00000001:00080000:1.0F:1762166766.777543:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869330 is committed 00000001:00080000:1.0:1762166766.777568:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869328 is committed 00000001:00080000:1.0:1762166766.777601:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869331 is committed 00010000:00010000:1.0:1762166766.952855:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1762166767.532730:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166767.532815:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444172544 00000100:00100000:1.0:1762166767.532826:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444172544 00000100:00100000:1.0:1762166767.532905:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2272 00000100:00100000:1.0:1762166767.532916:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+7:34576:x1847765444172544:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:1.0:1762166767.532939:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166767.532962:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9a94d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f904b4 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.533023:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9a954 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.533037:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9a954 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.533066:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9a954 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:1.0:1762166767.533143:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:1.0:1762166767.533148:0:5757:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 18 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166767.533174:0:5757:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9a954 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.533201:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9a94d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904b4 expref: 9 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.533216:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9a954 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904b4 expref: 8 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.533225:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34c9fad00) 00010000:00010000:1.0:1762166767.533251:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762166767.533256:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7ca00, rc 0) 00000100:00100000:1.0:1762166767.533327:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:34576:x1847765444172544:12345-192.168.203.35@tcp:101:rm.0 Request processed in 413us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166767.533334:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2272 00000100:00100000:3.0:1762166767.536517:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166767.541933:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00080000:3.0:1762166767.542085:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1762166767.550511:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166767.550519:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc0e000/0xf915a5bdf3c9a993 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.550527:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc0e000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166767.550531:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc0e000/0xf915a5bdf3c9a993 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.550539:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc0e000/0xf915a5bdf3c9a993 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.550549:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ee36062bf00) 00010000:00010000:1.0:1762166767.550552:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166767.550556:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc0e000/0xf915a5bdf3c9a993 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.550562:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc0e000/0xf915a5bdf3c9a993 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.550576:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166767.550578:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166767.550580:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166767.555432:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166767.558742:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00080000:3.0:1762166767.558959:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166767.562923:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166767.562989:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444173696 00000100:00100000:1.0:1762166767.563000:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444173696 00000100:00100000:1.0:1762166767.563069:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2277 00000100:00100000:1.0:1762166767.563080:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+9:34576:x1847765444173696:12345-192.168.203.35@tcp:36:rm.0 00010000:00010000:1.0:1762166767.563138:0:5757:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762166767.563165:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc0e200/0xf915a5bdf3c9a9bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904d0 expref: 9 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.563180:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff9ee36062b300) 00010000:00010000:1.0:1762166767.563196:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc0fc00/0xf915a5bdf3c9a9a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904c9 expref: 8 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.563205:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee36062b200) 00010000:00010000:1.0:1762166767.563211:0:5757:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166767.563234:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9a9cb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.563246:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9a9cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.563255:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9a9cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.563267:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9a9d2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.563274:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9a9d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.563280:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9a9d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.563382:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9a9d9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.563390:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9a9d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.563403:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9a9d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000040:00080000:1.0:1762166767.563805:0:5757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].93, 64 off15824 00000040:00080000:1.0:1762166767.563833:0:5757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].90, 64 off15512 00000040:00080000:1.0:1762166767.563850:0:5757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].94, 64 off15888 00010000:00010000:1.0:1762166767.563910:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9a9e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.563919:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9a9e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.563926:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9a9e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.563933:0:5757:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9a9e0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.563938:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9a9e0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.563943:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9a9e0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.563971:0:5757:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166767.563988:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9a9d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.563994:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9a9d9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.564000:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9a9d9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.564005:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166767.564014:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9a9d9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.564021:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9a9d9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.564030:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff9ee34c9fa700) 00010000:00010000:1.0:1762166767.564033:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1762166767.564036:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9a9d9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.564053:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9a9d9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.564098:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9a9cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.564104:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9a9cb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.564109:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9a9cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.564114:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7d800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166767.564117:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9a9cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.564122:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9a9cb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.564129:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34c9faf00) 00010000:00010000:1.0:1762166767.564132:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166767.564134:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9a9cb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.564149:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9a9cb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00000004:00010000:1.0:1762166767.564162:0:5757:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d17ceda4 reply state 0000000047e5ad4a transno 4294968770 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9a9d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000100:00100000:1.0:1762166767.564170:0:5757:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166767.564252:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+9:34576:x1847765444173696:12345-192.168.203.35@tcp:36:rm.0 Request processed in 1173us (1338us total) trans 4294968770 rc 0/0 00000100:00100000:1.0:1762166767.564259:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2277 00010000:00010000:3.0:1762166767.564433:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166767.564440:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9a9e0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166767.564447:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7dc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166767.564450:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9a9e0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166767.564456:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9a9e0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166767.564465:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff9ee34c9fa700) 00010000:00010000:3.0:1762166767.564467:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166767.564470:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9a9e0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166767.564475:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9a9e0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166767.564487:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166767.564489:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166767.564491:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166767.570099:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9a9d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.570116:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9a9d2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.570123:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9a9d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.570129:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166767.570133:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9a9d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.570140:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9a9d2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.570160:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdf5e0693 (ffff9ee34c9fa600) 00010000:00010000:1.0:1762166767.570163:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166767.570166:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9a9d2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166767.570172:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9a9d2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00000100:00100000:3.0:1762166767.786462:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451897472 00000100:00100000:3.0:1762166767.786484:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451897472 00010000:00010000:1.0:1762166767.976084:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166768.228342:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166768.228383:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166768.228417:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166768.228449:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166768.229312:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444174080 00000100:00100000:1.0:1762166768.229316:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444174208 00000100:00100000:3.0:1762166768.229317:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444174080 00000100:00100000:1.0:1762166768.229324:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444174208 00000100:00100000:3.0:1762166768.229360:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 154 00000100:00100000:3.0:1762166768.229371:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+6:2358:x1847765444174080:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762166768.229410:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+6:2358:x1847765444174080:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 42us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166768.229417:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 154 00000100:00100000:1.0:1762166768.296292:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762166768.296317:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f620a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451897600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762166768.296402:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166768.296656:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836650 gen 2 00000004:00080000:1.0:1762166768.296663:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee3493ae680, transno 21474836646 00000004:00080000:1.0:1762166768.296676:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee3493af480, transno 21474836647 00000004:00080000:1.0:1762166768.296679:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee3493ac700, transno 21474836648 00000004:00080000:1.0:1762166768.296683:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b2d80, transno 21474836649 00000004:00080000:1.0:1762166768.296686:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b2300, transno 21474836650 00000100:00100000:1.0:1762166768.296698:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f620a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451897600:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1762166768.296912:0:6728:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 3 changes, 0 in progress, 0 in flight, 5 done 00010000:00010000:3.0:1762166768.999899:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166770.024851:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166770.855945:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451897728:0@lo:400:kworker.0 00000100:00100000:3.0:1762166770.856011:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166770.856080:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765451898240:0@lo:400:kworker.0 00000100:00100000:3.0:1762166770.856111:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166770.856155:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1762166770.856163:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1847765451897856:0@lo:400:kworker.0 00000100:00100000:3.0:1762166770.856189:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166770.856219:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1847765451898368:0@lo:400:kworker.0 00000100:00100000:3.0:1762166770.856244:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166770.856282:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451897984:0@lo:400:kworker.0 00000100:00100000:3.0:1762166770.856310:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166770.856334:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1762166770.856342:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451898112:0@lo:400:kworker.0 00000100:00100000:3.0:1762166770.856364:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166770.856418:0:5749:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451897728 00000100:00100000:3.0:1762166770.856425:0:5749:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451897728 00000100:00100000:3.0:1762166770.856488:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1762166770.856498:0:5749:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765451897728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166770.856549:0:5749:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765451897728:12345-0@lo:400:kworker.0 Request processed in 53us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166770.856557:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1762166770.856598:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451898240 00000100:00100000:3.0:1762166770.856602:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451898240 00000100:00100000:3.0:1762166770.856645:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451897856 00000100:00100000:3.0:1762166770.856648:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451897856 00000100:00100000:3.0:1762166770.856671:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451898368 00000100:00100000:3.0:1762166770.856675:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451898368 00000100:00100000:3.0:1762166770.856700:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1762166770.856709:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765451898240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166770.856747:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765451898240:12345-0@lo:400:kworker.0 Request processed in 39us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166770.856754:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1762166770.856794:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1762166770.856802:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1847765451897856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166770.856835:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1847765451897856:12345-0@lo:400:kworker.0 Request processed in 35us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166770.856842:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1762166770.856862:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1762166770.856871:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1847765451898368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166770.856901:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1847765451898368:12345-0@lo:400:kworker.0 Request processed in 32us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166770.856908:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1762166770.856936:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451897984 00000100:00100000:3.0:1762166770.856945:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451897984 00000100:00100000:3.0:1762166770.856980:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451898112 00000100:00100000:3.0:1762166770.856983:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451898112 00000100:00100000:3.0:1762166770.857751:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1762166770.857782:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451897984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166770.857831:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451897984:12345-0@lo:400:kworker.0 Request processed in 72us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166770.857839:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1762166770.857860:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1762166770.857869:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451898112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166770.857902:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451898112:12345-0@lo:400:kworker.0 Request processed in 35us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166770.857909:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:3.0:1762166770.857943:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1762166770.857948:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1762166770.857952:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166770.858632:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451898112:0@lo:400:kworker.0 00000100:00100000:3.0:1762166770.858650:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451897984:0@lo:400:kworker.0 00000100:00100000:3.0:1762166770.858753:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1847765451897856:0@lo:400:kworker.0 00000100:00100000:3.0:1762166770.858787:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1847765451898368:0@lo:400:kworker.0 00000100:00100000:3.0:1762166770.858801:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451897728:0@lo:400:kworker.0 00000100:00100000:3.0:1762166770.858818:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765451898240:0@lo:400:kworker.0 00000001:00080000:1.0:1762166770.902085:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968769 is committed 00000004:00080000:1.0:1762166770.902094:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 82 committed 00000100:00100000:3.0:1762166770.902260:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451898496:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166770.902321:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166770.902377:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451898496 00000100:00100000:3.0:1762166770.902384:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451898496 00000100:00100000:3.0:1762166770.902423:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:3.0:1762166770.902431:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451898496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1762166770.902456:0:7858:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:69 count 1 00002000:00010000:3.0:1762166770.902486:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166770.902494:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ca00/0xf915a5bdf3c9a9e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166770.902507:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166770.902510:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166770.902515:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ca00/0xf915a5bdf3c9a9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166770.902530:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ca00/0xf915a5bdf3c9a9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166770.902538:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ca00/0xf915a5bdf3c9a9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166770.902545:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ca00/0xf915a5bdf3c9a9e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166770.902562:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1762166770.902998:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765451898496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 566us (676us total) trans 17179869332 rc 0/0 00000100:00100000:3.0:1762166770.903006:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000004:00080000:3.0:1762166770.903062:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de2f100/2, rc 0, transno 17179869332 00000100:00100000:3.0:1762166770.903072:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451898496:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1762166770.903139:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 87 committed 00000001:00080000:1.0:1762166770.903157:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968770 is committed 00010000:00010000:1.0:1762166770.903186:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166770.903193:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ca00/0xf915a5bdf3c9a9e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166770.903202:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105ca00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166770.903207:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ca00/0xf915a5bdf3c9a9e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166770.903216:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ca00/0xf915a5bdf3c9a9e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166770.903238:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ca00/0xf915a5bdf3c9a9e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166770.903246:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ca00/0xf915a5bdf3c9a9e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166770.903272:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166770.903274:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166770.903276:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166770.903312:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee3819b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451898624:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166770.903339:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166770.903365:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451898624 00000100:00100000:1.0:1762166770.903369:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451898624 00000100:00100000:1.0:1762166770.903391:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:1.0:1762166770.903398:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1847765451898624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1762166770.903410:0:6535:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:71 count 1 00010000:00010000:1.0:1762166770.903424:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9a9ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166770.903438:0:6535:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee348244400/0xf915a5bdf3c9a977 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904c2 expref: 5 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166770.903446:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166770.903448:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166770.903450:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9a9ee lrc: 4/0,1 mode: --/PW res: [0x240000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166770.903484:0:6535:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee348244400/0xf915a5bdf3c9a977 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904c2 expref: 5 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166770.903496:0:6535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee348244400/0xf915a5bdf3c9a977 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904c2 expref: 5 pid: 6535 timeout: 491 lvb_type: 1 00000100:00100000:1.0:1762166770.903508:0:6535:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee3819b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765451898752:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166770.903568:0:6535:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166770.909553:0:6535:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee3819b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765451898752:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166770.909581:0:6535:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9a9ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166770.910483:0:6535:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9a9ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166770.910493:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9a9ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166770.910503:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9a9ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166770.910511:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9a9ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166770.910536:0:6535:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166770.910559:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166770.910568:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9a9ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166770.910578:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166770.910583:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9a9ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166770.910593:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9a9ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166770.910607:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9a9ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166770.910614:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9a9ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166770.910637:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166770.910641:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166770.910643:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166770.910994:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765451898624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7594us (7652us total) trans 21474836651 rc 0/0 00000100:00100000:1.0:1762166770.911002:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00010000:00010000:3.0:1762166771.047927:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166772.074079:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1762166772.406028:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836651 is committed 00000001:02000400:1.0:1762166772.885700:0:28403:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-flr test_43a needs >= 3 OSTs 00000100:00100000:3.0:1762166772.904318:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451898880 00000100:00100000:3.0:1762166772.904326:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451898880 00000100:00100000:3.0:1762166772.904405:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1762166772.904420:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765451898880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1762166772.904457:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 73203712 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1762166772.904516:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765451898880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166772.904529:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00010000:3.0:1762166773.096044:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166773.348424:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444174592 00000100:00100000:3.0:1762166773.348434:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444174592 00000100:00100000:3.0:1762166773.348491:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 199 00000100:00100000:3.0:1762166773.348501:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+5:2361:x1847765444174592:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:1.0:1762166773.348539:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444174720 00000100:00100000:1.0:1762166773.348545:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444174720 00000100:00100000:1.0:1762166773.348581:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444174848 00000100:00100000:1.0:1762166773.348584:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444174848 00000100:00100000:1.0:1762166773.348618:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 158 00000100:00100000:3.0:1762166773.348624:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+5:2361:x1847765444174592:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 122us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166773.348633:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+5:2361:x1847765444174720:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762166773.348636:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 199 00000100:00100000:1.0:1762166773.348675:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+5:2361:x1847765444174720:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 47us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166773.348685:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 158 00000100:00100000:1.0:1762166773.348706:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 159 00000100:00100000:1.0:1762166773.348718:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+6:2361:x1847765444174848:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:1.0:1762166773.348748:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+6:2361:x1847765444174848:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 32us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166773.348804:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 159 00000100:00080000:1.0:1762166773.348837:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1762166773.348842:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166773.416119:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451899008 00000100:00100000:1.0:1762166773.416127:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451899008 00000100:00100000:1.0:1762166773.416223:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1762166773.416235:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765451899008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1762166773.416275:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 46071808 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1762166773.416339:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765451899008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166773.416354:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1762166773.572458:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.572535:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444174976 00000100:00100000:3.0:1762166773.572546:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444174976 00000100:00100000:3.0:1762166773.572614:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2278 00000100:00100000:3.0:1762166773.572627:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+5:35438:x1847765444174976:12345-192.168.203.35@tcp:101:mkdir.0 00010000:00010000:3.0:1762166773.572646:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166773.572678:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9a9f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f904de expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.572744:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9a9fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.572757:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9a9fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.572801:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9a9fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166773.572863:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:3.0:1762166773.572867:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 16 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166773.572902:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9a9fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.572933:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9a9f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904de expref: 7 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.572961:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9a9fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904de expref: 6 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.572969:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13a00) 00010000:00010000:3.0:1762166773.572972:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166773.572976:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105d000, rc 0) 00000100:00100000:3.0:1762166773.573051:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+6:35438:x1847765444174976:12345-192.168.203.35@tcp:101:mkdir.0 Request processed in 426us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166773.573060:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2278 00000100:00100000:3.0:1762166773.575264:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166773.577815:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5000/0xf915a5bdf3c9aa0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.577831:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5000/0xf915a5bdf3c9aa0a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.577837:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5000/0xf915a5bdf3c9aa0a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.577844:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.577847:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5000/0xf915a5bdf3c9aa0a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.577854:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5000/0xf915a5bdf3c9aa0a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.577867:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6a87ace7 (ffff9ee36062bd00) 00010000:00010000:3.0:1762166773.577877:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.577882:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5000/0xf915a5bdf3c9aa0a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.577888:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5000/0xf915a5bdf3c9aa0a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166773.583154:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.585452:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444175488 00000100:00100000:3.0:1762166773.585459:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444175488 00000100:00100000:3.0:1762166773.585512:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2281 00000100:00100000:3.0:1762166773.585522:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+7:35441:x1847765444175488:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:3.0:1762166773.585539:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166773.585556:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9aa1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f904ec expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.585618:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9aa26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.585629:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9aa26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.585643:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9aa26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.585669:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9aa2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.585675:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9aa2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.585679:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9aa2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.585810:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ca00/0xf915a5bdf3c9aa34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.585818:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ca00/0xf915a5bdf3c9aa34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.585825:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ca00/0xf915a5bdf3c9aa34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166773.585876:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 512 00000004:00200000:3.0:1762166773.585879:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166773.585900:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ca00/0xf915a5bdf3c9aa34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.585912:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9aa26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.585918:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9aa26 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.585924:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9aa26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.585930:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.585934:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9aa26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.585942:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9aa26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.585954:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee36062b400) 00010000:00010000:3.0:1762166773.585958:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.585962:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9aa26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.585976:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9aa26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.586008:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9aa2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.586015:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9aa2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.586021:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9aa2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.586026:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.586030:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9aa2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.586036:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9aa2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.586044:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6a87ace7 (ffff9ee343a13d00) 00010000:00010000:3.0:1762166773.586047:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.586050:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9aa2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.586056:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9aa2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.586086:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9aa1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904ec expref: 9 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.586099:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ca00/0xf915a5bdf3c9aa34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904ec expref: 8 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.586118:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.586120:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1762166773.586123:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105ca00, rc 0) 00000100:00100000:3.0:1762166773.586181:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:35441:x1847765444175488:12345-192.168.203.35@tcp:101:rm.0 Request processed in 660us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166773.586188:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2281 00000100:00100000:1.0:1762166773.588034:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.588115:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444175616 00000100:00100000:3.0:1762166773.588123:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444175616 00000100:00100000:3.0:1762166773.588173:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2282 00000100:00100000:3.0:1762166773.588184:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:35441:x1847765444175616:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:3.0:1762166773.588203:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166773.588221:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aa3b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f904f3 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.588279:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa42 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588292:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588303:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588315:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588322:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588329:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588409:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588416:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa42 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588422:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588427:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105c200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.588431:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588438:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa42 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588449:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.588452:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.588456:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588462:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588483:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588489:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa49 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588494:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588498:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.588509:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588514:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588522:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x8f0a8bfd (ffff9ee343a13700) 00010000:00010000:3.0:1762166773.588525:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.588527:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa49 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588533:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.588566:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aa3b lrc: 1/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904f3 expref: 9 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.588576:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.588579:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.588582:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aa3b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904f3 expref: 9 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.588600:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105dc00, rc 0) 00000100:00100000:3.0:1762166773.588662:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:35441:x1847765444175616:12345-192.168.203.35@tcp:101:rm.0 Request processed in 480us (634us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166773.588671:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2282 00000100:00100000:3.0:1762166773.590151:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444175744 00000100:00100000:3.0:1762166773.590159:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444175744 00000100:00100000:3.0:1762166773.590213:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2283 00000100:00100000:3.0:1762166773.590225:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dd12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:35441:x1847765444175744:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:3.0:1762166773.590251:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166773.590267:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9aa50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f904fa expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.590324:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa57 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590336:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590346:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590360:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590368:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590374:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590450:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590458:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa57 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590464:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590470:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105c000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.590474:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590487:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa57 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590497:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.590500:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.590502:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590507:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590525:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590529:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590533:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590538:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.590540:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590546:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590553:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x8f0a8bfd (ffff9ee343a13100) 00010000:00010000:3.0:1762166773.590556:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.590563:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa5e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590569:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.590612:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9aa50 lrc: 1/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904fa expref: 9 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.590622:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.590624:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.590628:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9aa50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904fa expref: 9 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.590639:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105ce00, rc 0) 00000100:00100000:3.0:1762166773.590694:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dd12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:35441:x1847765444175744:12345-192.168.203.35@tcp:101:rm.0 Request processed in 472us (586us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166773.590701:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2283 00000100:00100000:3.0:1762166773.607454:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444175872 00000100:00100000:3.0:1762166773.607473:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444175872 00000100:00100000:3.0:1762166773.607546:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2284 00000100:00100000:3.0:1762166773.607559:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ecfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:35447:x1847765444175872:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166773.607580:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166773.607598:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9aa65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90501 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.607660:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa6c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607673:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa6c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607683:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa6c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607708:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607715:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607721:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607811:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa6c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607820:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa6c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607827:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607833:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.607838:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607846:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa6c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607856:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.607860:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.607863:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607868:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9aa6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607887:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607900:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607906:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607910:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105c000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.607913:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607919:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607949:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x8f0a8bfd (ffff9ee343a13100) 00010000:00010000:3.0:1762166773.607952:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.607956:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa73 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.607962:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9aa73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.608011:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9aa65 lrc: 1/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90501 expref: 9 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.608022:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.608025:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.608029:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9aa65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90501 expref: 9 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.608041:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105ce00, rc 0) 00000100:00100000:3.0:1762166773.608103:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ecfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:35447:x1847765444175872:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 547us (727us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166773.608116:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2284 00000100:00100000:1.0:1762166773.609710:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.609757:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444176000 00000100:00100000:3.0:1762166773.609937:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444176000 00000100:00100000:3.0:1762166773.610012:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2285 00000100:00100000:3.0:1762166773.610024:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:35447:x1847765444176000:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166773.610041:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166773.610058:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aa7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90508 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.610111:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa81 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610123:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610133:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610146:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610153:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610161:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610221:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610228:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa81 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610253:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610259:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.610263:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610269:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa81 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610281:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.610284:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.610289:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610295:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9aa81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610318:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610324:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610329:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610334:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105c200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.610338:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610344:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610362:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x8f0a8bfd (ffff9ee343a13700) 00010000:00010000:3.0:1762166773.610365:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.610368:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa88 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610375:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9aa88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.610406:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aa7a lrc: 1/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90508 expref: 9 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.610416:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.610418:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.610421:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aa7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90508 expref: 9 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.610438:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105dc00, rc 0) 00000100:00100000:3.0:1762166773.610514:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:35447:x1847765444176000:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 492us (809us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166773.610521:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2285 00000100:00100000:1.0:1762166773.612052:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.612097:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444176128 00000100:00100000:3.0:1762166773.612104:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444176128 00000100:00100000:3.0:1762166773.612155:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2286 00000100:00100000:3.0:1762166773.612168:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:35447:x1847765444176128:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166773.612184:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166773.612201:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9aa8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9050f expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.612271:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9aa96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.612282:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9aa96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.612292:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9aa96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166773.612348:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 512 00000004:00200000:3.0:1762166773.612352:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166773.612381:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9aa96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.612407:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9aa8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9050f expref: 10 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.612431:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9aa96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9050f expref: 9 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.612439:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.612442:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166773.612446:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105d000, rc 0) 00000100:00100000:3.0:1762166773.612504:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+9:35447:x1847765444176128:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 340us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166773.612512:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2286 00000100:00100000:3.0:1762166773.614510:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444176256 00000100:00100000:3.0:1762166773.614517:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444176256 00000100:00100000:3.0:1762166773.614570:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2287 00000100:00100000:3.0:1762166773.614577:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ecf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+9:35447:x1847765444176256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166773.614599:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166773.614614:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9aa9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90516 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.614667:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9aaa4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614679:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9aaa4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614689:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9aaa4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614701:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9aaab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614707:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9aaab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614713:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9aaab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614784:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9aaa4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614791:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9aaa4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614797:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9aaa4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614802:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.614806:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9aaa4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614822:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9aaa4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614833:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.614836:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.614840:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9aaa4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614846:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9aaa4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614866:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9aaab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614872:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9aaab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614877:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9aaab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614881:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.614883:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9aaab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614889:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9aaab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614895:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x8f0a8bfd (ffff9ee343a13d00) 00010000:00010000:3.0:1762166773.614904:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.614907:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9aaab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614912:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9aaab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.614950:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9aa9d lrc: 1/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90516 expref: 10 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.614960:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.614962:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.614966:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9aa9d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90516 expref: 10 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.614976:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105da00, rc 0) 00000100:00100000:3.0:1762166773.615044:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ecf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+9:35447:x1847765444176256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 466us (587us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166773.615052:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2287 00000100:00100000:1.0:1762166773.616459:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.616493:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444176512 00000100:00100000:3.0:1762166773.616501:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444176512 00000100:00100000:3.0:1762166773.616539:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2288 00000100:00100000:3.0:1762166773.616548:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+9:35447:x1847765444176512:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166773.616564:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166773.616567:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1762166773.616584:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9aa96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9050f expref: 9 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.616606:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.616609:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166773.616619:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9aab2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9051d expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.616715:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9aab9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.616735:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9aab9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.616744:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9aab9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.616757:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9aac0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.616794:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9aac0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.616801:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9aac0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.617210:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9aac7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.617219:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9aac7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.617225:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9aac7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166773.617234:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 0 00010000:00010000:3.0:1762166773.617257:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9aab9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.617263:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9aab9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.617270:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9aab9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.617276:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.617285:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9aab9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.617292:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9aab9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.617300:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.617302:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.617304:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9aab9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.617308:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9aab9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000004:00010000:3.0:1762166773.617319:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cadcb1ae reply state 0000000030e9bcbb transno 4294968772 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9aac0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166773.617327:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1762166773.617348:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9aab2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9051d expref: 11 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.617361:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9aac7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9051d expref: 10 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.617368:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9ee343a13a00) 00010000:00010000:3.0:1762166773.617371:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166773.617373:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105c400, rc 0) 00000100:00100000:3.0:1762166773.617429:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+11:35447:x1847765444176512:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 882us (973us total) trans 4294968772 rc 0/0 00000100:00100000:3.0:1762166773.617436:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2288 00000100:00100000:1.0:1762166773.619038:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.619108:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444176768 00000100:00100000:3.0:1762166773.619116:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444176768 00000100:00100000:3.0:1762166773.619175:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2289 00000100:00100000:3.0:1762166773.619184:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+10:35447:x1847765444176768:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166773.619203:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166773.619216:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9aad5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90524 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.619294:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aadc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.619306:0:6558:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9aac7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9051d expref: 11 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.619314:0:6558:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aadc lrc: 4/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.619345:0:6558:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9aac7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9051d expref: 11 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.619357:0:6558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9aac7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9051d expref: 11 pid: 6558 timeout: 494 lvb_type: 0 00000100:00100000:3.0:1762166773.619370:0:6558:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de2d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451899136:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166773.619442:0:6558:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166773.620254:0:6558:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de2d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451899136:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166773.620268:0:6558:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aadc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:1.0:1762166773.620546:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166773.620837:0:6558:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aadc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.620857:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aadc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166773.620872:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 0 00000004:00080000:3.0:1762166773.621193:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x47:0x0], index 1: 0 00000004:00080000:3.0:1762166773.621205:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4a:0x0], index 0: 0 00000004:00080000:3.0:1762166773.621211:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x48:0x0], index 1: 0 00010000:00010000:3.0:1762166773.621357:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aadc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.621366:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aadc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.621422:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aadc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.621428:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105dc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.621432:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aadc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.621439:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aadc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.621448:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9ee343a13a00) 00010000:00010000:3.0:1762166773.621452:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166773.621455:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aadc lrc: 2/0,0 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.621461:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aadc lrc: 0/0,0 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.621521:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9aad5 lrc: 1/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90524 expref: 11 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.621537:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.621540:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166773.621544:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9aad5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90524 expref: 11 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.621555:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105d600, rc 0) 00000100:00100000:3.0:1762166773.621603:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+10:35447:x1847765444176768:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2419us (2568us total) trans 4294968773 rc 301/301 00000100:00100000:3.0:1762166773.621611:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2289 00000100:00100000:1.0:1762166773.623039:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.623085:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444177152 00000100:00100000:3.0:1762166773.623093:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444177152 00000100:00100000:3.0:1762166773.623139:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 677 00000100:00100000:3.0:1762166773.623149:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+10:35447:x1847765444177152:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166773.623425:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+11:35447:x1847765444177152:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 277us (387us total) trans 4294968774 rc 0/0 00000100:00100000:3.0:1762166773.623433:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 677 00000100:00100000:1.0:1762166773.624362:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.624411:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444177408 00000100:00100000:3.0:1762166773.624418:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444177408 00000100:00100000:3.0:1762166773.624450:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 678 00000100:00100000:3.0:1762166773.624459:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345abc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+11:35447:x1847765444177408:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166773.624588:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345abc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:35447:x1847765444177408:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 130us (240us total) trans 4294968775 rc 0/0 00000100:00100000:3.0:1762166773.624596:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 678 00000100:00100000:3.0:1762166773.634218:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444177664 00000100:00100000:3.0:1762166773.634241:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444177664 00000100:00100000:3.0:1762166773.634291:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2290 00000100:00100000:3.0:1762166773.634298:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ecfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:35449:x1847765444177664:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166773.634324:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166773.634343:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9aaea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9052b expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.634415:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aaf1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634430:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aaf1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634440:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aaf1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634453:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9aaf8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634460:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9aaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634465:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9aaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634565:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aaf1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634573:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aaf1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634579:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aaf1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634595:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105dc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.634599:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aaf1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634607:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aaf1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634618:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.634622:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.634625:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aaf1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634631:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9aaf1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634654:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9aaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634660:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9aaf8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634665:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9aaf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634670:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.634673:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9aaf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634679:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9aaf8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634685:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x8f0a8bfd (ffff9ee343a13a00) 00010000:00010000:3.0:1762166773.634688:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.634698:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9aaf8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634704:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9aaf8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.634739:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9aaea lrc: 1/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9052b expref: 13 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.634749:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.634752:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166773.634755:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9aaea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9052b expref: 13 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.634805:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105d600, rc 0) 00000100:00100000:3.0:1762166773.634867:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ecfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:35449:x1847765444177664:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 567us (769us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166773.634874:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2290 00000100:00100000:1.0:1762166773.636243:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.636270:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444177920 00000100:00100000:3.0:1762166773.636277:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444177920 00000100:00100000:3.0:1762166773.636316:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2291 00000100:00100000:3.0:1762166773.636325:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:35449:x1847765444177920:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166773.636339:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166773.636351:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9aaff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90532 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1762166773.636440:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 512 00010000:00010000:3.0:1762166773.636544:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9aaff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90532 expref: 14 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.636569:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee36062b400) 00010000:00010000:3.0:1762166773.636572:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166773.636576:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9aaff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90532 expref: 14 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.636592:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105d400, rc 0) 00000100:00100000:3.0:1762166773.636638:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+13:35449:x1847765444177920:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 315us (400us total) trans 4294968776 rc 301/301 00000100:00100000:3.0:1762166773.636645:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2291 00000100:00100000:1.0:1762166773.637562:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.637595:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444178048 00000100:00100000:3.0:1762166773.637601:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444178048 00000100:00100000:3.0:1762166773.637638:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2292 00000100:00100000:3.0:1762166773.637647:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+13:35449:x1847765444178048:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:3.0:1762166773.637694:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9ab0d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.637706:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9ab0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.637716:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9ab0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.637729:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ab14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.637734:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ab14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.637740:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ab14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.637904:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.637912:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.637918:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166773.637957:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 0 00000004:00200000:3.0:1762166773.637961:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166773.637969:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.637981:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9ab0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.637987:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9ab0d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.637992:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9ab0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.638009:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.638012:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9ab0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.638019:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9ab0d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.638028:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.638031:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.638034:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9ab0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.638046:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9ab0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.638061:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ab14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.638067:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ab14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.638072:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ab14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.638077:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.638080:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ab14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.638085:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ab14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.638092:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x8f0a8bfd (ffff9ee343a13d00) 00010000:00010000:3.0:1762166773.638095:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.638097:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ab14 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.638103:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ab14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.638118:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.638123:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab1b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.638128:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.638138:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.638142:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.638147:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.638155:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9ee343a13700) 00010000:00010000:3.0:1762166773.638157:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.638159:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab1b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.638164:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166773.638222:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+13:35449:x1847765444178048:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 576us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166773.638229:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2292 00000100:00100000:3.0:1762166773.639369:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444178304 00000100:00100000:3.0:1762166773.639374:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444178304 00000100:00100000:3.0:1762166773.639404:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 679 00000100:00100000:3.0:1762166773.639409:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ecf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+13:35449:x1847765444178304:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166773.639594:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ecf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+14:35449:x1847765444178304:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 184us (276us total) trans 4294968777 rc 0/0 00000100:00100000:3.0:1762166773.639601:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 679 00000100:00100000:1.0:1762166773.646212:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.646390:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444178560 00000100:00100000:3.0:1762166773.646400:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444178560 00000100:00100000:3.0:1762166773.646456:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2293 00000100:00100000:3.0:1762166773.646468:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+14:35451:x1847765444178560:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166773.646506:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166773.646523:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9ab22 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90539 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.646665:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9ab29 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646677:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9ab29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646686:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9ab29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646696:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9ab30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646700:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9ab30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646704:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9ab30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646753:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ab37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646758:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ab37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646819:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ab37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166773.646827:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 0 00010000:00010000:3.0:1762166773.646906:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9ab29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646918:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9ab29 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646922:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9ab29 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646925:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.646928:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9ab29 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646933:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9ab29 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646941:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166773.646942:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.646945:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9ab29 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646948:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9ab29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646959:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9ab30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646965:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9ab30 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646970:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9ab30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646975:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.646977:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9ab30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.646993:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9ab30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.647012:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x8f0a8bfd (ffff9ee343a13a00) 00010000:00010000:3.0:1762166773.647015:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.647017:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9ab30 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.647023:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9ab30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.647065:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9ab22 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90539 expref: 17 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.647078:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ab37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90539 expref: 16 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.647085:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:3.0:1762166773.647087:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166773.647090:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105dc00, rc 0) 00000100:00100000:3.0:1762166773.647151:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+16:35451:x1847765444178560:12345-192.168.203.35@tcp:101:dd.0 Request processed in 685us (945us total) trans 4294968778 rc 0/0 00000100:00100000:3.0:1762166773.647159:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2293 00000100:00100000:1.0:1762166773.648352:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.648389:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444178816 00000100:00100000:3.0:1762166773.648396:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444178816 00000100:00100000:3.0:1762166773.648435:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2294 00000100:00100000:3.0:1762166773.648442:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+16:35451:x1847765444178816:12345-192.168.203.35@tcp:36:dd.0 00010000:00010000:3.0:1762166773.648478:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166773.648500:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ab37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90539 expref: 16 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.648518:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:3.0:1762166773.648524:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166773.648680:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab45 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.648691:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.648698:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000001:00080000:3.0:1762166773.648747:0:6558:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968779 00000004:00010000:3.0:1762166773.648791:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000020c44d32 reply state 000000004f253d69 transno 4294968780 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166773.648799:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166773.648866:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:35451:x1847765444178816:12345-192.168.203.35@tcp:36:dd.0 Request processed in 423us (515us total) trans 4294968780 rc 0/0 00000100:00100000:3.0:1762166773.648873:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2294 00000020:00080000:3.0:1762166773.648878:0:6558:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762166773.649706:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.649717:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab45 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.649723:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab45 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.649728:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166773.649739:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab45 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.649747:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab45 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.649782:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9ee343a13700) 00010000:00010000:3.0:1762166773.649786:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166773.649790:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab45 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.649794:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ab45 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:1.0:1762166773.649946:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.649990:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444178944 00000100:00100000:3.0:1762166773.650049:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444178944 00000100:00100000:3.0:1762166773.650086:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2295 00000100:00100000:3.0:1762166773.650094:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+17:35451:x1847765444178944:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166773.650109:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166773.650121:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ab4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90540 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.650155:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ab4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90540 expref: 18 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.650165:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ab4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90540 expref: 18 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.650178:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9ee343a13d00) 00010000:00010000:3.0:1762166773.650181:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166773.650184:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105da00, rc 0) 00000100:00100000:3.0:1762166773.650228:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:35451:x1847765444178944:12345-192.168.203.35@tcp:101:dd.0 Request processed in 134us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166773.650234:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2295 00000100:00100000:3.0:1762166773.651189:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444179200 00000100:00100000:3.0:1762166773.651195:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444179200 00000100:00100000:3.0:1762166773.651228:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2296 00000100:00100000:3.0:1762166773.651236:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:35451:x1847765444179200:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166773.651246:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166773.651249:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1762166773.651265:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ab4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90540 expref: 18 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.651282:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9ee343a13d00) 00010000:00010000:3.0:1762166773.651289:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166773.651298:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9ab53 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90547 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.651326:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9ab5a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.651335:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9ab5a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166773.651343:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9ab5a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000040:00080000:3.0:1762166773.651656:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].91, 88 off15600 00000004:00080000:3.0:1762166773.651666:0:6558:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394443902609ns, next at 394696397876ns, rc = 0 00000040:00080000:3.0:1762166773.651721:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].95, 88 off15976 00000004:00080000:3.0:1762166773.651729:0:6558:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394443965775ns, next at 395208511542ns, rc = 0 00000040:00080000:3.0:1762166773.651813:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].92, 88 off15688 00000004:00080000:3.0:1762166773.651819:0:6558:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394444056593ns, next at 394696397876ns, rc = 0 00000001:00080000:1.0:1762166773.664823:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968771 is committed 00000004:00080000:1.0:1762166773.664848:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 88 committed 00000004:00080000:1.0:1762166773.664869:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 83 committed 00000001:00080000:1.0:1762166773.664891:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968781 is committed 00000004:00080000:1.0:1762166773.664899:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 85 committed 00000004:00080000:1.0:1762166773.664903:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 89 committed 00000004:00080000:1.0:1762166773.664907:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 84 committed 00000100:00100000:1.0:1762166773.664971:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451899264:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166773.665063:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166773.665112:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451899776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166773.665147:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166773.665194:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451899520:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166773.665216:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451899776 00000100:00100000:3.0:1762166773.665223:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451899776 00000100:00100000:1.0:1762166773.665228:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166773.665266:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451899520 00000100:00100000:1.0:1762166773.665270:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451899520 00000100:00100000:1.0:1762166773.665297:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:1.0:1762166773.665307:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3293:x1847765451899264:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166773.665327:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00002000:00080000:1.0:1762166773.665330:0:12400:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:70 count 1 00000100:00100000:3.0:1762166773.665337:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3294:x1847765451899904:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1762166773.665353:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9ab61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.665373:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9a9c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904d7 expref: 5 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166773.665382:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166773.665384:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166773.665388:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9ab61 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.665418:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9a9c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904d7 expref: 5 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166773.665432:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9a9c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904d7 expref: 5 pid: 6535 timeout: 494 lvb_type: 1 00000100:00100000:1.0:1762166773.665445:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee3493af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765451900032:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166773.665496:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:3.0:1762166773.665508:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765451899520:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166773.665512:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a300 going to sleep for 11 seconds 00002000:00080000:3.0:1762166773.665522:0:6532:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:73 count 1 00002000:00010000:1.0:1762166773.666955:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166773.666963:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9ab68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.666991:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166773.666993:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166773.667011:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9ab68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.667035:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9ab68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.667046:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9ab68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.667058:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9ab68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.667084:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1762166773.667378:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3294:x1847765451899392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2062us (2259us total) trans 21474836653 rc 0/0 00000100:00100000:1.0:1762166773.667392:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00010000:00010000:1.0:1762166773.667422:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000004:00080000:3.0:1762166773.667426:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e2bca80/2, rc 0, transno 21474836653 00010000:00010000:1.0:1762166773.667430:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9ab68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166773.667436:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451899392:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1762166773.667447:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166773.667453:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9ab68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.667462:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9ab68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.667505:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9ab68 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.667514:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9ab68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.667534:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166773.667540:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee348245c00/0xf915a5bdf3c9ab76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.667556:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348245c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166773.667562:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee348245c00/0xf915a5bdf3c9ab76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.667571:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee348245c00/0xf915a5bdf3c9ab76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.667584:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee348245c00/0xf915a5bdf3c9ab76 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.667592:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee348245c00/0xf915a5bdf3c9ab76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.667597:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166773.667605:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9ab61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.667611:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166773.667615:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166773.667619:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166773.667627:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166773.667650:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166773.667654:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9ab61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762166773.667656:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e2bdf80/2, rc 0, transno 21474836654 00010000:00010000:3.0:1762166773.667661:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9ab61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166773.667666:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451899520:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1762166773.667683:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9ab61 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.667691:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9ab61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.667720:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166773.667723:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166773.667726:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1762166773.667947:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de2d180/2, rc 0, transno 17179869335 00000100:00100000:1.0:1762166773.667955:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451899264:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166773.680325:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.680377:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.694414:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.697186:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.699817:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.710436:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.713286:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.715902:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.718844:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.720844:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.723030:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166773.724702:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166773.726913:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166773.728667:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166773.742260:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451900672:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166773.742323:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451900544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166773.742369:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166773.742394:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1762166773.742410:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f7cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451900800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166773.742456:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166773.742570:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166773.742639:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:3.0:1762166773.742652:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3493af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765451900672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166773.742907:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3493af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765451900672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 256us (538us total) trans 21474836655 rc 0/0 00000100:00100000:3.0:1762166773.742920:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000004:00080000:3.0:1762166773.742976:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f2d2680/2, rc 0, transno 21474836655 00000100:00100000:3.0:1762166773.742990:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451900672:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762166773.743260:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f7cf480/2, rc 0, transno 17179869339 00000100:00100000:1.0:1762166773.743265:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451900544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166773.748738:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.773266:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166773.781975:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000001:00080000:3.0:1762166773.799261:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836656 is committed 00000001:00080000:3.0:1762166773.799283:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836652 is committed 00000001:00080000:3.0:1762166773.799290:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836653 is committed 00000001:00080000:3.0:1762166773.799296:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836654 is committed 00000001:00080000:3.0:1762166773.799305:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836655 is committed 00002000:00010000:1.0:1762166773.819991:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x48:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1762166773.820008:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x48:0x0] updating lvb mtime from disk: 0 -> 1762166774 00002000:00010000:1.0:1762166773.820011:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x48:0x0] updating lvb ctime from disk: 0 -> 1762166774 00002000:00010000:1.0:1762166773.820014:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x48:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1762166773.820027:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee348245e00/0xf915a5bdf3c9ac48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.820038:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348245e00/0xf915a5bdf3c9ac48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.820046:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee348245e00/0xf915a5bdf3c9ac48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.820053:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348245e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166773.820065:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348245e00/0xf915a5bdf3c9ac48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.820074:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348245e00/0xf915a5bdf3c9ac48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.820093:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee348245e00/0xf915a5bdf3c9ac48 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.820100:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee348245e00/0xf915a5bdf3c9ac48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166773.820193:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:22b95110-b0b2-4d2b-9402-7e0d82812a7e+6:2358:x1847765444182912:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 17141us (17310us total) trans 17179869340 rc 0/0 00000100:00100000:1.0:1762166773.820204:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 837 00000100:00100000:1.0:1762166773.829502:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166773.831629:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.833083:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166773.833138:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444183424 00000100:00100000:1.0:1762166773.833145:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444183424 00002000:00010000:1.0:1762166773.833172:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/74 (1048576->18446744073709551615) 00002000:00100000:1.0:1762166773.833177:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374af7100 with x1847765444183424 ext(1048576->18446744073709551615) 00002000:00010000:1.0:1762166773.833185:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee374af7100. 00000100:00100000:1.0:1762166773.833211:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 838 00000100:00100000:1.0:1762166773.833220:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:22b95110-b0b2-4d2b-9402-7e0d82812a7e+6:2360:x1847765444183424:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762166773.833426:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x4a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1762166773.833430:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x4a:0x0] updating lvb mtime from disk: 1762166774 -> 1762166774 00002000:00010000:1.0:1762166773.833432:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x4a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166773.833443:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x4a:0x0] updating lvb ctime from disk: 1762166774 -> 1762166774 00002000:00010000:1.0:1762166773.833446:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x4a:0x0] updating lvb blocks from disk: 2051 -> 2051 00000100:00100000:1.0:1762166773.833490:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:22b95110-b0b2-4d2b-9402-7e0d82812a7e+7:2360:x1847765444183424:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 271us (409us total) trans 21474836657 rc 0/0 00000100:00100000:1.0:1762166773.833498:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 838 00002000:00010000:1.0:1762166773.833502:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/74 (1048576->18446744073709551615) 00002000:00100000:1.0:1762166773.833505:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374af7100 with x1847765444183424 ext(1048576->18446744073709551615) 00002000:00010000:1.0:1762166773.833510:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee374af7100. 00000100:00100000:3.0:1762166773.834738:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.839025:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166773.839063:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444184064 00000100:00100000:1.0:1762166773.839069:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444184064 00002000:00010000:1.0:1762166773.839090:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/72 (1048576->18446744073709551615) 00002000:00100000:1.0:1762166773.839095:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374af6a00 with x1847765444184064 ext(1048576->18446744073709551615) 00002000:00010000:1.0:1762166773.839102:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee374af6a00. 00000100:00100000:1.0:1762166773.839126:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 839 00000100:00100000:1.0:1762166773.839135:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:22b95110-b0b2-4d2b-9402-7e0d82812a7e+7:2361:x1847765444184064:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762166773.839382:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x48:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1762166773.839386:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x48:0x0] updating lvb mtime from disk: 1762166774 -> 1762166774 00002000:00010000:1.0:1762166773.839389:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x48:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166773.839391:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x48:0x0] updating lvb ctime from disk: 1762166774 -> 1762166774 00002000:00010000:1.0:1762166773.839394:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x48:0x0] updating lvb blocks from disk: 2051 -> 2051 00000100:00100000:1.0:1762166773.839435:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:2361:x1847765444184064:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 301us (412us total) trans 17179869341 rc 0/0 00000100:00100000:1.0:1762166773.839443:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 839 00002000:00010000:1.0:1762166773.839447:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/72 (1048576->18446744073709551615) 00002000:00100000:1.0:1762166773.839451:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374af6a00 with x1847765444184064 ext(1048576->18446744073709551615) 00002000:00010000:1.0:1762166773.839456:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee374af6a00. 00000100:00100000:3.0:1762166773.840231:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.841357:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.842576:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.843887:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.845169:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.846502:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166773.855800:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762166773.855817:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451901440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166773.855921:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451901312 00000100:00100000:1.0:1762166773.855928:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451901312 00000100:00100000:3.0:1762166773.855936:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166773.855971:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451901440 00000100:00100000:1.0:1762166773.855976:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451901440 00000100:00100000:1.0:1762166773.856036:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451901568 00000100:00100000:1.0:1762166773.856040:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451901568 00000100:00100000:3.0:1762166773.856064:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:1.0:1762166773.856074:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1762166773.856081:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765451901312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166773.856090:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765451901440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762166773.856316:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x4a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1762166773.856318:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x47:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1762166773.856323:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x4a:0x0] updating lvb mtime from disk: 1762166774 -> 1762166774 00002000:00010000:3.0:1762166773.856326:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x47:0x0] updating lvb mtime from disk: 1762166773 -> 1762166773 00002000:00010000:1.0:1762166773.856328:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x4a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166773.856332:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x4a:0x0] updating lvb ctime from disk: 1762166774 -> 1762166774 00002000:00010000:1.0:1762166773.856339:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x4a:0x0] updating lvb blocks from disk: 2051 -> 2051 00002000:00010000:3.0:1762166773.856382:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x47:0x0] updating lvb atime from disk: 1762166773 -> 1762166773 00002000:00010000:3.0:1762166773.856388:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x47:0x0] updating lvb ctime from disk: 1762166774 -> 1762166774 00000100:00100000:1.0:1762166773.856389:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765451901440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 301us (453us total) trans 21474836658 rc 0/0 00002000:00010000:3.0:1762166773.856394:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x47:0x0] updating lvb blocks from disk: 2051 -> 2051 00000100:00100000:1.0:1762166773.856407:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1762166773.856438:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3294:x1847765451901312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 363us (561us total) trans 17179869344 rc 0/0 00000100:00100000:3.0:1762166773.856448:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:1.0:1762166773.856454:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836655 gen 2 00000004:00080000:1.0:1762166773.856461:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e2bfb80, transno 21474836652 00000004:00080000:1.0:1762166773.856484:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e2bca80, transno 21474836653 00000004:00080000:1.0:1762166773.856491:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e2bdf80, transno 21474836654 00000004:00080000:1.0:1762166773.856498:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f2d2680, transno 21474836655 00000100:00100000:1.0:1762166773.856508:0:3296:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee36e3b2680 x1847765451901440/t21474836658(21474836658) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166789 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762166773.856521:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b2680/2, rc 0, transno 21474836658 00000100:00100000:1.0:1762166773.856527:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451901440:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762166773.856721:0:6728:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 1 in progress, 0 in flight, 4 done 00000100:00100000:1.0:1762166773.857453:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166773.859302:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166773.873971:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166773.877014:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166774.120035:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166775.145665:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166775.731184:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166775.731229:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444185984 00000100:00100000:3.0:1762166775.731238:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444185984 00000100:00100000:3.0:1762166775.731297:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2314 00000100:00100000:3.0:1762166775.731308:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+10:35875:x1847765444185984:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:3.0:1762166775.731327:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166775.731345:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9acbf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f905be expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166775.731403:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9acc6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731416:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9acc6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731429:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9acc6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731443:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9accd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731449:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9accd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731456:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9accd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731571:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9acd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731580:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9acd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731598:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9acd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166775.731630:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 1048576 00000004:00200000:3.0:1762166775.731634:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166775.731649:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9acd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731660:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9acd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731669:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9acc6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731675:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9acc6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731682:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9acc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731686:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105c200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166775.731690:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9acc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731697:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9acc6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731708:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166775.731711:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166775.731715:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9acc6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731721:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9acc6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731749:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9accd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731755:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9accd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731784:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9accd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731790:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166775.731794:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9accd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731800:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9accd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731808:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x8f0a8bfd (ffff9ee343a13900) 00010000:00010000:3.0:1762166775.731811:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166775.731814:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9accd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731820:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9accd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.731861:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9acbf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f905be expref: 12 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166775.731875:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9acd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f905be expref: 11 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166775.731882:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9ee360714f00) 00010000:00010000:3.0:1762166775.731890:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166775.731893:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105d600, rc 0) 00000100:00100000:3.0:1762166775.731948:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+11:35875:x1847765444185984:12345-192.168.203.35@tcp:101:rm.0 Request processed in 641us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166775.731956:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2314 00000100:00080000:3.0:1762166775.731978:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166775.733945:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166775.735390:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166775.735403:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5400/0xf915a5bdf3c9acf0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.735413:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166775.735416:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5400/0xf915a5bdf3c9acf0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.735423:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5400/0xf915a5bdf3c9acf0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.735433:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9ee36062bd00) 00010000:00010000:3.0:1762166775.735437:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166775.735440:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5400/0xf915a5bdf3c9acf0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.735445:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5400/0xf915a5bdf3c9acf0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166775.735463:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166775.735466:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166775.735471:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166775.977306:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f1807908-b95d-4027-b65a-753b7d69e554:3293:1847765451901696:0@lo:400:kworker.0 00000100:00100000:3.0:1762166775.977380:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166775.977450:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765451902208:0@lo:400:kworker.0 00000100:00100000:3.0:1762166775.977479:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166775.977505:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1762166775.977514:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1847765451901824:0@lo:400:kworker.0 00000100:00100000:3.0:1762166775.977547:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166775.977573:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1847765451902336:0@lo:400:kworker.0 00000100:00100000:3.0:1762166775.977599:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166775.977645:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451902208 00000100:00100000:3.0:1762166775.977653:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451902208 00000100:00100000:3.0:1762166775.977710:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451902336 00000100:00100000:3.0:1762166775.977715:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451902336 00000100:00100000:3.0:1762166775.977741:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1762166775.977751:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1847765451901824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166775.977827:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1847765451901824:12345-0@lo:400:kworker.0 Request processed in 76us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166775.977840:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1762166775.978119:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451901952 00000100:00100000:1.0:1762166775.978124:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451901952 00000100:00100000:1.0:1762166775.978154:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451902080 00000100:00100000:1.0:1762166775.978157:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451902080 00000100:00100000:1.0:1762166775.978179:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1762166775.978194:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765451901952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166775.978234:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765451901952:12345-0@lo:400:kworker.0 Request processed in 49us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166775.978241:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1762166775.978268:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1762166775.978275:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765451902080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166775.978691:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765451902080:12345-0@lo:400:kworker.0 Request processed in 416us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166775.978698:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00010000:00010000:1.0:1762166776.167970:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166777.191959:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166777.704603:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00080000:3.0:1762166777.704726:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166777.713564:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166777.718629:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166777.720379:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166777.724911:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166777.729439:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00080000:3.0:1762166777.729676:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166777.733819:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166777.743510:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166777.743549:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444187776 00000100:00100000:1.0:1762166777.743558:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444187776 00000100:00100000:1.0:1762166777.743607:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2321 00000100:00100000:1.0:1762166777.743616:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+15:36319:x1847765444187776:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166777.743645:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166777.743664:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8c00/0xf915a5bdf3c9ad6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f905e8 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.743756:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8200/0xf915a5bdf3c9ad75 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166777.743955:0:5757:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244800/0xf915a5bdf3c9ad59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f905da expref: 16 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.743963:0:5757:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8200/0xf915a5bdf3c9ad75 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166777.744006:0:5757:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244800/0xf915a5bdf3c9ad59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f905da expref: 16 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.744020:0:5757:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244800/0xf915a5bdf3c9ad59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f905da expref: 16 pid: 5756 timeout: 498 lvb_type: 0 00000100:00100000:1.0:1762166777.744033:0:5757:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1847765451902464:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166777.744120:0:5757:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36540 going to sleep for 11 seconds 00000100:00100000:3.0:1762166777.757670:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444188416 00000100:00100000:3.0:1762166777.757680:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444188416 00000100:00100000:3.0:1762166777.757743:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2323 00000100:00100000:3.0:1762166777.757799:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:36319:x1847765444188416:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166777.757821:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166777.757840:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9ad98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f905f6 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.757939:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9ad9f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166777.757953:0:5757:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348245400/0xf915a5bdf3c9ad8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f905ef expref: 19 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.757961:0:5757:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9ad9f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166777.758002:0:5757:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348245400/0xf915a5bdf3c9ad8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f905ef expref: 19 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.758017:0:5757:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348245400/0xf915a5bdf3c9ad8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f905ef expref: 19 pid: 5757 timeout: 498 lvb_type: 0 00000100:00100000:3.0:1762166777.758031:0:5757:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1847765451902592:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166777.758111:0:5757:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166777.760746:0:5757:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1847765451902592:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166777.761057:0:5757:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9ad9f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166777.763293:0:5757:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9ad9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166777.763304:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9ad9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:3.0:1762166777.763328:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x13:0x0]: returning size 0 00000100:00100000:3.0:1762166777.765833:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444188800 00000100:00100000:3.0:1762166777.765840:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444188800 00000100:00100000:3.0:1762166777.765914:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 684 00000100:00100000:3.0:1762166777.765924:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:36319:x1847765444188800:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166777.766220:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+19:36319:x1847765444188800:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 297us (531us total) trans 4294968801 rc 0/0 00000100:00100000:3.0:1762166777.766227:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 684 00000100:00100000:3.0:1762166777.772290:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444189056 00000100:00100000:3.0:1762166777.772297:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444189056 00010000:00010000:3.0:1762166777.772327:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8200/0xf915a5bdf3c9ad75 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f905e8 expref: 21 pid: 5757 timeout: 498 lvb_type: 0 00000100:00100000:3.0:1762166777.772364:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 505 00000100:00100000:3.0:1762166777.772373:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+21:2360:x1847765444189056:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166777.772385:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166777.772391:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8200/0xf915a5bdf3c9ad75 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f905e8 expref: 21 pid: 5757 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1762166777.772402:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8200/0xf915a5bdf3c9ad75 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f905e8 expref: 21 pid: 5757 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1762166777.772420:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8200/0xf915a5bdf3c9ad75 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f905e8 expref: 21 pid: 5757 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1762166777.772432:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee360714700) 00010000:00010000:3.0:1762166777.772450:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9adb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166777.772459:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9adb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166777.772466:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9adb4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166777.772494:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166777.772549:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+20:2360:x1847765444189056:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 177us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166777.772556:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 505 00000100:00100000:3.0:1762166777.778461:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00080000:3.0:1762166777.778946:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166777.781207:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166777.784921:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166777.787241:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166777.789364:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166777.791818:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166777.823444:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166777.826962:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166777.828703:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f7cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765451902976:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166777.828727:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee348244e00/0xf915a5bdf3c9adfa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166777.828820:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166777.829320:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee348244e00/0xf915a5bdf3c9adfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.829330:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee348244e00/0xf915a5bdf3c9adfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166777.849641:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x49:0x0] updating lvb size from disk: 0 -> 4 00002000:00010000:1.0:1762166777.849647:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x49:0x0] updating lvb mtime from disk: 0 -> 1762166778 00002000:00010000:1.0:1762166777.849653:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x49:0x0] updating lvb ctime from disk: 0 -> 1762166778 00002000:00010000:1.0:1762166777.849655:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x49:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1762166777.849668:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee348244e00/0xf915a5bdf3c9adfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.849680:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348244e00/0xf915a5bdf3c9adfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.849689:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee348244e00/0xf915a5bdf3c9adfa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.849696:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348244e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166777.849701:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348244e00/0xf915a5bdf3c9adfa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.849709:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348244e00/0xf915a5bdf3c9adfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.849726:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee348244e00/0xf915a5bdf3c9adfa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.849757:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee348244e00/0xf915a5bdf3c9adfa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166777.849867:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:22b95110-b0b2-4d2b-9402-7e0d82812a7e+7:2360:x1847765444190336:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 22759us (22907us total) trans 17179869345 rc 0/0 00000100:00100000:1.0:1762166777.849877:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 841 00000100:00100000:3.0:1762166777.851824:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166777.874328:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451903104:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166777.874378:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166777.874417:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1762166777.874424:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451903232:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166777.874448:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1762166777.874703:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166777.874804:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:1.0:1762166777.874815:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765451903232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1762166777.874834:0:6533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:74 count 1 00010000:00010000:1.0:1762166777.874854:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c8c00/0xf915a5bdf3c9ae01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.874873:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9ac56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90594 expref: 9 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.874881:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166777.874883:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166777.874887:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c8c00/0xf915a5bdf3c9ae01 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.874914:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9ac56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90594 expref: 9 pid: 12402 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1762166777.874931:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1762166777.874942:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9ac56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90594 expref: 9 pid: 12402 timeout: 498 lvb_type: 0 00000100:00100000:1.0:1762166777.874989:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451903360:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166777.875055:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166777.877207:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166777.877286:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166777.877315:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444190848 00000100:00100000:3.0:1762166777.877327:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444190848 00010000:00010000:3.0:1762166777.877402:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9ac56 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90594 expref: 10 pid: 12402 timeout: 498 lvb_type: 0 00000100:00100000:3.0:1762166777.877439:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 508 00000100:00100000:3.0:1762166777.877449:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+10:2360:x1847765444190848:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166777.877461:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166777.877467:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9ac56 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90594 expref: 10 pid: 12402 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1762166777.877479:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9ac56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90594 expref: 10 pid: 12402 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1762166777.877501:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166777.877503:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166777.877508:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c8c00/0xf915a5bdf3c9ae01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.877521:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c8c00/0xf915a5bdf3c9ae01 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.877545:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166777.877570:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+10:2360:x1847765444190848:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 123us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166777.877577:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 508 00010000:00010000:1.0:1762166777.877748:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9ac56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90594 expref: 9 pid: 12402 timeout: 498 lvb_type: 0 00000100:00100000:1.0:1762166777.877759:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451903360:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166777.877810:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c8c00/0xf915a5bdf3c9ae01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.877819:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c8c00/0xf915a5bdf3c9ae01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.877827:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c8c00/0xf915a5bdf3c9ae01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.877836:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c8c00/0xf915a5bdf3c9ae01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.877844:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c8c00/0xf915a5bdf3c9ae01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.877862:0:6533:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166777.877989:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166777.877996:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c8c00/0xf915a5bdf3c9ae01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.878016:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f7c8c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166777.878020:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c8c00/0xf915a5bdf3c9ae01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.878029:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c8c00/0xf915a5bdf3c9ae01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.878041:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c8c00/0xf915a5bdf3c9ae01 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.878048:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c8c00/0xf915a5bdf3c9ae01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.878066:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166777.878067:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166777.878069:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166777.878201:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765451903232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3388us (3750us total) trans 21474836660 rc 0/0 00000100:00100000:1.0:1762166777.878207:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:3.0:1762166777.878282:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444190976 00000100:00100000:3.0:1762166777.878286:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444190976 00010000:00010000:3.0:1762166777.878300:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348245800/0xf915a5bdf3c9ac80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f905a9 expref: 7 pid: 12402 timeout: 498 lvb_type: 0 00000100:00100000:3.0:1762166777.878329:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 509 00000100:00100000:3.0:1762166777.878336:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+7:2360:x1847765444190976:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166777.878346:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166777.878350:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee348245800/0xf915a5bdf3c9ac80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f905a9 expref: 7 pid: 12402 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1762166777.878372:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee348245800/0xf915a5bdf3c9ac80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f905a9 expref: 7 pid: 12402 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1762166777.878385:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee348245800/0xf915a5bdf3c9ac80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f905a9 expref: 7 pid: 12402 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1762166777.878395:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166777.878397:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166777.878400:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc5800/0xf915a5bdf3c9ae08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.878408:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc5800/0xf915a5bdf3c9ae08 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.878433:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166777.878469:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+6:2360:x1847765444190976:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 133us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166777.878476:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 509 00010000:00010000:1.0:1762166777.878795:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166777.878802:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc5800/0xf915a5bdf3c9ae08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.878811:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166777.878815:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc5800/0xf915a5bdf3c9ae08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.878824:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc5800/0xf915a5bdf3c9ae08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.878837:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc5800/0xf915a5bdf3c9ae08 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.878856:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc5800/0xf915a5bdf3c9ae08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.878877:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166777.878880:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166777.878884:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166777.889204:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444191360 00000100:00100000:1.0:1762166777.889213:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444191360 00000100:00100000:1.0:1762166777.889307:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2328 00000100:00100000:1.0:1762166777.889316:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:36319:x1847765444191360:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762166777.889364:0:5756:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166777.889386:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5400/0xf915a5bdf3c9adc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90604 expref: 12 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.889401:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9ee36062b300) 00010000:00010000:1.0:1762166777.889422:0:5756:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166777.889450:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8800/0xf915a5bdf3c9ae16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.889461:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8800/0xf915a5bdf3c9ae16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.889468:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8800/0xf915a5bdf3c9ae16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00010000:1.0:1762166777.889609:0:5756:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009d3a2a28 reply state 00000000be435854 transno 4294968803 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8800/0xf915a5bdf3c9ae16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:1.0:1762166777.889618:0:5756:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166777.889731:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+13:36319:x1847765444191360:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 416us (621us total) trans 4294968803 rc 0/0 00000100:00100000:1.0:1762166777.889739:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2328 00000100:00100000:1.0:1762166777.891927:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444191488 00000100:00100000:1.0:1762166777.891934:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444191488 00000100:00100000:1.0:1762166777.891988:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2329 00000100:00100000:1.0:1762166777.891996:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:36319:x1847765444191488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166777.892015:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166777.892030:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8000/0xf915a5bdf3c9ae1d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90620 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.892084:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8000/0xf915a5bdf3c9ae1d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90620 expref: 13 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.892099:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8000/0xf915a5bdf3c9ae1d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90620 expref: 13 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.892124:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9ee34c9fa200) 00010000:00010000:1.0:1762166777.892127:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166777.892129:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f7c8000, rc 0) 00000100:00100000:1.0:1762166777.892180:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+13:36319:x1847765444191488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 185us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166777.892186:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2329 00000100:00100000:1.0:1762166777.893580:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444191616 00000100:00100000:1.0:1762166777.893587:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444191616 00000100:00100000:1.0:1762166777.893634:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 812 00000100:00100000:1.0:1762166777.893644:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+6:2360:x1847765444191616:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762166777.893902:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+7:2360:x1847765444191616:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 258us (373us total) trans 17179869347 rc 0/0 00000100:00100000:1.0:1762166777.893910:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 812 00000100:00100000:3.0:1762166777.902060:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444192256 00000100:00100000:3.0:1762166777.902078:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444192256 00000100:00100000:3.0:1762166777.902275:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2332 00000100:00100000:3.0:1762166777.902285:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+13:36319:x1847765444192256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166777.902304:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166777.902317:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90627 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.902376:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90627 expref: 14 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.902387:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90627 expref: 14 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.902402:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee360714700) 00010000:00010000:3.0:1762166777.902405:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166777.902408:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105dc00, rc 0) 00000100:00100000:3.0:1762166777.902498:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+14:36319:x1847765444192256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 215us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166777.902506:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2332 00000100:00100000:1.0:1762166777.904193:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444192384 00000100:00100000:1.0:1762166777.904200:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444192384 00000100:00100000:1.0:1762166777.904251:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 813 00000100:00100000:1.0:1762166777.904260:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+9:2360:x1847765444192384:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762166777.904432:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb size from disk: 4 -> 4 00002000:00010000:1.0:1762166777.904436:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb mtime from disk: 1762166778 -> 1762166778 00002000:00010000:1.0:1762166777.904439:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb atime from disk: 0 -> 1762166778 00002000:00010000:1.0:1762166777.904441:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb ctime from disk: 1762166778 -> 1762166778 00002000:00010000:1.0:1762166777.904444:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762166777.904495:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+10:2360:x1847765444192384:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 235us (357us total) trans 21474836661 rc 0/0 00000100:00100000:1.0:1762166777.904517:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 813 00000100:00100000:3.0:1762166777.906600:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444192640 00000100:00100000:3.0:1762166777.906608:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444192640 00000100:00100000:3.0:1762166777.906654:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 685 00000100:00100000:3.0:1762166777.906669:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+14:36319:x1847765444192640:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:3.0:1762166777.906734:0:5759:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000402:0x12:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9add7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90612 expref: 14 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.906798:0:5759:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ae39 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166777.906811:0:5759:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae32 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90627 expref: 14 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.906819:0:5759:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ae39 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166777.906868:0:5759:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90627 expref: 14 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.906879:0:5759:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae32 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90627 expref: 14 pid: 5757 timeout: 498 lvb_type: 0 00000100:00100000:3.0:1762166777.906894:0:5759:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5759:1847765451903616:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166777.906964:0:5759:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee343e28000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166777.908789:0:5759:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5759:1847765451903616:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166777.908822:0:5759:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ae39 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00000100:00100000:3.0:1762166777.910980:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444192768 00000100:00100000:3.0:1762166777.910989:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444192768 00010000:00010000:3.0:1762166777.911024:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae32 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90627 expref: 15 pid: 5757 timeout: 498 lvb_type: 0 00000100:00100000:3.0:1762166777.911057:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 510 00000100:00100000:3.0:1762166777.911078:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+15:2360:x1847765444192768:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166777.911146:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166777.911154:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae32 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90627 expref: 15 pid: 5757 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1762166777.911167:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90627 expref: 15 pid: 5757 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1762166777.911188:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90627 expref: 15 pid: 5757 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1762166777.911223:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee360714700) 00010000:00010000:3.0:1762166777.911228:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ae39 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166777.911246:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ae39 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166777.911253:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9ae39 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166777.911283:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166777.911333:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+14:2360:x1847765444192768:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 258us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166777.911341:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 510 00000100:00100000:3.0:1762166777.913892:0:5759:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5759:1847765451903744:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166777.913915:0:5759:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9ae40 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166777.914183:0:5759:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9ae40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166777.914189:0:5759:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9ae40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00000100:00100000:3.0:1762166777.914581:0:5759:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5759:1847765451903872:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166777.914612:0:5759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166777.914634:0:5759:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350460a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166777.914651:0:11810:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451903872 00000100:00100000:1.0:1762166777.914655:0:11810:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451903872 00000100:00100000:1.0:1762166777.914684:0:11810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1762166777.914691:0:11810:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5759:x1847765451903872:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166777.914789:0:11810:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5759:x1847765451903872:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 98us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166777.914796:0:11810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1762166777.914874:0:5759:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5759:1847765451903872:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166777.914928:0:5759:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5759:1847765451904000:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166777.914961:0:5759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166777.914996:0:5759:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee343e28000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166777.915062:0:11810:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451904000 00000100:00100000:1.0:1762166777.915067:0:11810:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451904000 00000100:00100000:1.0:1762166777.915095:0:11810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1762166777.915101:0:11810:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5759:x1847765451904000:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166777.915153:0:11810:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5759:x1847765451904000:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 52us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166777.915160:0:11810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1762166777.915172:0:5759:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5759:1847765451904000:0@lo:1000:mdt_rdpg00_001.0 00000040:00080000:3.0:1762166777.915888:0:5759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].12, 280 off36848 00000001:00080000:3.0:1762166777.915901:0:5759:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968805 00000100:00100000:3.0:1762166777.915964:0:5759:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5759:1847765451904128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166777.916001:0:5759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166777.916033:0:5759:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347174a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166777.916088:0:11810:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451904128 00000100:00100000:1.0:1762166777.916093:0:11810:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451904128 00000100:00100000:1.0:1762166777.916128:0:11810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1762166777.916135:0:11810:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5759:x1847765451904128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166777.916285:0:11810:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5759:x1847765451904128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 149us (283us total) trans 17179869348 rc 0/0 00000100:00100000:1.0:1762166777.916292:0:11810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1762166777.916451:0:5760:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451904256 00000100:00100000:3.0:1762166777.916456:0:5760:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451904256 00000100:00100000:3.0:1762166777.916489:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1762166777.916497:0:5760:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5759:x1847765451904256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166777.916618:0:5760:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5759:x1847765451904256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 122us (212us total) trans 21474836662 rc 0/0 00000100:00100000:3.0:1762166777.916626:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1762166777.921193:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444193024 00000100:00100000:3.0:1762166777.921202:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444193024 00000100:00100000:3.0:1762166777.921257:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2333 00000100:00100000:3.0:1762166777.921268:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+14:36319:x1847765444193024:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166777.921289:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166777.921311:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9062e expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.921365:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9062e expref: 15 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.921379:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9062e expref: 15 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.921409:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13000) 00010000:00010000:3.0:1762166777.921412:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166777.921416:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105dc00, rc 0) 00000100:00100000:3.0:1762166777.921486:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+15:36319:x1847765444193024:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 219us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166777.921493:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2333 00010000:00010000:1.0:1762166777.926613:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166777.926621:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348245200/0xf915a5bdf3c9ae4e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166777.926630:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348245200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166777.926640:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348245200/0xf915a5bdf3c9ae4e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166777.926647:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348245200/0xf915a5bdf3c9ae4e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166777.926663:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9ee360714200) 00010000:00010000:1.0:1762166777.926667:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166777.926671:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348245200/0xf915a5bdf3c9ae4e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166777.926678:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348245200/0xf915a5bdf3c9ae4e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166777.926692:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166777.926694:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166777.926697:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166777.929295:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166777.929340:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444193792 00000100:00100000:1.0:1762166777.929349:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444193792 00000100:00100000:1.0:1762166777.929403:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2334 00000100:00100000:1.0:1762166777.929413:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+17:36172:x1847765444193792:12345-192.168.203.35@tcp:101:bash.0 00010000:00010000:1.0:1762166777.929433:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166777.929454:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9200/0xf915a5bdf3c9ae55 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90635 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.929605:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9800/0xf915a5bdf3c9ae5c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.929618:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9800/0xf915a5bdf3c9ae5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.929628:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9800/0xf915a5bdf3c9ae5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.929657:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9ae63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.929664:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9ae63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.929671:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9ae63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.929741:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9ae6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.929750:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9ae6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.929757:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9ae6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:1.0:1762166777.929802:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00010000:00010000:1.0:1762166777.929896:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9800/0xf915a5bdf3c9ae5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.929904:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9800/0xf915a5bdf3c9ae5c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.929910:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9800/0xf915a5bdf3c9ae5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.929915:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f7c9800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166777.929920:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9800/0xf915a5bdf3c9ae5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.929926:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9800/0xf915a5bdf3c9ae5c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.929943:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:1.0:1762166777.929946:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166777.929950:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9800/0xf915a5bdf3c9ae5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.929956:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9800/0xf915a5bdf3c9ae5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.929978:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9ae63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.929984:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9ae63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.929990:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9ae63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.929995:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f7c9a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166777.929998:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9ae63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.930003:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9ae63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.930010:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x889a05d5 (ffff9ee34c9faa00) 00010000:00010000:1.0:1762166777.930013:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166777.930016:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9ae63 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.930021:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9ae63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.930058:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9200/0xf915a5bdf3c9ae55 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90635 expref: 20 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.930079:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9ae6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90635 expref: 19 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.930086:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13000) 00010000:00010000:1.0:1762166777.930089:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166777.930092:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f7c8e00, rc 0) 00000100:00100000:1.0:1762166777.930154:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+19:36172:x1847765444193792:12345-192.168.203.35@tcp:101:bash.0 Request processed in 742us (864us total) trans 4294968810 rc 0/0 00000100:00100000:1.0:1762166777.930161:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2334 00000100:00100000:1.0:1762166777.933107:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444194048 00000100:00100000:1.0:1762166777.933115:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444194048 00000100:00100000:1.0:1762166777.933173:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2335 00000100:00100000:1.0:1762166777.933182:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+19:36172:x1847765444194048:12345-192.168.203.35@tcp:36:bash.0 00010000:00010000:1.0:1762166777.933231:0:5756:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166777.933253:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9ae6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90635 expref: 19 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.933270:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13000) 00010000:00010000:1.0:1762166777.933274:0:5756:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166777.933452:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9ae78 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.933466:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9ae78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166777.933475:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9ae78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000001:00080000:1.0:1762166777.933545:0:5756:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968811 00000004:00010000:1.0:1762166777.933571:0:5756:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e5a0b3f4 reply state 000000008cdef14d transno 4294968812 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9ae78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:1.0:1762166777.933580:0:5756:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166777.933682:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+21:36172:x1847765444194048:12345-192.168.203.35@tcp:36:bash.0 Request processed in 499us (641us total) trans 4294968812 rc 0/0 00000100:00100000:1.0:1762166777.933689:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2335 00000020:00080000:1.0:1762166777.933695:0:5756:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166777.935878:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444194304 00000100:00100000:3.0:1762166777.935887:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444194304 00000100:00100000:3.0:1762166777.935931:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2336 00000100:00100000:3.0:1762166777.935941:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+20:36172:x1847765444194304:12345-192.168.203.35@tcp:101:bash.0 00010000:00010000:3.0:1762166777.935959:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166777.935962:0:5757:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1762166777.935988:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9062e expref: 20 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.936010:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13000) 00010000:00010000:3.0:1762166777.936019:0:5757:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166777.936035:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9ae7f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9063c expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.936078:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9ae86 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166777.936088:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9ae86 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166777.936097:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9ae86 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000040:00080000:3.0:1762166777.936368:0:5757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].99, 88 off16304 00000004:00080000:3.0:1762166777.936384:0:5757:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 398728620575ns, next at 397527427743ns, rc = 0 00000040:00080000:3.0:1762166777.936435:0:5757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].99, 88 off16256 00000004:00080000:3.0:1762166777.936442:0:5757:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 398728678930ns, next at 397527386914ns, rc = 0 00000001:00080000:1.0:1762166777.951633:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968812 is committed 00000001:00080000:1.0:1762166777.951660:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968813 is committed 00000004:00080000:1.0:1762166777.951665:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 91 committed 00000004:00080000:1.0:1762166777.951680:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 93 committed 00000020:00080000:1.0:1762166777.951709:0:5777:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee350460180 refcount 2 committed 0 result 0 batchid 34 00000020:00080000:1.0:1762166777.951717:0:5777:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee36f323000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3471746c0 00000020:00080000:1.0:1762166777.951723:0:5777:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee36f323e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee350460a80 00000020:00080000:1.0:1762166777.951726:0:5777:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee36f323a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee36f337400 00000020:00080000:1.0:1762166777.951729:0:5777:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].12 00000020:00080000:1.0:1762166777.951789:0:5788:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 34 committed batchid 33 00000020:00080000:1.0:1762166777.952007:0:5788:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 33 00000100:00100000:3.0:1762166777.952089:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451904640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166777.952198:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451904384 00000100:00100000:1.0:1762166777.952207:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451904384 00000100:00100000:1.0:1762166777.952253:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451904512 00000100:00100000:1.0:1762166777.952258:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451904512 00000100:00100000:1.0:1762166777.952296:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:3.0:1762166777.952310:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166777.952311:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765451904512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166777.952348:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451904640 00000100:00100000:3.0:1762166777.952353:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451904640 00000100:00100000:3.0:1762166777.952384:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:3.0:1762166777.952392:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765451904640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762166777.952474:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb size from disk: 4 -> 4 00002000:00010000:1.0:1762166777.952484:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb mtime from disk: 1762166778 -> 1762166778 00002000:00010000:1.0:1762166777.952488:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb atime from disk: 1762166778 -> 1762166778 00002000:00010000:1.0:1762166777.952491:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb ctime from disk: 1762166778 -> 1762166778 00002000:00010000:1.0:1762166777.952493:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762166777.952837:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3293:x1847765451904512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 532us (614us total) trans 21474836663 rc 0/0 00000100:00100000:1.0:1762166777.952845:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:3.0:1762166777.952852:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765451904640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 459us (544us total) trans 17179869349 rc 0/0 00000100:00100000:3.0:1762166777.952860:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:3.0:1762166777.954691:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444194432 00000100:00100000:3.0:1762166777.954698:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444194432 00010000:00010000:3.0:1762166777.954723:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348245000/0xf915a5bdf3c9ac72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f905a2 expref: 7 pid: 12402 timeout: 498 lvb_type: 0 00000100:00100000:3.0:1762166777.954930:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444194560 00000100:00100000:3.0:1762166777.954935:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444194560 00000100:00100000:3.0:1762166777.954985:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 817 00000100:00100000:3.0:1762166777.954998:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:22b95110-b0b2-4d2b-9402-7e0d82812a7e+10:36172:x1847765444194560:12345-192.168.203.35@tcp:101:bash.0 00010000:00010000:3.0:1762166777.955010:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166777.955024:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae94 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90643 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.955057:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9adec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90619 expref: 11 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166777.955065:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166777.955067:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166777.955071:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae94 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90643 expref: 11 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.955098:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9adec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90619 expref: 11 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166777.955120:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9adec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90619 expref: 11 pid: 6535 timeout: 498 lvb_type: 1 00000100:00100000:3.0:1762166777.955176:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765451904896:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166777.955239:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347174cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166777.957221:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765451904896:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166777.957247:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae94 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90643 expref: 11 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.957260:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105dc00, rc 0) 00000100:00100000:3.0:1762166777.957298:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:22b95110-b0b2-4d2b-9402-7e0d82812a7e+11:36172:x1847765444194560:12345-192.168.203.35@tcp:101:bash.0 Request processed in 2305us (2428us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166777.957305:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 817 00000100:00100000:1.0:1762166777.957470:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166777.958959:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166777.961119:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444195072 00000100:00100000:3.0:1762166777.961139:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444195072 00000100:00100000:3.0:1762166777.961189:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 688 00000100:00100000:3.0:1762166777.961198:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345abdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+10:36172:x1847765444195072:12345-192.168.203.35@tcp:35:bash.0 00000100:00100000:3.0:1762166777.961483:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345abdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+11:36172:x1847765444195072:12345-192.168.203.35@tcp:35:bash.0 Request processed in 285us (443us total) trans 4294968814 rc 0/0 00000100:00100000:3.0:1762166777.961491:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 688 00000100:00100000:1.0:1762166777.975113:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762166777.975606:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37ffc4a00, rc 0) 00000100:00100000:0.0:1762166777.975662:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:36321:x1847765444195584:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 360us (554us total) trans 4294968815 rc 301/301 00000100:00100000:0.0:1762166777.975670:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2338 00000100:00100000:3.0:1762166777.977255:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166777.977527:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444195712 00000100:00100000:0.0:1762166777.977540:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444195712 00000100:00100000:0.0:1762166777.977609:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2339 00000100:00100000:0.0:1762166777.977620:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:36321:x1847765444195712:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166777.977700:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4800/0xf915a5bdf3c9aebe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.977717:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4800/0xf915a5bdf3c9aebe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.977730:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4800/0xf915a5bdf3c9aebe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.977744:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9aec5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.977750:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9aec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.977756:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9aec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.977943:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9aecc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.977952:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9aecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.977958:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9aecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:0.0:1762166777.978024:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00000004:00200000:0.0:1762166777.978029:0:5757:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166777.978040:0:5757:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9aecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978051:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4800/0xf915a5bdf3c9aebe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978057:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4800/0xf915a5bdf3c9aebe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978063:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4800/0xf915a5bdf3c9aebe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978069:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc4800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166777.978074:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4800/0xf915a5bdf3c9aebe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978081:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4800/0xf915a5bdf3c9aebe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978092:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:0.0:1762166777.978095:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166777.978099:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4800/0xf915a5bdf3c9aebe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978105:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4800/0xf915a5bdf3c9aebe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978117:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9aec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978134:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9aec5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978147:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9aec5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978152:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc4200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166777.978155:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9aec5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978161:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9aec5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978169:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x889a05d5 (ffff9ee36062ba00) 00010000:00010000:0.0:1762166777.978172:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166777.978174:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9aec5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978185:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9aec5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978201:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9aecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978206:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9aecc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978212:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9aecc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978216:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166777.978219:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9aecc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978224:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9aecc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978248:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:0.0:1762166777.978250:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166777.978253:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9aecc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.978258:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9aecc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00000100:00100000:0.0:1762166777.978348:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:36321:x1847765444195712:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 729us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166777.978357:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2339 00000100:00100000:3.0:1762166777.979999:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444195968 00000100:00100000:3.0:1762166777.980009:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444195968 00000100:00100000:3.0:1762166777.980066:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 689 00000100:00100000:3.0:1762166777.980076:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:36321:x1847765444195968:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166777.980316:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+13:36321:x1847765444195968:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 240us (412us total) trans 4294968816 rc 0/0 00000100:00100000:3.0:1762166777.980323:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 689 00000100:00100000:1.0:1762166777.988405:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166777.988474:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444196224 00000100:00100000:0.0:1762166777.988485:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444196224 00000100:00100000:0.0:1762166777.988547:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2340 00000100:00100000:0.0:1762166777.988557:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+13:36323:x1847765444196224:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:0.0:1762166777.988580:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166777.988598:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5800/0xf915a5bdf3c9aed3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90658 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166777.988670:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9aeda lrc: 3/1,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.988684:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9aeda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.988695:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9aeda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.988709:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9aee1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.988732:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9aee1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.988740:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9aee1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.988906:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5c00/0xf915a5bdf3c9aee8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.988915:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5c00/0xf915a5bdf3c9aee8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.988924:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5c00/0xf915a5bdf3c9aee8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:0.0:1762166777.988935:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00010000:00010000:0.0:1762166777.989041:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9aeda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.989049:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9aeda lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.989054:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9aeda lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.989059:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166777.989064:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9aeda lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.989071:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9aeda lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.989082:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:0.0:1762166777.989090:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166777.989095:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9aeda lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.989100:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9aeda lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.989112:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9aee1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.989117:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9aee1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.989122:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9aee1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.989126:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166777.989129:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9aee1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.989134:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9aee1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.989141:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x889a05d5 (ffff9ee36062be00) 00010000:00010000:0.0:1762166777.989143:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166777.989146:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9aee1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.989150:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9aee1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166777.989191:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5800/0xf915a5bdf3c9aed3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90658 expref: 16 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166777.989217:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5c00/0xf915a5bdf3c9aee8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90658 expref: 15 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166777.989223:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:0.0:1762166777.989226:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166777.989228:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37ffc5c00, rc 0) 00000100:00100000:0.0:1762166777.989292:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+15:36323:x1847765444196224:12345-192.168.203.35@tcp:101:cat.0 Request processed in 737us (895us total) trans 4294968817 rc 0/0 00000100:00100000:0.0:1762166777.989299:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2340 00000100:00100000:3.0:1762166777.992561:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444196480 00000100:00100000:3.0:1762166777.992571:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444196480 00000100:00100000:3.0:1762166777.992630:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 690 00000100:00100000:3.0:1762166777.992641:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+15:36323:x1847765444196480:12345-192.168.203.35@tcp:35:cat.0 00000100:00100000:3.0:1762166777.992879:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+16:36323:x1847765444196480:12345-192.168.203.35@tcp:35:cat.0 Request processed in 239us (402us total) trans 4294968818 rc 0/0 00000100:00100000:3.0:1762166777.992886:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 690 00000100:00100000:0.0:1762166778.004209:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444196736 00000100:00100000:0.0:1762166778.004219:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444196736 00000100:00100000:0.0:1762166778.004275:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2341 00000100:00100000:0.0:1762166778.004283:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+16:36325:x1847765444196736:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166778.004309:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166778.004329:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5800/0xf915a5bdf3c9aef6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9065f expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.004454:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9aefd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.004468:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9aefd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.004478:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9aefd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:0.0:1762166778.004489:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x11:0x0]: returning size 11776 00010000:00010000:0.0:1762166778.004615:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5800/0xf915a5bdf3c9aef6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9065f expref: 19 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.004647:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9aefd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9065f expref: 18 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.004656:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:0.0:1762166778.004659:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166778.004663:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37ffc5600, rc 0) 00000100:00100000:0.0:1762166778.004720:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:36325:x1847765444196736:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 437us (589us total) trans 4294968819 rc 0/0 00000100:00100000:0.0:1762166778.004729:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2341 00000100:00100000:1.0:1762166778.006398:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166778.006438:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444196864 00000100:00100000:0.0:1762166778.006446:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444196864 00000100:00100000:0.0:1762166778.006488:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2342 00000100:00100000:0.0:1762166778.006497:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:36325:x1847765444196864:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166778.006552:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af0b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006565:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006573:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006586:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006592:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006598:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006726:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006735:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006741:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:0.0:1762166778.006788:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00000004:00200000:0.0:1762166778.006793:0:5757:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166778.006803:0:5757:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006815:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006822:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af0b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006833:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006839:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.006843:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006851:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af0b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006862:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:0.0:1762166778.006865:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.006869:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006880:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006893:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006899:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af12 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006904:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006910:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.006913:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006918:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af12 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006925:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x889a05d5 (ffff9ee36062be00) 00010000:00010000:0.0:1762166778.006928:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.006930:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af12 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006936:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006950:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006956:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af19 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006984:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006989:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc4200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.006992:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.006999:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.007007:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:0.0:1762166778.007009:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.007012:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af19 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.007017:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00000100:00100000:0.0:1762166778.007079:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:36325:x1847765444196864:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 582us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.007087:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2342 00000100:00100000:0.0:1762166778.020253:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444196992 00000100:00100000:0.0:1762166778.020268:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444196992 00000100:00100000:0.0:1762166778.020339:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2343 00000100:00100000:0.0:1762166778.020349:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:36329:x1847765444196992:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166778.020435:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af20 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020450:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af20 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020478:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af20 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020492:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020499:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020504:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020608:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020616:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020628:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:0.0:1762166778.020659:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00000004:00200000:0.0:1762166778.020664:0:5757:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166778.020674:0:5757:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020683:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af20 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020687:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af20 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020691:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af20 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020702:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc4200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.020705:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af20 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020709:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af20 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020717:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:0.0:1762166778.020719:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.020722:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af20 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020726:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af20 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020734:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020737:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020740:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020743:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.020745:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020748:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020752:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x889a05d5 (ffff9ee36062be00) 00010000:00010000:0.0:1762166778.020753:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.020759:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af27 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020807:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020820:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020824:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af2e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020827:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020830:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.020831:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020834:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af2e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020839:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:0.0:1762166778.020840:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.020841:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af2e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.020844:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00000100:00100000:0.0:1762166778.020905:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:36329:x1847765444196992:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 557us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.020911:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2343 00000100:00100000:0.0:1762166778.024027:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451905152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166778.024122:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166778.024202:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451905152 00000100:00100000:1.0:1762166778.024210:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451905152 00000100:00100000:1.0:1762166778.024258:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1762166778.024268:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765451905152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1762166778.024291:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 78315520 pending 0 free 3855613952 avail 3852468224 00000100:00100000:1.0:1762166778.024339:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765451905152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166778.024347:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1762166778.024386:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451905152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166778.036196:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444197120 00000100:00100000:0.0:1762166778.036213:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444197120 00000100:00100000:0.0:1762166778.036294:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2344 00000100:00100000:0.0:1762166778.036306:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:36332:x1847765444197120:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166778.036457:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af35 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036477:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036489:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036504:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036510:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036516:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036628:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036637:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036644:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:0.0:1762166778.036689:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00000004:00200000:0.0:1762166778.036692:0:5757:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166778.036702:0:5757:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036712:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036716:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af35 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036721:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036726:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.036730:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036737:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af35 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036747:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:0.0:1762166778.036750:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.036754:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036795:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af35 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036810:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036816:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036833:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036838:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.036842:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036848:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036856:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x889a05d5 (ffff9ee36062be00) 00010000:00010000:0.0:1762166778.036858:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.036861:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036866:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036882:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036888:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af43 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036894:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036898:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc4200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.036904:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036910:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036925:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:0.0:1762166778.036928:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.036931:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af43 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.036936:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00000100:00100000:0.0:1762166778.037029:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:36332:x1847765444197120:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 720us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.037040:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2344 00000100:00100000:1.0:1762166778.047949:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166778.048211:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444197248 00000100:00100000:0.0:1762166778.048222:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444197248 00000100:00100000:0.0:1762166778.048290:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2345 00000100:00100000:0.0:1762166778.048300:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:36334:x1847765444197248:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166778.048379:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af4a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048394:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048406:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048418:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048426:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048431:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048543:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048553:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048560:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:0.0:1762166778.048590:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00000004:00200000:0.0:1762166778.048594:0:5757:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166778.048605:0:5757:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048617:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048623:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af4a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048630:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af4a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048637:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc4200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.048641:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af4a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048647:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af4a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048658:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:0.0:1762166778.048662:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.048665:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048677:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9af4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048691:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048696:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af51 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048701:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048706:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.048709:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048714:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048722:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x889a05d5 (ffff9ee36062be00) 00010000:00010000:0.0:1762166778.048725:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.048727:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af51 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048732:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9af51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048746:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048752:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048831:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048835:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.048838:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048844:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048852:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:0.0:1762166778.048854:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.048857:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af58 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.048862:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9af58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00000100:00100000:0.0:1762166778.048954:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:36334:x1847765444197248:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 655us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.048963:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2345 00000100:00100000:1.0:1762166778.058659:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444197504 00000100:00100000:1.0:1762166778.058669:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444197504 00000100:00100000:1.0:1762166778.058734:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2346 00000100:00100000:1.0:1762166778.058744:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:36335:x1847765444197504:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166778.058787:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166778.058807:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9af5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90666 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.058917:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9200/0xf915a5bdf3c9af66 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.058932:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9200/0xf915a5bdf3c9af66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.058952:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9200/0xf915a5bdf3c9af66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:1.0:1762166778.058964:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00010000:00010000:1.0:1762166778.059113:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9af5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90666 expref: 21 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.059132:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9200/0xf915a5bdf3c9af66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90666 expref: 20 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.059140:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:1.0:1762166778.059143:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166778.059146:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f7c9200, rc 0) 00000100:00100000:1.0:1762166778.059209:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+20:36335:x1847765444197504:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 466us (626us total) trans 4294968820 rc 0/0 00000100:00100000:1.0:1762166778.059216:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2346 00000100:00100000:3.0:1762166778.061907:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166778.061984:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444197760 00000100:00100000:1.0:1762166778.061993:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444197760 00000100:00100000:1.0:1762166778.062058:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2347 00000100:00100000:1.0:1762166778.062069:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+20:36335:x1847765444197760:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166778.062099:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166778.062117:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9af74 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9066d expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.062233:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9af7b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.062247:0:5756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5c00/0xf915a5bdf3c9aee8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90658 expref: 21 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.062256:0:5756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9af7b lrc: 4/0,1 mode: --/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.062291:0:5756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5c00/0xf915a5bdf3c9aee8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90658 expref: 21 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.062304:0:5756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5c00/0xf915a5bdf3c9aee8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90658 expref: 21 pid: 5757 timeout: 498 lvb_type: 0 00000100:00100000:1.0:1762166778.062317:0:5756:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1847765451905280:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166778.062397:0:5756:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166778.063668:0:5756:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1847765451905280:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166778.063693:0:5756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9af7b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:3.0:1762166778.063848:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166778.063881:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444197888 00000100:00100000:0.0:1762166778.063887:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444197888 00010000:00010000:0.0:1762166778.063911:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5c00/0xf915a5bdf3c9aee8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90658 expref: 22 pid: 5757 timeout: 498 lvb_type: 0 00000100:00100000:0.0:1762166778.063945:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 514 00000100:00100000:0.0:1762166778.063953:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+22:2360:x1847765444197888:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166778.063965:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166778.063980:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5c00/0xf915a5bdf3c9aee8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90658 expref: 22 pid: 5757 timeout: 498 lvb_type: 0 00010000:00010000:0.0:1762166778.063999:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5c00/0xf915a5bdf3c9aee8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90658 expref: 22 pid: 5757 timeout: 498 lvb_type: 0 00010000:00010000:0.0:1762166778.064018:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5c00/0xf915a5bdf3c9aee8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90658 expref: 22 pid: 5757 timeout: 498 lvb_type: 0 00010000:00010000:0.0:1762166778.064033:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:0.0:1762166778.064037:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9af7b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166778.064045:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9af7b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166778.064051:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9af7b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166778.064079:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166778.064132:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+21:2360:x1847765444197888:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 178us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.064139:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 514 00010000:00010000:1.0:1762166778.064191:0:5756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9af7b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.064198:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9af7b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:1.0:1762166778.064219:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00010000:00010000:1.0:1762166778.064339:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9af74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9066d expref: 22 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.064360:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9af7b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9066d expref: 21 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.064365:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:1.0:1762166778.064367:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166778.064368:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f7c8a00, rc 0) 00000100:00100000:1.0:1762166778.064399:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+21:36335:x1847765444197760:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2334us (2499us total) trans 4294968821 rc 0/0 00000100:00100000:1.0:1762166778.064404:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2347 00000100:00100000:3.0:1762166778.066138:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166778.066208:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444198016 00000100:00100000:1.0:1762166778.066215:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444198016 00000100:00100000:1.0:1762166778.066264:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2348 00000100:00100000:1.0:1762166778.066274:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+21:36335:x1847765444198016:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166778.066292:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166778.066309:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8000/0xf915a5bdf3c9af89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90674 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.066374:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9af90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.066387:0:5756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9af7b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9066d expref: 22 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.066394:0:5756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9af90 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.066424:0:5756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9af7b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9066d expref: 22 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.066458:0:5756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9af7b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9066d expref: 22 pid: 5756 timeout: 498 lvb_type: 0 00000100:00100000:1.0:1762166778.066471:0:5756:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1847765451905408:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166778.066547:0:5756:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36240 going to sleep for 11 seconds 00000100:00100000:1.0:1762166778.067873:0:5756:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1847765451905408:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166778.067894:0:5756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9af90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:3.0:1762166778.068047:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166778.068327:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444198144 00000100:00100000:0.0:1762166778.068333:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444198144 00010000:00010000:0.0:1762166778.068363:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9af7b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9066d expref: 23 pid: 5756 timeout: 498 lvb_type: 0 00000100:00100000:0.0:1762166778.068399:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 515 00000100:00100000:0.0:1762166778.068408:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+23:2361:x1847765444198144:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166778.068421:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166778.068437:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9af7b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9066d expref: 23 pid: 5756 timeout: 498 lvb_type: 0 00010000:00010000:0.0:1762166778.068448:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9af7b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9066d expref: 23 pid: 5756 timeout: 498 lvb_type: 0 00010000:00010000:0.0:1762166778.068468:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8a00/0xf915a5bdf3c9af7b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9066d expref: 23 pid: 5756 timeout: 498 lvb_type: 0 00010000:00010000:0.0:1762166778.068493:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:0.0:1762166778.068498:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9af90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166778.068506:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9af90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166778.068513:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9af90 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166778.068540:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166778.068560:0:5756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9af90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.068569:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9af90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:0.0:1762166778.068586:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+22:2361:x1847765444198144:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 178us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.068594:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 515 00000004:00200000:1.0:1762166778.068604:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00000004:00200000:1.0:1762166778.068609:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166778.068624:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9af90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.068648:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8000/0xf915a5bdf3c9af89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90674 expref: 22 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.068663:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9af90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90674 expref: 21 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.068671:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:1.0:1762166778.068674:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166778.068684:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f7c9c00, rc 0) 00000100:00100000:1.0:1762166778.068720:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+21:36335:x1847765444198016:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2447us (2587us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166778.068728:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2348 00000100:00100000:3.0:1762166778.070144:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166778.071528:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166778.071572:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444198656 00000100:00100000:1.0:1762166778.071579:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444198656 00000100:00100000:1.0:1762166778.071623:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2349 00000100:00100000:1.0:1762166778.071633:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+22:36335:x1847765444198656:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166778.071651:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166778.071654:0:5756:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166778.071677:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9200/0xf915a5bdf3c9af66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90666 expref: 22 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.071691:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:1.0:1762166778.071695:0:5756:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166778.071704:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9af97 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9067b expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.071803:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8800/0xf915a5bdf3c9af9e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.071813:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8800/0xf915a5bdf3c9af9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.071820:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8800/0xf915a5bdf3c9af9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:1.0:1762166778.071829:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00010000:00010000:1.0:1762166778.071910:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9af97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9067b expref: 24 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.071953:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8800/0xf915a5bdf3c9af9e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9067b expref: 23 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.071960:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:1.0:1762166778.071963:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166778.071965:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f7c8800, rc 0) 00000100:00100000:1.0:1762166778.072021:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+23:36335:x1847765444198656:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 390us (497us total) trans 4294968823 rc 0/0 00000100:00100000:1.0:1762166778.072027:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2349 00000100:00100000:3.0:1762166778.073111:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166778.075106:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166778.076895:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166778.076988:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444199040 00000100:00100000:0.0:1762166778.076995:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444199040 00010000:00010000:0.0:1762166778.077024:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90643 expref: 14 pid: 12402 timeout: 498 lvb_type: 0 00000100:00100000:0.0:1762166778.077067:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 516 00000100:00100000:0.0:1762166778.077079:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+14:2360:x1847765444199040:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166778.077102:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1762166778.077116:0:5741:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb size from disk: 0 -> 4 00010000:00010000:0.0:1762166778.077133:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90643 expref: 14 pid: 12402 timeout: 498 lvb_type: 0 00010000:00010000:0.0:1762166778.077147:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90643 expref: 14 pid: 12402 timeout: 498 lvb_type: 0 00010000:00010000:0.0:1762166778.077169:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9ae94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90643 expref: 14 pid: 12402 timeout: 498 lvb_type: 0 00010000:00010000:0.0:1762166778.077193:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166778.077196:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166778.077200:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee348245a00/0xf915a5bdf3c9afac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.077214:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee348245a00/0xf915a5bdf3c9afac lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.077249:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166778.077291:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+13:2360:x1847765444199040:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 212us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.077306:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 516 00000100:00100000:3.0:1762166778.078660:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166778.078714:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444199296 00000100:00100000:1.0:1762166778.078721:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444199296 00000100:00100000:1.0:1762166778.078782:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2350 00000100:00100000:1.0:1762166778.078793:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+23:36335:x1847765444199296:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762166778.078838:0:5756:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762166778.078858:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9af90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90674 expref: 23 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.078882:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9ae86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9063c expref: 22 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.078900:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:1.0:1762166778.078905:0:5756:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166778.078932:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8000/0xf915a5bdf3c9afb3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.078945:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8000/0xf915a5bdf3c9afb3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.078983:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8000/0xf915a5bdf3c9afb3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000040:00080000:1.0:1762166778.079318:0:5756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].101, 88 off16472 00000004:00080000:1.0:1762166778.079327:0:5756:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 398871563844ns, next at 397527427743ns, rc = 0 00000040:00080000:1.0:1762166778.079380:0:5756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].100, 88 off16344 00000004:00080000:1.0:1762166778.079386:0:5756:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 398871622992ns, next at 397527386914ns, rc = 0 00000004:00010000:1.0:1762166778.093430:0:5756:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009048c545 reply state 00000000b1157fb6 transno 4294968824 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8000/0xf915a5bdf3c9afb3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:1.0:1762166778.093448:0:5756:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166778.093564:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+23:36335:x1847765444199296:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 14771us (14905us total) trans 4294968824 rc 0/0 00000100:00100000:1.0:1762166778.093574:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2350 00000001:00080000:1.0:1762166778.093610:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968819 is committed 00000001:00080000:1.0:1762166778.093628:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968824 is committed 00000004:00080000:1.0:1762166778.093632:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 92 committed 00000004:00080000:1.0:1762166778.093644:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 94 committed 00000020:00080000:1.0:1762166778.093665:0:5777:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 34 batchid updated 00010000:00010000:0.0:1762166778.093792:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8000/0xf915a5bdf3c9afb3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166778.093805:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8000/0xf915a5bdf3c9afb3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166778.093824:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8000/0xf915a5bdf3c9afb3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166778.093831:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f7c8000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.093835:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8000/0xf915a5bdf3c9afb3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166778.093842:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8000/0xf915a5bdf3c9afb3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166778.093859:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:0.0:1762166778.093862:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166778.093867:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8000/0xf915a5bdf3c9afb3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166778.093879:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8000/0xf915a5bdf3c9afb3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000020:00080000:1.0:1762166778.093957:0:5788:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 34 00000020:00080000:1.0:1762166778.094186:0:5788:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 34 cancel update log [0x200000400:0x2:0x0].12: rc = 0 00000020:00080000:1.0:1762166778.094200:0:5788:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 34 00000100:00100000:0.0:1762166778.094280:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:0.0:1762166778.094296:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3293:x1847765451905792:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762166778.094395:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e629500/2, rc 0, transno 17179869351 00000100:00100000:3.0:1762166778.094411:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451905664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166778.094465:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765451905792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 174us (474us total) trans 21474836666 rc 0/0 00000100:00100000:0.0:1762166778.094474:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000004:00080000:3.0:1762166778.094488:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb5c00/2, rc 0, transno 21474836666 00000100:00100000:3.0:1762166778.094497:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451905792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166778.095240:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166778.095289:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444199424 00000100:00100000:1.0:1762166778.095295:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444199424 00000100:00100000:1.0:1762166778.095337:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2351 00000100:00100000:1.0:1762166778.095347:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+11:36335:x1847765444199424:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166778.095365:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166778.095380:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9afba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90682 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.095434:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9afba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90682 expref: 12 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.095448:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9afba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90682 expref: 12 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.095466:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:1.0:1762166778.095469:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166778.095472:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f7c9c00, rc 0) 00000100:00100000:1.0:1762166778.095530:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:36335:x1847765444199424:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 185us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166778.095540:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2351 00000100:00100000:3.0:1762166778.097267:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166778.097348:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444199552 00000100:00100000:1.0:1762166778.097359:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444199552 00000100:00100000:1.0:1762166778.097419:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2352 00000100:00100000:1.0:1762166778.097429:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:36335:x1847765444199552:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166778.097444:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166778.097461:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9afc1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90689 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.097529:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9200/0xf915a5bdf3c9afc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.097541:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9200/0xf915a5bdf3c9afc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.097552:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9200/0xf915a5bdf3c9afc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:1.0:1762166778.097594:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00000004:00200000:1.0:1762166778.097598:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166778.097614:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9200/0xf915a5bdf3c9afc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.097638:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9afc1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90689 expref: 14 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.097655:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9200/0xf915a5bdf3c9afc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90689 expref: 13 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.097662:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:1.0:1762166778.097665:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166778.097668:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f7c9200, rc 0) 00000100:00100000:1.0:1762166778.097721:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+13:36335:x1847765444199552:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 293us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166778.097728:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2352 00000100:00100000:3.0:1762166778.099518:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166778.099611:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444199680 00000100:00100000:0.0:1762166778.099624:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444199680 00000100:00100000:0.0:1762166778.099696:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 821 00000100:00100000:0.0:1762166778.099709:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:2361:x1847765444199680:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166778.099731:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166778.099824:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37ffc5000/0xf915a5bdf3c9afcf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90690 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166778.099855:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x4b:0x0] initial LVB size: 4, mtime: 0x690887fa, atime: 0x690887fa, ctime: 0x690887fa, blocks: 0x1 00010000:00010000:0.0:1762166778.099890:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166778.099893:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166778.099907:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37ffc5000/0xf915a5bdf3c9afcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90690 expref: 13 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166778.099928:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37ffc5000/0xf915a5bdf3c9afcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90690 expref: 13 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166778.099945:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37ffc5000, rc 0) 00000100:00100000:0.0:1762166778.100119:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+13:2361:x1847765444199680:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 408us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.100132:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 821 00000100:00100000:0.0:1762166778.126042:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166778.128823:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166778.128874:0:6538:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444199936 00000100:00100000:0.0:1762166778.128886:0:6538:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444199936 00000100:00100000:0.0:1762166778.128964:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 844 00000100:00100000:0.0:1762166778.128986:0:6538:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+6:2361:x1847765444199936:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:0.0:1762166778.129041:0:6538:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x49:0x0] initial LVB size: 4, mtime: 0x690887fa, atime: 0x690887fa, ctime: 0x690887fa, blocks: 0xb 00010000:00010000:0.0:1762166778.129049:0:6538:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc4a00/0xf915a5bdf3c9afdd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.129062:0:6538:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166778.129064:0:6538:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166778.129069:0:6538:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc4a00/0xf915a5bdf3c9afdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.129096:0:6538:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc4a00/0xf915a5bdf3c9afdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166778.144246:0:6538:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x49:0x0] updating lvb size from disk: 4 -> 4096 00010000:00010000:3.0:1762166778.144259:0:6538:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc4a00/0xf915a5bdf3c9afdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.144267:0:6538:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc4a00/0xf915a5bdf3c9afdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.144276:0:6538:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc4a00/0xf915a5bdf3c9afdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.144281:0:6538:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc4a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166778.144284:0:6538:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc4a00/0xf915a5bdf3c9afdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.144290:0:6538:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc4a00/0xf915a5bdf3c9afdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.144320:0:6538:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc4a00/0xf915a5bdf3c9afdd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.144327:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc4a00/0xf915a5bdf3c9afdd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166778.144413:0:6538:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+5:2361:x1847765444199936:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 15426us (15666us total) trans 17179869352 rc 0/0 00000100:00100000:3.0:1762166778.144424:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 844 00000100:00100000:3.0:1762166778.154708:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166778.154815:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444200192 00000100:00100000:1.0:1762166778.154826:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444200192 00000100:00100000:1.0:1762166778.154901:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2353 00000100:00100000:1.0:1762166778.154911:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f77b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+13:36335:x1847765444200192:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762166778.154998:0:5756:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166778.155024:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9200/0xf915a5bdf3c9afc8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90689 expref: 13 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.155043:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:1.0:1762166778.155048:0:5756:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166778.155297:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9afe4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.155311:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9afe4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.155321:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9afe4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000001:00080000:1.0:1762166778.155390:0:5756:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968825 00000004:00010000:1.0:1762166778.155418:0:5756:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002379c931 reply state 00000000a4c223a1 transno 4294968826 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9a00/0xf915a5bdf3c9afe4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:1.0:1762166778.155427:0:5756:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166778.155507:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f77b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+15:36335:x1847765444200192:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 597us (807us total) trans 4294968826 rc 0/0 00000100:00100000:1.0:1762166778.155515:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2353 00000020:00080000:1.0:1762166778.155521:0:5756:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166778.156931:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166778.156997:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444200320 00000100:00100000:0.0:1762166778.157004:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444200320 00000100:00100000:0.0:1762166778.157052:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 822 00000100:00100000:0.0:1762166778.157061:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+5:36335:x1847765444200320:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166778.157086:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166778.157108:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc5800/0xf915a5bdf3c9afeb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90697 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166778.157130:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x49:0x0] initial LVB size: 4096, mtime: 0x690887fa, atime: 0x690887fa, ctime: 0x690887fa, blocks: 0xb 00010000:00010000:0.0:1762166778.157146:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166778.157148:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166778.157155:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc5800/0xf915a5bdf3c9afeb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90697 expref: 6 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.157179:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37ffc5800/0xf915a5bdf3c9afeb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90697 expref: 6 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.157199:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37ffc5800, rc 0) 00000100:00100000:0.0:1762166778.157249:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+6:36335:x1847765444200320:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 189us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.157256:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 822 00000100:00100000:0.0:1762166778.158436:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166778.158493:0:6538:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444200448 00000100:00100000:3.0:1762166778.158501:0:6538:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444200448 00002000:00010000:3.0:1762166778.158533:0:6538:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/73 (4->18446744073709551615) 00002000:00100000:3.0:1762166778.158538:0:6538:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24550c380 with x1847765444200448 ext(4->18446744073709551615) 00002000:00010000:3.0:1762166778.158548:0:6538:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24550c380. 00000100:00100000:3.0:1762166778.158577:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 845 00000100:00100000:3.0:1762166778.158586:0:6538:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+6:2360:x1847765444200448:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762166778.158887:0:6538:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x49:0x0] updating lvb size from disk: 4096 -> 4 00002000:00010000:3.0:1762166778.158891:0:6538:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x49:0x0] updating lvb mtime from disk: 1762166778 -> 1762166778 00002000:00010000:3.0:1762166778.158894:0:6538:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x49:0x0] updating lvb atime from disk: 1762166778 -> 1762166778 00002000:00010000:3.0:1762166778.158896:0:6538:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x49:0x0] updating lvb ctime from disk: 1762166778 -> 1762166778 00002000:00010000:3.0:1762166778.158899:0:6538:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x49:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1762166778.158950:0:6538:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+7:2360:x1847765444200448:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 366us (520us total) trans 17179869353 rc 0/0 00000100:00100000:3.0:1762166778.158981:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 845 00002000:00010000:3.0:1762166778.158985:0:6538:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/73 (4->18446744073709551615) 00002000:00100000:3.0:1762166778.158988:0:6538:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24550c380 with x1847765444200448 ext(4->18446744073709551615) 00002000:00010000:3.0:1762166778.158994:0:6538:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24550c380. 00000100:00100000:3.0:1762166778.160092:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166778.160136:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444200704 00000100:00100000:1.0:1762166778.160142:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444200704 00000100:00100000:1.0:1762166778.160188:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2354 00000100:00100000:1.0:1762166778.160197:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+14:36335:x1847765444200704:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762166778.160287:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9aff2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.160302:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9aff2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166778.160312:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9aff2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00010000:1.0:1762166778.160408:0:5756:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b7fea9e4 reply state 00000000c65122d7 transno 4294968827 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9aff2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:1.0:1762166778.160430:0:5756:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166778.160498:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+16:36335:x1847765444200704:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 302us (408us total) trans 4294968827 rc 0/0 00000100:00100000:1.0:1762166778.160505:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2354 00010000:00010000:0.0:1762166778.161333:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9aff2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166778.161353:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9aff2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166778.161361:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9aff2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166778.161366:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f7c8e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.161370:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9aff2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166778.161377:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9aff2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166778.161389:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:0.0:1762166778.161393:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.161397:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9aff2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166778.161402:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9aff2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000100:00100000:3.0:1762166778.161577:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166778.161652:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444200832 00000100:00100000:0.0:1762166778.161659:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444200832 00000100:00100000:0.0:1762166778.161703:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 823 00000100:00100000:0.0:1762166778.161712:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f77b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+13:2361:x1847765444200832:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166778.161900:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb size from disk: 4 -> 4 00002000:00010000:0.0:1762166778.161903:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb mtime from disk: 1762166778 -> 1762166778 00002000:00010000:0.0:1762166778.161906:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb atime from disk: 1762166778 -> 1762166778 00002000:00010000:0.0:1762166778.161908:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb ctime from disk: 1762166778 -> 1762166778 00002000:00010000:0.0:1762166778.161910:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166778.161975:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f77b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+14:2361:x1847765444200832:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 255us (390us total) trans 21474836667 rc 0/0 00000100:00100000:0.0:1762166778.161983:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 823 00000100:00100000:3.0:1762166778.163924:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444201088 00000100:00100000:3.0:1762166778.163941:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444201088 00000100:00100000:3.0:1762166778.163998:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 692 00000100:00100000:3.0:1762166778.164009:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+15:36335:x1847765444201088:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:3.0:1762166778.164067:0:5759:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000402:0x12:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8800/0xf915a5bdf3c9af9e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9067b expref: 15 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.164127:0:5759:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9aff9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166778.164140:0:5759:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9afba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90682 expref: 15 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.164153:0:5759:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9aff9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166778.164189:0:5759:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9afba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90682 expref: 15 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.164202:0:5759:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9afba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90682 expref: 15 pid: 5756 timeout: 498 lvb_type: 0 00000100:00100000:3.0:1762166778.164240:0:5759:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f77ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5759:1847765451905920:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166778.164319:0:5759:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485540 going to sleep for 11 seconds 00000100:00100000:3.0:1762166778.165526:0:5759:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f77ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5759:1847765451905920:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166778.165546:0:5759:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9aff9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00000100:00100000:0.0:1762166778.166494:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444201216 00000100:00100000:0.0:1762166778.166502:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444201216 00010000:00010000:0.0:1762166778.166535:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9afba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90682 expref: 16 pid: 5756 timeout: 498 lvb_type: 0 00000100:00100000:0.0:1762166778.166574:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 517 00000100:00100000:0.0:1762166778.166588:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+16:2360:x1847765444201216:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166778.166601:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166778.166608:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9afba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90682 expref: 16 pid: 5756 timeout: 498 lvb_type: 0 00010000:00010000:0.0:1762166778.166620:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9afba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90682 expref: 16 pid: 5756 timeout: 498 lvb_type: 0 00010000:00010000:0.0:1762166778.166640:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9afba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90682 expref: 16 pid: 5756 timeout: 498 lvb_type: 0 00010000:00010000:0.0:1762166778.166654:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:0.0:1762166778.166664:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9aff9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00010000:00010000:0.0:1762166778.166671:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9aff9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5759 initiator: MDT0 00010000:00010000:0.0:1762166778.166679:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9aff9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5759 initiator: MDT0 00010000:00010000:0.0:1762166778.166716:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166778.166741:0:5759:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9aff9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166778.166751:0:5759:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9aff9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00000100:00100000:0.0:1762166778.166806:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+15:2360:x1847765444201216:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 220us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.166815:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 517 00000040:00080000:3.0:1762166778.167165:0:5759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].102, 88 off16560 00000004:00080000:3.0:1762166778.167173:0:5759:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 398959409577ns, next at 397527427743ns, rc = 0 00000040:00080000:3.0:1762166778.167274:0:5759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].102, 88 off16472 00000004:00080000:3.0:1762166778.167280:0:5759:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 398959517722ns, next at 397527386914ns, rc = 0 00000001:00080000:1.0:1762166778.188380:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968827 is committed 00000001:00080000:1.0:1762166778.188408:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968828 is committed 00000004:00080000:1.0:1762166778.188413:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 93 committed 00000004:00080000:1.0:1762166778.188430:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 95 committed 00000100:00100000:1.0:1762166778.188570:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f77ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451906048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166778.188624:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166778.188784:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451906176:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166778.188815:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166778.188889:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451906176 00000100:00100000:0.0:1762166778.188895:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451906176 00000100:00100000:0.0:1762166778.188943:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:0.0:1762166778.188956:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765451906176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762166778.189178:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb size from disk: 4 -> 4 00002000:00010000:0.0:1762166778.189183:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb mtime from disk: 1762166778 -> 1762166778 00002000:00010000:0.0:1762166778.189189:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb atime from disk: 1762166778 -> 1762166778 00002000:00010000:0.0:1762166778.189192:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb ctime from disk: 1762166778 -> 1762166778 00002000:00010000:0.0:1762166778.189194:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762166778.189341:0:3295:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869351 gen 2 00000004:00080000:1.0:1762166778.189347:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f7cf480, transno 17179869346 00000004:00080000:1.0:1762166778.189364:0:3295:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869348 committed transno 17179869351 00000004:00080000:1.0:1762166778.189384:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e628000, transno 17179869349 00000004:00080000:1.0:1762166778.189388:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e628a80, transno 17179869350 00000004:00080000:1.0:1762166778.189390:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e629500, transno 17179869351 00000100:00100000:1.0:1762166778.189397:0:3295:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee37f77ad80 x1847765451906048/t17179869354(17179869354) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166794 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762166778.189407:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f77ad80/2, rc 0, transno 17179869354 00000100:00100000:1.0:1762166778.189412:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f77ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451906048:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762166778.189518:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e2bea00/2, rc 0, transno 21474836668 00000100:00100000:3.0:1762166778.189525:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451906176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166778.189569:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765451906176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 478us (615us total) trans 21474836668 rc 0/0 00000100:00100000:0.0:1762166778.189578:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00100000:1.0:1762166778.190364:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444201344 00000100:00100000:1.0:1762166778.190369:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444201344 00000100:00100000:1.0:1762166778.190416:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2355 00000100:00100000:1.0:1762166778.190424:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+10:36335:x1847765444201344:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166778.190440:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166778.190456:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9400/0xf915a5bdf3c9b000 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9069e expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.190516:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9400/0xf915a5bdf3c9b000 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9069e expref: 11 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.190528:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9400/0xf915a5bdf3c9b000 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9069e expref: 11 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.190545:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee34c9faf00) 00010000:00010000:1.0:1762166778.190548:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166778.190552:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f7c9400, rc 0) 00000100:00100000:1.0:1762166778.190599:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+11:36335:x1847765444201344:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 176us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166778.190605:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2355 00000100:00100000:3.0:1762166778.192823:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444201600 00000100:00100000:3.0:1762166778.192833:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444201600 00000100:00100000:3.0:1762166778.192890:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 693 00000100:00100000:3.0:1762166778.192900:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345abf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+11:36335:x1847765444201600:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166778.193177:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345abf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:36335:x1847765444201600:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 278us (459us total) trans 4294968829 rc 0/0 00000100:00100000:3.0:1762166778.193200:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 693 00000100:00100000:0.0:1762166778.195989:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444201856 00000100:00100000:0.0:1762166778.196001:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444201856 00000100:00100000:0.0:1762166778.196063:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2356 00000100:00100000:0.0:1762166778.196074:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:36335:x1847765444201856:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166778.196098:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166778.196120:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9b007 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f906a5 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.196226:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b00e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196251:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b00e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196268:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b00e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196285:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b015 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196292:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b015 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196298:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b015 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196414:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b01c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196420:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b01c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196425:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b01c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:0.0:1762166778.196433:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00010000:00010000:0.0:1762166778.196518:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b00e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196526:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b00e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196532:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b00e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196537:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.196550:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b00e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196557:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b00e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196567:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:0.0:1762166778.196570:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.196575:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b00e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196580:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b00e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196594:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b015 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196612:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b015 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196618:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b015 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196623:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.196625:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b015 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196630:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b015 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196637:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x889a05d5 (ffff9ee36062b300) 00010000:00010000:0.0:1762166778.196639:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.196642:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b015 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196657:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b015 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.196702:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9b007 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906a5 expref: 15 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.196716:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b01c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906a5 expref: 14 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.196724:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee34c9faf00) 00010000:00010000:0.0:1762166778.196727:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166778.196729:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37ffc4c00, rc 0) 00000100:00100000:0.0:1762166778.196825:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+14:36335:x1847765444201856:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 752us (969us total) trans 4294968830 rc 0/0 00000100:00100000:0.0:1762166778.196832:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2356 00000100:00100000:3.0:1762166778.200239:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444202112 00000100:00100000:3.0:1762166778.200249:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444202112 00000100:00100000:3.0:1762166778.200311:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 694 00000100:00100000:3.0:1762166778.200321:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+14:36335:x1847765444202112:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166778.200562:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+15:36335:x1847765444202112:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 241us (430us total) trans 4294968831 rc 0/0 00000100:00100000:3.0:1762166778.200570:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 694 00000100:00100000:0.0:1762166778.202660:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444202368 00000100:00100000:0.0:1762166778.202669:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444202368 00000100:00100000:0.0:1762166778.202727:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2357 00000100:00100000:0.0:1762166778.202748:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+15:36335:x1847765444202368:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166778.202799:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166778.202817:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9b02a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f906ac expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.202906:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b031 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.202920:0:5757:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b01c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906a5 expref: 16 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.202946:0:5757:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b031 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.202993:0:5757:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b01c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906a5 expref: 16 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.203006:0:5757:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b01c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906a5 expref: 16 pid: 5757 timeout: 498 lvb_type: 0 00000100:00100000:0.0:1762166778.203020:0:5757:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2be300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1847765451906304:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166778.203098:0:5757:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166778.204574:0:5757:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2be300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1847765451906304:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166778.204597:0:5757:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b031 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000100:00100000:0.0:1762166778.205398:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444202496 00000100:00100000:0.0:1762166778.205404:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444202496 00010000:00010000:0.0:1762166778.205438:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b01c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906a5 expref: 17 pid: 5757 timeout: 498 lvb_type: 0 00000100:00100000:0.0:1762166778.205477:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 518 00000100:00100000:0.0:1762166778.205488:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+17:2361:x1847765444202496:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166778.205502:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166778.205509:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b01c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906a5 expref: 17 pid: 5757 timeout: 498 lvb_type: 0 00010000:00010000:0.0:1762166778.205520:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b01c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906a5 expref: 17 pid: 5757 timeout: 498 lvb_type: 0 00010000:00010000:0.0:1762166778.205561:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b01c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906a5 expref: 17 pid: 5757 timeout: 498 lvb_type: 0 00010000:00010000:0.0:1762166778.205577:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee34c9faf00) 00010000:00010000:0.0:1762166778.205581:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b031 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.205590:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b031 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.205598:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b031 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.205628:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166778.205689:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+16:2361:x1847765444202496:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 202us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.205697:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 518 00010000:00010000:3.0:1762166778.205800:0:5757:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b031 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.205808:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b031 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:3.0:1762166778.205825:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00010000:00010000:3.0:1762166778.205957:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4200/0xf915a5bdf3c9b02a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906ac expref: 17 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.205986:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b031 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906ac expref: 16 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.205993:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee34c9faf00) 00010000:00010000:3.0:1762166778.205997:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166778.206000:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37ffc5e00, rc 0) 00000100:00100000:3.0:1762166778.206028:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+16:36335:x1847765444202368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3283us (3437us total) trans 4294968832 rc 0/0 00000100:00100000:3.0:1762166778.206035:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2357 00000100:00100000:1.0:1762166778.207347:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444202624 00000100:00100000:1.0:1762166778.207355:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444202624 00000100:00100000:1.0:1762166778.207395:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 695 00000100:00100000:1.0:1762166778.207405:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+16:36335:x1847765444202624:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:1.0:1762166778.207505:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+16:36335:x1847765444202624:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 103us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166778.207510:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 695 00000100:00100000:1.0:1762166778.209530:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166778.209800:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444202880 00000100:00100000:3.0:1762166778.209809:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444202880 00000100:00100000:3.0:1762166778.209860:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2358 00000100:00100000:3.0:1762166778.209870:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+16:36335:x1847765444202880:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166778.209886:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166778.209902:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b03f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f906b3 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.210029:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b046 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.210042:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b046 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.210054:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b046 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.210065:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b04d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x11:0x0].0x9da75000 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.210072:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b04d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.210078:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b04d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.210499:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b054 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.210508:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b054 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.210514:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b054 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:3.0:1762166778.210538:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x15:0x0]: returning size 0 00010000:00010000:3.0:1762166778.210558:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b046 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.210565:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b046 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.210572:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b046 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.210577:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105c000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166778.210581:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b046 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.210587:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b046 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.210597:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:3.0:1762166778.210600:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166778.210604:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b046 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.210610:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b046 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00000004:00010000:3.0:1762166778.210631:0:5757:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000090ff4fe5 reply state 0000000077b3219f transno 4294968833 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b04d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000100:00100000:3.0:1762166778.210639:0:5757:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1762166778.210659:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b03f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906b3 expref: 19 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.210671:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b054 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906b3 expref: 18 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.210685:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9ee343a13000) 00010000:00010000:3.0:1762166778.210687:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166778.210690:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105ce00, rc 0) 00000100:00100000:3.0:1762166778.210750:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+19:36335:x1847765444202880:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 881us (1226us total) trans 4294968833 rc 0/0 00000100:00100000:3.0:1762166778.210757:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2358 00010000:00010000:0.0:1762166778.212518:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b04d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.212533:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b04d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.212540:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b04d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.212546:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.212549:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b04d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.212557:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b04d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.212584:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x9da75000 (ffff9ee343a13100) 00010000:00010000:0.0:1762166778.212588:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.212592:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b04d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.212599:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b04d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00000100:00100000:1.0:1762166778.214129:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166778.214197:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444203136 00000100:00100000:3.0:1762166778.214207:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444203136 00000100:00100000:3.0:1762166778.214259:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2359 00000100:00100000:3.0:1762166778.214269:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:36335:x1847765444203136:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166778.214289:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166778.214292:0:5757:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1762166778.214312:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5e00/0xf915a5bdf3c9b031 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906ac expref: 18 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.214329:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee34c9faf00) 00010000:00010000:3.0:1762166778.214333:0:5757:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166778.214344:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b062 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f906ba expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.214425:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b069 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.214437:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b069 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.214445:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b069 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:3.0:1762166778.214480:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00010000:00010000:3.0:1762166778.214584:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b062 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906ba expref: 20 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.214609:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b069 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906ba expref: 19 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.214616:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee34c9faf00) 00010000:00010000:3.0:1762166778.214618:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166778.214621:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105dc00, rc 0) 00000100:00100000:3.0:1762166778.214676:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+19:36335:x1847765444203136:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 408us (554us total) trans 4294968834 rc 0/0 00000100:00100000:3.0:1762166778.214683:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2359 00010000:00010000:1.0:1762166778.215939:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166778.216661:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444203392 00000100:00100000:1.0:1762166778.216669:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444203392 00000100:00100000:1.0:1762166778.216718:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 696 00000100:00100000:1.0:1762166778.216728:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+19:36335:x1847765444203392:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166778.216830:0:5758:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000402:0x12:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b069 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906ba expref: 19 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.216873:0:5758:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9000/0xf915a5bdf3c9b077 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.216885:0:5758:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9400/0xf915a5bdf3c9b000 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9069e expref: 19 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.216892:0:5758:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9000/0xf915a5bdf3c9b077 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.216924:0:5758:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9400/0xf915a5bdf3c9b000 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9069e expref: 19 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.216937:0:5758:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9400/0xf915a5bdf3c9b000 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9069e expref: 19 pid: 5756 timeout: 499 lvb_type: 0 00000100:00100000:1.0:1762166778.216951:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1847765451906432:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166778.217047:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166778.218379:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1847765451906432:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166778.218404:0:5758:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9000/0xf915a5bdf3c9b077 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00000100:00100000:0.0:1762166778.218935:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444203520 00000100:00100000:0.0:1762166778.218942:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444203520 00010000:00010000:0.0:1762166778.218981:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9400/0xf915a5bdf3c9b000 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9069e expref: 20 pid: 5756 timeout: 499 lvb_type: 0 00000100:00100000:0.0:1762166778.219022:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 519 00000100:00100000:0.0:1762166778.219031:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+20:2360:x1847765444203520:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166778.219045:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166778.219051:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9400/0xf915a5bdf3c9b000 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9069e expref: 20 pid: 5756 timeout: 499 lvb_type: 0 00010000:00010000:0.0:1762166778.219063:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9400/0xf915a5bdf3c9b000 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9069e expref: 20 pid: 5756 timeout: 499 lvb_type: 0 00010000:00010000:0.0:1762166778.219081:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9400/0xf915a5bdf3c9b000 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9069e expref: 20 pid: 5756 timeout: 499 lvb_type: 0 00010000:00010000:0.0:1762166778.219093:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee34c9faf00) 00010000:00010000:0.0:1762166778.219096:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9000/0xf915a5bdf3c9b077 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166778.219112:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9000/0xf915a5bdf3c9b077 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166778.219117:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9000/0xf915a5bdf3c9b077 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166778.219142:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166778.219176:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+19:2360:x1847765444203520:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 148us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.219181:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 519 00010000:00010000:1.0:1762166778.219342:0:5758:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9000/0xf915a5bdf3c9b077 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.219352:0:5758:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9000/0xf915a5bdf3c9b077 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.219382:0:5758:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8600/0xf915a5bdf3c9b07e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.219394:0:5758:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b054 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906b3 expref: 19 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.219401:0:5758:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8600/0xf915a5bdf3c9b07e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.219428:0:5758:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b054 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906b3 expref: 19 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.219439:0:5758:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b054 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906b3 expref: 19 pid: 5757 timeout: 499 lvb_type: 0 00000100:00100000:1.0:1762166778.219451:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1847765451906560:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166778.219526:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166778.221055:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1847765451906560:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166778.221079:0:5758:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8600/0xf915a5bdf3c9b07e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00000100:00100000:0.0:1762166778.221741:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444203648 00000100:00100000:0.0:1762166778.221748:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444203648 00010000:00010000:0.0:1762166778.221818:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b054 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906b3 expref: 19 pid: 5757 timeout: 499 lvb_type: 0 00000100:00100000:0.0:1762166778.221860:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 520 00000100:00100000:0.0:1762166778.221870:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+19:2360:x1847765444203648:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166778.221884:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166778.221890:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b054 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906b3 expref: 19 pid: 5757 timeout: 499 lvb_type: 0 00010000:00010000:0.0:1762166778.221902:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b054 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906b3 expref: 19 pid: 5757 timeout: 499 lvb_type: 0 00010000:00010000:0.0:1762166778.221922:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b054 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906b3 expref: 19 pid: 5757 timeout: 499 lvb_type: 0 00010000:00010000:0.0:1762166778.221938:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9ee343a13000) 00010000:00010000:0.0:1762166778.221983:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8600/0xf915a5bdf3c9b07e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166778.221993:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8600/0xf915a5bdf3c9b07e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166778.222001:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8600/0xf915a5bdf3c9b07e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166778.222030:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166778.222081:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:2360:x1847765444203648:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 213us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.222089:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 520 00010000:00010000:1.0:1762166778.222137:0:5758:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8600/0xf915a5bdf3c9b07e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.222146:0:5758:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8600/0xf915a5bdf3c9b07e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00000100:00100000:1.0:1762166778.222522:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451906688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166778.222572:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166778.222611:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166778.222659:0:11810:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451906688 00000100:00100000:0.0:1762166778.222663:0:11810:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451906688 00000100:00100000:0.0:1762166778.222812:0:11810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1762166778.222824:0:11810:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5758:x1847765451906688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166778.222890:0:11810:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5758:x1847765451906688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 67us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.222896:0:11810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1762166778.222964:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451906688:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1762166778.223017:0:5758:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968835 00000001:00080000:1.0:1762166778.223073:0:5758:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968836 00010000:00010000:1.0:1762166778.223094:0:5758:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8600/0xf915a5bdf3c9b07e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.223102:0:5758:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8600/0xf915a5bdf3c9b07e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.223108:0:5758:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8600/0xf915a5bdf3c9b07e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.223114:0:5758:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f7c8600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166778.223118:0:5758:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8600/0xf915a5bdf3c9b07e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.223125:0:5758:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8600/0xf915a5bdf3c9b07e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.223135:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9ee343a13000) 00010000:00010000:1.0:1762166778.223138:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166778.223142:0:5758:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8600/0xf915a5bdf3c9b07e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.223147:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c8600/0xf915a5bdf3c9b07e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.223161:0:5758:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9000/0xf915a5bdf3c9b077 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.223167:0:5758:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9000/0xf915a5bdf3c9b077 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.223183:0:5758:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9000/0xf915a5bdf3c9b077 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.223188:0:5758:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f7c9000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166778.223190:0:5758:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9000/0xf915a5bdf3c9b077 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.223196:0:5758:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9000/0xf915a5bdf3c9b077 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.223204:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee34c9faf00) 00010000:00010000:1.0:1762166778.223206:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166778.223209:0:5758:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9000/0xf915a5bdf3c9b077 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.223214:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f7c9000/0xf915a5bdf3c9b077 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166778.223225:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee34c9faf00) 00010000:00010000:1.0:1762166778.223228:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166778.223233:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b069 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906ba expref: 20 pid: 5757 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166778.223313:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+19:36335:x1847765444203392:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 6583us (6984us total) trans 4294968837 rc 0/0 00000100:00100000:1.0:1762166778.223321:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 696 00000020:00080000:1.0:1762166778.223325:0:5758:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166778.224964:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444203776 00000100:00100000:3.0:1762166778.224983:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444203776 00000100:00100000:3.0:1762166778.225035:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2360 00000100:00100000:3.0:1762166778.225045:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+19:36335:x1847765444203776:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166778.225064:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166778.225082:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b085 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f906c1 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.225132:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b085 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906c1 expref: 20 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.225142:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b085 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906c1 expref: 20 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.225167:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:3.0:1762166778.225171:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166778.225174:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105d400, rc 0) 00000100:00100000:3.0:1762166778.225229:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+20:36335:x1847765444203776:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 185us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166778.225235:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2360 00000100:00100000:1.0:1762166778.227439:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444204032 00000100:00100000:1.0:1762166778.227456:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444204032 00000100:00100000:1.0:1762166778.227546:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 697 00000100:00100000:1.0:1762166778.227557:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+20:36335:x1847765444204032:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166778.227997:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+21:36335:x1847765444204032:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 440us (671us total) trans 4294968838 rc 0/0 00000100:00100000:1.0:1762166778.228007:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 697 00000100:00100000:1.0:1762166778.230530:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444204288 00000100:00100000:1.0:1762166778.230540:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444204288 00000100:00100000:1.0:1762166778.230589:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 698 00000100:00100000:1.0:1762166778.230599:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345abec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+21:36335:x1847765444204288:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166778.230949:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345abec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+22:36335:x1847765444204288:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 350us (561us total) trans 4294968839 rc 0/0 00000100:00100000:1.0:1762166778.230957:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 698 00000100:00100000:3.0:1762166778.240264:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444204544 00000100:00100000:3.0:1762166778.240278:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444204544 00000100:00100000:3.0:1762166778.240339:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2361 00000100:00100000:3.0:1762166778.240349:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+22:36336:x1847765444204544:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166778.240372:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166778.240390:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b08c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f906c8 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.240493:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b093 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.240511:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b093 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.240522:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b093 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.240537:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b09a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.240543:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b09a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.240549:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b09a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.240653:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b093 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.240660:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b093 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.240666:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b093 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.240671:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105c000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166778.240675:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b093 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.240682:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b093 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.240694:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:3.0:1762166778.240697:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166778.240702:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b093 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.240708:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b093 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.240733:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b09a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.240739:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b09a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.240744:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b09a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.240749:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166778.240758:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b09a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.241073:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b09a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.241082:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x889a05d5 (ffff9ee343a13800) 00010000:00010000:3.0:1762166778.241085:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166778.241088:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b09a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.241094:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b09a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.241149:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b08c lrc: 1/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906c8 expref: 23 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.241159:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:3.0:1762166778.241161:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166778.241165:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b08c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906c8 expref: 23 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.241176:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105c600, rc 0) 00000100:00100000:0.0:1762166778.243269:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444204672 00000100:00100000:0.0:1762166778.243278:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444204672 00000100:00100000:0.0:1762166778.243333:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2362 00000100:00100000:0.0:1762166778.243343:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+22:36336:x1847765444204672:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166778.243416:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0a1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243432:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243442:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243468:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243474:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243480:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243579:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b0af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243587:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b0af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243594:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b0af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:0.0:1762166778.243623:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00000004:00200000:0.0:1762166778.243626:0:5757:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166778.243636:0:5757:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b0af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243647:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243652:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0a1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243658:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243663:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc4c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.243666:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243679:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0a1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243690:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:0.0:1762166778.243693:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.243697:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243702:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243715:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243720:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243725:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243730:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.243739:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243745:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243752:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x889a05d5 (ffff9ee36062b300) 00010000:00010000:0.0:1762166778.243754:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.243756:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243792:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243820:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b0af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243826:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b0af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243830:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b0af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243835:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc4400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.243838:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b0af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243843:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b0af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243850:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:0.0:1762166778.243852:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.243855:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b0af lrc: 2/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.243860:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b0af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00000100:00100000:0.0:1762166778.243932:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+22:36336:x1847765444204672:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 590us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.243940:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2362 00000100:00100000:3.0:1762166778.254925:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166778.255094:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444204928 00000100:00100000:0.0:1762166778.255104:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444204928 00000100:00100000:0.0:1762166778.255159:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2363 00000100:00100000:0.0:1762166778.255169:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+22:36337:x1847765444204928:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166778.255207:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166778.255225:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b0b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f906cf expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.255297:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0bd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255311:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255322:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255335:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255341:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255347:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255466:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5400/0xf915a5bdf3c9b0cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255474:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5400/0xf915a5bdf3c9b0cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255482:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5400/0xf915a5bdf3c9b0cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:0.0:1762166778.255492:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00010000:00010000:0.0:1762166778.255578:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255595:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0bd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255601:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255607:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.255611:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255617:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255628:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:0.0:1762166778.255631:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.255635:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255640:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255653:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255669:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255675:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255679:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc4c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.255682:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255697:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255705:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x889a05d5 (ffff9ee36062b300) 00010000:00010000:0.0:1762166778.255707:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.255710:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255715:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.255754:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b0b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906cf expref: 25 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.255823:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5400/0xf915a5bdf3c9b0cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906cf expref: 24 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.255831:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:0.0:1762166778.255833:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166778.255835:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37ffc5400, rc 0) 00000100:00100000:0.0:1762166778.255898:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+24:36337:x1847765444204928:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 730us (981us total) trans 4294968840 rc 0/0 00000100:00100000:0.0:1762166778.255905:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2363 00000100:00100000:1.0:1762166778.258110:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444205184 00000100:00100000:1.0:1762166778.258120:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444205184 00000100:00100000:1.0:1762166778.258175:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 699 00000100:00100000:1.0:1762166778.258185:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+24:36337:x1847765444205184:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166778.258471:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+25:36337:x1847765444205184:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 286us (438us total) trans 4294968841 rc 0/0 00000100:00100000:1.0:1762166778.258489:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 699 00000100:00100000:3.0:1762166778.261040:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166778.261093:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444205440 00000100:00100000:0.0:1762166778.261101:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444205440 00000100:00100000:0.0:1762166778.261162:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2364 00000100:00100000:0.0:1762166778.261173:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+25:36337:x1847765444205440:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166778.261194:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166778.261224:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f906d6 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.261343:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0e0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.261359:0:5757:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5400/0xf915a5bdf3c9b0cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906cf expref: 26 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.261367:0:5757:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0e0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.261400:0:5757:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5400/0xf915a5bdf3c9b0cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906cf expref: 26 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.261413:0:5757:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5400/0xf915a5bdf3c9b0cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906cf expref: 26 pid: 5757 timeout: 499 lvb_type: 0 00000100:00100000:0.0:1762166778.261426:0:5757:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2be300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1847765451906816:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166778.261508:0:5757:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166778.263177:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166778.263209:0:5757:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2be300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1847765451906816:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166778.263236:0:5757:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0e0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.263476:0:5757:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.263488:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:0.0:1762166778.263510:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00010000:00010000:0.0:1762166778.263658:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b0d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906d6 expref: 27 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.263675:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906d6 expref: 26 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.263682:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:0.0:1762166778.263686:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166778.263688:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37ffc5200, rc 0) 00000100:00100000:0.0:1762166778.263729:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+26:36337:x1847765444205440:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2559us (2697us total) trans 4294968842 rc 0/0 00000100:00100000:0.0:1762166778.263737:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2364 00000100:00100000:3.0:1762166778.265787:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166778.265837:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444205696 00000100:00100000:0.0:1762166778.265856:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444205696 00000100:00100000:0.0:1762166778.265908:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2365 00000100:00100000:0.0:1762166778.265917:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+26:36337:x1847765444205696:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166778.265938:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166778.265954:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b0ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f906dd expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.266058:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4e00/0xf915a5bdf3c9b0f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.266078:0:5757:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0e0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906d6 expref: 27 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.266086:0:5757:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4e00/0xf915a5bdf3c9b0f5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.266119:0:5757:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906d6 expref: 27 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.266138:0:5757:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906d6 expref: 27 pid: 5757 timeout: 499 lvb_type: 0 00000100:00100000:0.0:1762166778.266152:0:5757:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2be300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1847765451906944:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166778.266223:0:5757:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166778.268306:0:5757:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2be300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1847765451906944:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166778.268344:0:5757:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4e00/0xf915a5bdf3c9b0f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000100:00100000:3.0:1762166778.268606:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166778.268807:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 522 00000100:00100000:3.0:1762166778.268820:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+28:2360:x1847765444205824:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166778.268864:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166778.268873:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906d6 expref: 28 pid: 5757 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1762166778.268887:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906d6 expref: 28 pid: 5757 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1762166778.268913:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b0e0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906d6 expref: 28 pid: 5757 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1762166778.268932:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:3.0:1762166778.268937:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4e00/0xf915a5bdf3c9b0f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.268946:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4e00/0xf915a5bdf3c9b0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.268955:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4e00/0xf915a5bdf3c9b0f5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166778.268999:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166778.269055:0:5757:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4e00/0xf915a5bdf3c9b0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.269064:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4e00/0xf915a5bdf3c9b0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000100:00100000:3.0:1762166778.269071:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+27:2360:x1847765444205824:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 253us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166778.269082:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 522 00000004:00200000:0.0:1762166778.269114:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00000004:00200000:0.0:1762166778.269119:0:5757:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166778.269139:0:5757:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4e00/0xf915a5bdf3c9b0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.269171:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b0ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906dd expref: 27 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.269190:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4e00/0xf915a5bdf3c9b0f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906dd expref: 26 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.269197:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:0.0:1762166778.269200:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166778.269211:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37ffc4e00, rc 0) 00000100:00100000:0.0:1762166778.269238:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+26:36337:x1847765444205696:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3323us (3477us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.269244:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2365 00000100:00100000:1.0:1762166778.271219:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444206080 00000100:00100000:1.0:1762166778.271230:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444206080 00000100:00100000:1.0:1762166778.271283:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 700 00000100:00100000:1.0:1762166778.271294:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+26:36337:x1847765444206080:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166778.271516:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+27:36337:x1847765444206080:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 223us (393us total) trans 4294968843 rc 0/0 00000100:00100000:1.0:1762166778.271524:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 700 00000100:00100000:0.0:1762166778.284798:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444206336 00000100:00100000:0.0:1762166778.284810:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444206336 00000100:00100000:0.0:1762166778.284874:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2366 00000100:00100000:0.0:1762166778.284885:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34567ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+27:36338:x1847765444206336:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166778.284909:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166778.284928:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b0fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f906e4 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.285023:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b103 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285048:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b103 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285060:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b103 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285074:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5a00/0xf915a5bdf3c9b10a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285080:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5a00/0xf915a5bdf3c9b10a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285087:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5a00/0xf915a5bdf3c9b10a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285194:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b103 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285220:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b103 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285227:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b103 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285232:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc4c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.285237:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b103 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285245:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b103 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285256:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:0.0:1762166778.285259:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.285278:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b103 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285285:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4c00/0xf915a5bdf3c9b103 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285297:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5a00/0xf915a5bdf3c9b10a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285304:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5a00/0xf915a5bdf3c9b10a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285310:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5a00/0xf915a5bdf3c9b10a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285315:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.285317:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5a00/0xf915a5bdf3c9b10a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285333:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5a00/0xf915a5bdf3c9b10a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285340:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x889a05d5 (ffff9ee36062b300) 00010000:00010000:0.0:1762166778.285343:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.285345:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5a00/0xf915a5bdf3c9b10a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285351:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5a00/0xf915a5bdf3c9b10a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.285384:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b0fc lrc: 1/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906e4 expref: 28 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.285394:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:0.0:1762166778.285397:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166778.285401:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b0fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906e4 expref: 28 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.285410:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37ffc4400, rc 0) 00000100:00100000:0.0:1762166778.285471:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34567ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+27:36338:x1847765444206336:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 588us (806us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166778.285479:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2366 00000100:00100000:3.0:1762166778.287250:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166778.287373:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444206464 00000100:00100000:0.0:1762166778.287389:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444206464 00000100:00100000:0.0:1762166778.287470:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2367 00000100:00100000:0.0:1762166778.287483:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+27:36338:x1847765444206464:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166778.287591:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b111 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.287629:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b111 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.287643:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b111 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.287661:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b118 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.287666:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.287673:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.287831:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b11f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.287838:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b11f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.287842:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b11f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:0.0:1762166778.287885:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00000004:00200000:0.0:1762166778.287892:0:5757:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166778.287906:0:5757:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b11f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.287921:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b111 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.287928:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b111 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.287945:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b111 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.287950:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc4000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.287955:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b111 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.287961:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b111 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.287983:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:0.0:1762166778.287985:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.287989:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b111 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.287994:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b111 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.288005:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.288009:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b118 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.288013:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b118 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.288022:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc4600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.288025:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b118 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.288032:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b118 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.288049:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x889a05d5 (ffff9ee36062b600) 00010000:00010000:0.0:1762166778.288052:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.288055:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b118 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.288061:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b118 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.288078:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b11f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.288084:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b11f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.288089:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b11f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.288094:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc5200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.288097:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b11f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.288103:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b11f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.288110:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:0.0:1762166778.288112:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.288115:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b11f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.288121:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b11f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00000100:00100000:0.0:1762166778.288212:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+27:36338:x1847765444206464:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 732us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.288226:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2367 00000100:00100000:0.0:1762166778.298571:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444206720 00000100:00100000:0.0:1762166778.298582:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444206720 00000100:00100000:0.0:1762166778.298657:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2368 00000100:00100000:0.0:1762166778.298668:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+27:36341:x1847765444206720:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:0.0:1762166778.298692:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166778.298716:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b126 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f906eb expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.298856:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b12d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.298871:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b12d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.298882:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b12d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.298897:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b134 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.298904:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.298910:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.299073:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b13b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.299082:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b13b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.299107:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b13b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:0.0:1762166778.299118:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4 00010000:00010000:0.0:1762166778.299219:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b12d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.299227:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b12d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.299233:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b12d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.299239:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc4600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.299243:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b12d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.299249:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b12d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.299261:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:0.0:1762166778.299264:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.299269:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b12d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.299274:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4600/0xf915a5bdf3c9b12d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.299287:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.299294:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b134 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.299313:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b134 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.299318:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37ffc4000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166778.299322:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b134 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.299328:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b134 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.299336:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x889a05d5 (ffff9ee36062b600) 00010000:00010000:0.0:1762166778.299338:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.299341:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b134 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.299346:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4000/0xf915a5bdf3c9b134 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166778.299387:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5200/0xf915a5bdf3c9b126 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906eb expref: 30 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.299400:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b13b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906eb expref: 29 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.299407:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:0.0:1762166778.299409:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166778.299411:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37ffc4400, rc 0) 00000100:00100000:0.0:1762166778.299479:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+29:36341:x1847765444206720:12345-192.168.203.35@tcp:101:cat.0 Request processed in 814us (1039us total) trans 4294968844 rc 0/0 00000100:00100000:0.0:1762166778.299486:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2368 00000100:00100000:3.0:1762166778.301178:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444206848 00000100:00100000:3.0:1762166778.301186:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444206848 00000100:00100000:3.0:1762166778.301242:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 260 00000100:00100000:3.0:1762166778.301253:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+29:2358:x1847765444206848:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166778.301282:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166778.301306:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4400/0xf915a5bdf3c9b13b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906eb expref: 29 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.301364:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:3.0:1762166778.301370:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166778.301421:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+28:2358:x1847765444206848:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 171us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166778.301430:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 260 00000100:00100000:3.0:1762166778.302625:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166778.302694:0:6538:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444206976 00000100:00100000:0.0:1762166778.302702:0:6538:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444206976 00002000:00100000:0.0:1762166778.302741:0:6538:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x49:0x0] (0->4095) req@ffff9ee36dce5500 x1847765444206976/t0(0) o3->22b95110-b0b2-4d2b-9402-7e0d82812a7e@192.168.203.35@tcp:564/0 lens 488/0 e 0 to 0 dl 1762166789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166778.302752:0:6538:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce5500 with x1847765444206976 ext(0->4095) 00002000:00010000:0.0:1762166778.302758:0:6538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dce5500 00000100:00100000:0.0:1762166778.302811:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 846 00000100:00100000:0.0:1762166778.302820:0:6538:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+7:2360:x1847765444206976:12345-192.168.203.35@tcp:3:cat.0 00000100:00100000:0.0:1762166778.303003:0:6538:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+7:2360:x1847765444206976:12345-192.168.203.35@tcp:3:cat.0 Request processed in 184us (382us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166778.303011:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 846 00002000:00100000:0.0:1762166778.303018:0:6538:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x49:0x0] (0->4095) req@ffff9ee36dce5500 x1847765444206976/t0(0) o3->22b95110-b0b2-4d2b-9402-7e0d82812a7e@192.168.203.35@tcp:564/0 lens 488/4536 e 0 to 0 dl 1762166789 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166778.303026:0:6538:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce5500 with x1847765444206976 ext(0->4095) 00002000:00010000:0.0:1762166778.303029:0:6538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dce5500 00000100:00100000:1.0:1762166778.306731:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444207232 00000100:00100000:1.0:1762166778.306740:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444207232 00000100:00100000:1.0:1762166778.306823:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 701 00000100:00100000:1.0:1762166778.306834:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+28:36341:x1847765444207232:12345-192.168.203.35@tcp:35:cat.0 00000100:00100000:1.0:1762166778.307107:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+29:36341:x1847765444207232:12345-192.168.203.35@tcp:35:cat.0 Request processed in 274us (496us total) trans 4294968845 rc 0/0 00000100:00100000:1.0:1762166778.307115:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 701 00000100:00100000:0.0:1762166778.471501:0:5749:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444207360 00000100:00100000:0.0:1762166778.471511:0:5749:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444207360 00000100:00100000:0.0:1762166778.471587:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 458 00000100:00100000:0.0:1762166778.471601:0:5749:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4640a11a-daef-4792-afea-61fb0f0c55bf+9:2359:x1847765444207360:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:0.0:1762166778.471680:0:5749:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4640a11a-daef-4792-afea-61fb0f0c55bf+9:2359:x1847765444207360:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 80us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.471687:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 458 00000100:00100000:1.0:1762166778.536221:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451907072 00000100:00100000:1.0:1762166778.536230:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451907072 00000100:00100000:1.0:1762166778.536290:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1762166778.536300:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765451907072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1762166778.536322:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 54591488 pending 3407872 free 3855613952 avail 3853516800 00000100:00100000:1.0:1762166778.536367:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765451907072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166778.536374:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000001:00080000:3.0:1762166779.067375:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836668 is committed 00000001:00080000:3.0:1762166779.067391:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836667 is committed 00010000:00010000:1.0:1762166779.241027:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166781.095993:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1847765451907328:0@lo:400:kworker.0 00000100:00100000:0.0:1762166781.096004:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451907456:0@lo:400:kworker.0 00000100:00100000:1.0:1762166781.096108:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166781.096108:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166781.096172:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1847765451907840:0@lo:400:kworker.0 00000100:00100000:1.0:1762166781.096200:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166781.096227:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451907328 00000100:00100000:0.0:1762166781.096234:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451907328 00000100:00100000:1.0:1762166781.096243:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451907840 00000100:00100000:1.0:1762166781.096249:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451907840 00000100:00100000:0.0:1762166781.096281:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451907712 00000100:00100000:0.0:1762166781.096287:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451907712 00000100:00100000:1.0:1762166781.096291:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1762166781.096310:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1847765451907328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166781.096316:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1762166781.096327:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1847765451907840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166781.096374:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1847765451907328:12345-0@lo:400:kworker.0 Request processed in 72us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166781.096381:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451907456 00000100:00100000:0.0:1762166781.096382:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1847765451907840:12345-0@lo:400:kworker.0 Request processed in 56us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166781.096388:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451907456 00000100:00100000:0.0:1762166781.096399:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1762166781.096408:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1762166781.096427:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451907584 00000100:00100000:0.0:1762166781.096431:0:5749:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451907200 00000100:00100000:3.0:1762166781.096432:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451907584 00000100:00080000:1.0:1762166781.096436:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166781.096436:0:5749:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451907200 00000100:00080000:1.0:1762166781.096444:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1762166781.096448:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762166781.096473:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:3.0:1762166781.096475:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1762166781.096486:0:5749:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+18:3294:x1847765451907200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166781.096489:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765451907456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166781.096525:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1847765451907328:0@lo:400:kworker.0 00000100:00100000:1.0:1762166781.096545:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1847765451907840:0@lo:400:kworker.0 00000100:00100000:0.0:1762166781.096546:0:5749:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+18:3294:x1847765451907200:12345-0@lo:400:kworker.0 Request processed in 61us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166781.096553:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765451907456:12345-0@lo:400:kworker.0 Request processed in 67us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166781.096564:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:3.0:1762166781.096569:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1762166781.096613:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836668 gen 2 00000004:00080000:3.0:1762166781.096619:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b2680, transno 21474836658 00000004:00080000:3.0:1762166781.096627:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb4380, transno 21474836660 00000004:00080000:3.0:1762166781.096636:0:3296:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836662 committed transno 21474836668 00000004:00080000:3.0:1762166781.096655:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550c000, transno 21474836663 00000004:00080000:3.0:1762166781.096661:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb5c00, transno 21474836666 00000004:00080000:3.0:1762166781.096673:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e2bea00, transno 21474836668 00000100:00100000:3.0:1762166781.096680:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451907456:0@lo:400:kworker.0 00000004:00080000:0.0:1762166781.096974:0:6728:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00010000:00010000:1.0:1762166781.289019:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1762166781.543403:0:28987:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 44d: lfs mirror split does not break size ========================================================== 05:46:21 (1762166781) 00000100:00100000:1.0:1762166781.568686:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444207616 00000100:00100000:1.0:1762166781.568698:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444207616 00000100:00080000:3.0:1762166781.568793:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1762166781.570793:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244000/0xf915a5bdf3c9b150 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.570803:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244000/0xf915a5bdf3c9b150 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.570809:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244000/0xf915a5bdf3c9b150 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.570814:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348244000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166781.570818:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244000/0xf915a5bdf3c9b150 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.570825:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244000/0xf915a5bdf3c9b150 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.570837:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xedb28f26 (ffff9ee360714700) 00010000:00010000:1.0:1762166781.570840:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166781.570844:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244000/0xf915a5bdf3c9b150 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.570849:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244000/0xf915a5bdf3c9b150 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166781.576448:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444207744 00000100:00100000:3.0:1762166781.576461:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444207744 00000100:00100000:3.0:1762166781.576523:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2370 00000100:00100000:3.0:1762166781.576535:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+29:37047:x1847765444207744:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166781.576556:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166781.576574:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b157 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f906f2 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.576625:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b15e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.576635:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b15e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.576643:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b15e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166781.576690:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:3.0:1762166781.576693:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 19 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166781.576720:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b15e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.576743:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b157 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906f2 expref: 31 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.576788:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b15e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906f2 expref: 30 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.576803:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13b00) 00010000:00010000:3.0:1762166781.576807:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166781.576811:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105d800, rc 0) 00000100:00100000:3.0:1762166781.576866:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+30:37047:x1847765444207744:12345-192.168.203.35@tcp:101:dd.0 Request processed in 335us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166781.576873:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2370 00000100:00100000:3.0:1762166781.578345:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444207872 00000100:00100000:3.0:1762166781.578352:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444207872 00000100:00100000:3.0:1762166781.578390:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2371 00000100:00100000:3.0:1762166781.578397:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+30:37047:x1847765444207872:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166781.578408:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166781.578418:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b165 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f906f9 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.578465:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b16c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578477:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b16c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578486:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b16c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578499:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b173 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578506:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b173 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578513:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b173 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578605:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b17a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578610:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b17a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578615:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b17a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166781.578633:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x16:0x0]: returning size 512 00000004:00200000:3.0:1762166781.578636:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166781.578653:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b17a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578661:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b16c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578665:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b16c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578670:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b16c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578674:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166781.578677:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b16c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578682:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b16c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578694:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13b00) 00010000:00010000:3.0:1762166781.578697:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166781.578700:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b16c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578714:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b16c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578733:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b173 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578740:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b173 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578745:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b173 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578750:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166781.578754:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b173 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578923:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b173 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578934:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xedb28f26 (ffff9ee343a13800) 00010000:00010000:3.0:1762166781.578937:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166781.578940:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b173 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578961:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b173 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.578992:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b165 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906f9 expref: 32 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.579013:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b17a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906f9 expref: 31 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.579032:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9ee343a13500) 00010000:00010000:3.0:1762166781.579035:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1762166781.579038:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105c200, rc 0) 00000100:00100000:3.0:1762166781.579089:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+31:37047:x1847765444207872:12345-192.168.203.35@tcp:101:dd.0 Request processed in 691us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166781.579096:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2371 00000100:00100000:3.0:1762166781.580333:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444208128 00000100:00100000:3.0:1762166781.580340:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444208128 00000100:00100000:3.0:1762166781.580381:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2372 00000100:00100000:3.0:1762166781.580394:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+31:37047:x1847765444208128:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166781.580408:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166781.580421:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b181 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90700 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.580518:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b188 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.580530:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b188 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.580539:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b188 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.580555:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b18f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.580562:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b18f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.580568:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b18f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00080000:3.0:1762166781.581088:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4c:0x0], index 0: 0 00010000:00010000:3.0:1762166781.581271:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b196 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.581280:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b196 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.581288:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b196 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.581320:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b188 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.581327:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b188 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.581333:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b188 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.581338:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166781.581342:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b188 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.581348:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b188 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.581357:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9ee343a13500) 00010000:00010000:3.0:1762166781.581360:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166781.581363:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b188 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.581368:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b188 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000004:00010000:3.0:1762166781.581397:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006939c6a9 reply state 000000008cdba9d2 transno 4294968847 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b18f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166781.581404:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1762166781.581430:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b181 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90700 expref: 34 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.581443:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b196 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90700 expref: 33 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.581450:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee343a13e00) 00010000:00010000:3.0:1762166781.581452:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166781.581454:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105c400, rc 0) 00000100:00100000:3.0:1762166781.581511:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+34:37047:x1847765444208128:12345-192.168.203.35@tcp:101:dd.0 Request processed in 1118us (1244us total) trans 4294968847 rc 0/0 00000100:00100000:3.0:1762166781.581519:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2372 00010000:00010000:0.0:1762166781.582800:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b18f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.582814:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b18f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.582822:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b18f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.582828:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166781.582832:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b18f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.582839:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b18f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.582855:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x3d8b1ba3 (ffff9ee343a13600) 00010000:00010000:0.0:1762166781.582857:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.582860:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b18f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.582864:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b18f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166781.585395:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444208256 00000100:00100000:3.0:1762166781.585408:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444208256 00000100:00100000:3.0:1762166781.585472:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 826 00000100:00100000:3.0:1762166781.585483:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+6:37047:x1847765444208256:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166781.585500:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166781.585519:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b1a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90707 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166781.598918:0:6538:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444208384 00000100:00100000:0.0:1762166781.598930:0:6538:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444208384 00002000:00100000:0.0:1762166781.598999:0:6538:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4c:0x0] (0->1048575) req@ffff9ee36e62bb80 x1847765444208384/t0(0) o4->22b95110-b0b2-4d2b-9402-7e0d82812a7e@192.168.203.35@tcp:567/0 lens 488/0 e 0 to 0 dl 1762166792 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166781.599012:0:6538:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e62bb80 with x1847765444208384 ext(0->1048575) 00002000:00010000:0.0:1762166781.599017:0:6538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e62bb80 00000100:00100000:0.0:1762166781.599052:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 847 00000100:00100000:0.0:1762166781.599068:0:6538:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+7:2361:x1847765444208384:12345-192.168.203.35@tcp:4:dd.0 00000100:00100000:0.0:1762166781.610054:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.620810:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.632162:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.643299:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.654616:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.665722:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.676222:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.686402:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.695729:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.695811:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166781.695981:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444209792 00000100:00100000:1.0:1762166781.695994:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444209792 00000100:00100000:1.0:1762166781.696059:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 702 00000100:00100000:1.0:1762166781.696069:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+33:37047:x1847765444209792:12345-192.168.203.35@tcp:35:dd.0 00000100:00100000:1.0:1762166781.696527:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+34:37047:x1847765444209792:12345-192.168.203.35@tcp:35:dd.0 Request processed in 458us (715us total) trans 4294968848 rc 0/0 00000100:00100000:1.0:1762166781.696534:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 702 00000100:00100000:0.0:1762166781.719193:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166781.719287:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444210048 00000100:00100000:3.0:1762166781.719336:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444210048 00000100:00100000:3.0:1762166781.719394:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2373 00000100:00100000:3.0:1762166781.719406:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+34:37055:x1847765444210048:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166781.719439:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166781.719457:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b1ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9070e expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.719554:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b1b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.719569:0:6558:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b196 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90700 expref: 35 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.719578:0:6558:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b1b2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.719609:0:6558:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b196 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90700 expref: 35 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.719622:0:6558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b196 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90700 expref: 35 pid: 6558 timeout: 502 lvb_type: 0 00000100:00100000:3.0:1762166781.719635:0:6558:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451907968:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166781.719728:0:6558:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166781.721475:0:6558:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451907968:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166781.721500:0:6558:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b1b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166781.721666:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166781.721748:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444210176 00000100:00100000:1.0:1762166781.721754:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444210176 00010000:00010000:1.0:1762166781.721804:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b196 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90700 expref: 36 pid: 6558 timeout: 502 lvb_type: 0 00000100:00100000:1.0:1762166781.721840:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 523 00000100:00100000:1.0:1762166781.721849:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+36:2361:x1847765444210176:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166781.721862:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166781.721870:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b196 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90700 expref: 36 pid: 6558 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1762166781.721883:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b196 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90700 expref: 36 pid: 6558 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1762166781.721904:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b196 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90700 expref: 36 pid: 6558 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1762166781.721928:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee343a13e00) 00010000:00010000:1.0:1762166781.721934:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b1b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.721969:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b1b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.721976:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b1b2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.722007:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166781.722050:0:6558:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b1b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:1.0:1762166781.722058:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+35:2361:x1847765444210176:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 208us (391us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166781.722063:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b1b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:1.0:1762166781.722070:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 523 00000004:00200000:3.0:1762166781.722093:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 10485760 00010000:00010000:3.0:1762166781.722228:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b1ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9070e expref: 36 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.722245:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b1b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9070e expref: 35 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.722253:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee343a13e00) 00010000:00010000:3.0:1762166781.722255:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166781.722258:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105d600, rc 0) 00000100:00100000:3.0:1762166781.722284:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+35:37055:x1847765444210048:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2881us (3101us total) trans 4294968849 rc 0/0 00000100:00100000:3.0:1762166781.722292:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2373 00000100:00100000:0.0:1762166781.724247:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166781.724336:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444210432 00000100:00100000:3.0:1762166781.724344:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444210432 00000100:00100000:3.0:1762166781.724398:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2374 00000100:00100000:3.0:1762166781.724408:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+35:37055:x1847765444210432:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166781.724432:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166781.724451:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b1c0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90715 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166781.727355:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.729582:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166781.729683:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444210816 00000100:00100000:1.0:1762166781.729690:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444210816 00010000:00010000:1.0:1762166781.729717:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244600/0xf915a5bdf3c9b1c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90715 expref: 39 pid: 6558 timeout: 502 lvb_type: 0 00000100:00100000:1.0:1762166781.729750:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 524 00000100:00100000:1.0:1762166781.729759:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+39:2361:x1847765444210816:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166781.729802:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166781.729809:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244600/0xf915a5bdf3c9b1c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90715 expref: 39 pid: 6558 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1762166781.729822:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244600/0xf915a5bdf3c9b1c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90715 expref: 39 pid: 6558 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1762166781.729847:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244600/0xf915a5bdf3c9b1c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90715 expref: 39 pid: 6558 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1762166781.729862:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9ee360714500) 00010000:00010000:1.0:1762166781.729876:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b1dc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.729884:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b1dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.729891:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b1dc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.729921:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166781.729963:0:6558:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b1dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.729970:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b1dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166781.729983:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 0 00000100:00100000:1.0:1762166781.729986:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+38:2361:x1847765444210816:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 227us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166781.729999:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 524 00000004:00080000:3.0:1762166781.730152:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4a:0x0], index 1: 0 00010000:00010000:3.0:1762166781.730319:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b1dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.730327:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b1dc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.730333:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b1dc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.730339:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348244800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166781.730343:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b1dc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.730350:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b1dc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.730359:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9ee360714500) 00010000:00010000:3.0:1762166781.730362:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166781.730365:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b1dc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.730371:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b1dc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.730420:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b1d5 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9071c expref: 38 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.730430:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9ee343a13500) 00010000:00010000:3.0:1762166781.730432:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166781.730436:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b1d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9071c expref: 38 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.730476:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348244400, rc 0) 00000100:00100000:3.0:1762166781.730524:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+37:37055:x1847765444210688:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3023us (3175us total) trans 4294968851 rc 301/301 00000100:00100000:3.0:1762166781.730531:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2375 00000100:00100000:0.0:1762166781.731849:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166781.731955:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444211072 00000100:00100000:3.0:1762166781.731963:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444211072 00000100:00100000:3.0:1762166781.732011:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 703 00000100:00100000:3.0:1762166781.732020:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+37:37055:x1847765444211072:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166781.732281:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+38:37055:x1847765444211072:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 261us (435us total) trans 4294968852 rc 0/0 00000100:00100000:3.0:1762166781.732289:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 703 00000100:00100000:0.0:1762166781.733453:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166781.733496:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444211200 00000100:00100000:3.0:1762166781.733503:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444211200 00000100:00100000:3.0:1762166781.733542:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2376 00000100:00100000:3.0:1762166781.733552:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+38:37055:x1847765444211200:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166781.733569:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166781.733586:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b1ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90723 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.733644:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b1f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.733654:0:6558:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b1b2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9070e expref: 39 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.733659:0:6558:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b1f1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.733692:0:6558:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b1b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9070e expref: 39 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.733701:0:6558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b1b2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9070e expref: 39 pid: 6558 timeout: 502 lvb_type: 0 00000100:00100000:3.0:1762166781.733710:0:6558:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451908224:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166781.733793:0:6558:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166781.734759:0:6558:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451908224:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166781.734808:0:6558:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b1f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166781.734996:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166781.735305:0:6558:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b1f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.735335:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b1f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166781.735371:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 10485760 00000004:00200000:3.0:1762166781.735376:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166781.735393:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b1f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166781.735484:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b1ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90723 expref: 39 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.735509:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b1f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90723 expref: 38 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.735529:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee343a13e00) 00010000:00010000:3.0:1762166781.735538:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166781.735541:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105de00, rc 0) 00000100:00100000:3.0:1762166781.735579:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+38:37055:x1847765444211200:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2028us (2130us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166781.735586:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2376 00000100:00100000:0.0:1762166781.737874:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166781.738365:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444211456 00000100:00100000:3.0:1762166781.738376:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444211456 00000100:00100000:0.0:1762166781.740720:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00080000:3.0:1762166781.740962:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166781.742667:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.745029:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.751604:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166781.752056:0:12400:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee348245000/0xf915a5bdf3c9b222 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.752073:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee348245000/0xf915a5bdf3c9b222 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.752105:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee348245000/0xf915a5bdf3c9b222 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.752126:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee348245000/0xf915a5bdf3c9b222 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.752134:0:12400:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee348245000/0xf915a5bdf3c9b222 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.752142:0:12400:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348245000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166781.752146:0:12400:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee348245000/0xf915a5bdf3c9b222 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.752163:0:12400:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee348245000/0xf915a5bdf3c9b222 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.752176:0:12400:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee348245000/0xf915a5bdf3c9b222 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.752183:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee348245000/0xf915a5bdf3c9b222 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166781.752292:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+26:2360:x1847765444211968:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 7133us (7268us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166781.752306:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 828 00000100:00100000:0.0:1762166781.753655:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166781.753697:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444212224 00000100:00100000:3.0:1762166781.753703:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444212224 00000100:00100000:3.0:1762166781.753744:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 829 00000100:00100000:3.0:1762166781.753753:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+26:2358:x1847765444212224:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166781.753803:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166781.753820:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b229 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9073f expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166781.753843:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x4c:0x0] initial LVB size: 10485760, mtime: 0x690887fd, atime: 0x0, ctime: 0x690887fd, blocks: 0x1 00010000:00010000:3.0:1762166781.753858:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166781.753860:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166781.753867:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b229 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9073f expref: 27 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166781.753899:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b229 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9073f expref: 27 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166781.753910:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105c000, rc 0) 00000100:00100000:3.0:1762166781.753964:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+27:2358:x1847765444212224:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 212us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166781.753971:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 829 00000100:00100000:0.0:1762166781.781383:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.781421:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.781459:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.781488:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166781.781502:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444212480 00000100:00100000:1.0:1762166781.781503:0:6538:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444212608 00000100:00100000:3.0:1762166781.781509:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444212480 00000100:00100000:1.0:1762166781.781510:0:6538:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444212608 00000100:00100000:0.0:1762166781.781514:0:14121:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444212736 00000100:00100000:0.0:1762166781.781521:0:14121:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444212736 00000100:00100000:3.0:1762166781.781610:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 858 00000100:00100000:1.0:1762166781.781620:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 859 00000100:00100000:3.0:1762166781.781629:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:22b95110-b0b2-4d2b-9402-7e0d82812a7e+30:2359:x1847765444212480:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762166781.781631:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 860 00000100:00100000:1.0:1762166781.781637:0:6540:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+30:2359:x1847765444212608:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762166781.781649:0:14121:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:22b95110-b0b2-4d2b-9402-7e0d82812a7e+30:2359:x1847765444212736:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762166781.781672:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b237 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.781672:0:6540:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9b230 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.781673:0:14121:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37ffc5400/0xf915a5bdf3c9b245 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.781706:0:6540:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166781.781714:0:6540:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166781.781719:0:6540:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9b230 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.781734:0:6540:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9b230 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.781757:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166781.781791:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166781.781797:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b237 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.781810:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b237 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.781810:0:14121:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166781.781815:0:14121:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166781.781821:0:14121:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37ffc5400/0xf915a5bdf3c9b245 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.781847:0:14121:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37ffc5400/0xf915a5bdf3c9b245 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166781.782687:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166781.782713:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444212864 00000100:00100000:1.0:1762166781.782717:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444212864 00000100:00100000:1.0:1762166781.782789:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 861 00000100:00100000:3.0:1762166781.782794:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166781.782803:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:22b95110-b0b2-4d2b-9402-7e0d82812a7e+35:2359:x1847765444212864:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762166781.782826:0:26247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9b24c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166781.782833:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166781.782845:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166781.782848:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1762166781.782858:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444213120 00000100:00100000:3.0:1762166781.782864:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444213120 00010000:00010000:1.0:1762166781.782866:0:26247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9b24c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.782884:0:26247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c8e00/0xf915a5bdf3c9b24c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166781.782916:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 863 00000100:00100000:3.0:1762166781.782928:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+37:2359:x1847765444213120:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762166781.782959:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b25a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.782975:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166781.782977:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166781.782981:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b25a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.782990:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b25a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166781.783437:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.783456:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444213248 00000100:00100000:0.0:1762166781.783460:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444213248 00000100:00100000:0.0:1762166781.783493:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 864 00000100:00100000:0.0:1762166781.783502:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:22b95110-b0b2-4d2b-9402-7e0d82812a7e+41:2359:x1847765444213248:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762166781.783521:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9b261 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.783530:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166781.783532:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166781.783535:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9b261 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 10 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.783546:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9b261 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 10 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.787788:0:6540:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9b230 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 11 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.787807:0:6540:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9b230 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 11 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.787817:0:6540:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9b230 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 11 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.787824:0:6540:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f7c9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166781.787830:0:6540:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9b230 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 11 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.787840:0:6540:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9b230 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 11 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.787878:0:6540:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9b230 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 11 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.787887:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f7c9c00/0xf915a5bdf3c9b230 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 11 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166781.787983:0:6540:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+43:2359:x1847765444212608:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 6348us (6519us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1762166781.788003:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 859 00000100:00100000:1.0:1762166781.791031:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166781.791973:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b237 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.791984:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b237 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.791991:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b237 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.791998:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105da00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166781.792001:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b237 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.792009:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b237 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.792032:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b237 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.792039:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b237 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166781.792192:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:22b95110-b0b2-4d2b-9402-7e0d82812a7e+39:2359:x1847765444212480:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 10571us (10768us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1762166781.792203:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 858 00010000:00010000:3.0:1762166781.796484:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b25a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.796496:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b25a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.796505:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b25a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.796512:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105c600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166781.796517:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b25a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.796611:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b25a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.796626:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b25a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.796647:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b25a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166781.796710:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+33:2359:x1847765444213120:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 13784us (13881us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1762166781.796719:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 863 00000100:00100000:0.0:1762166781.808183:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.808220:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.808249:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.808291:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166781.808320:0:14120:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444214016 00000100:00100000:1.0:1762166781.808322:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444213632 00000100:00100000:3.0:1762166781.808325:0:14120:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444214016 00000100:00100000:1.0:1762166781.808330:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444213632 00000100:00100000:0.0:1762166781.808330:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166781.808364:0:14120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 867 00000100:00100000:0.0:1762166781.808366:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166781.808376:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 868 00000100:00100000:3.0:1762166781.808379:0:14120:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:2358:x1847765444213760:12345-192.168.203.35@tcp:4:lfs.0 00000100:00100000:1.0:1762166781.808389:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:2358:x1847765444214272:12345-192.168.203.35@tcp:4:lfs.0 00000100:00100000:0.0:1762166781.808404:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 869 00010000:00010000:3.0:1762166781.808415:0:14120:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b276 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.808415:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b27d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166781.808418:0:6538:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+13:2358:x1847765444214016:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:1.0:1762166781.808445:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9b206 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90731 expref: 13 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166781.808456:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166781.808457:0:6538:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9b284 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.808459:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166781.808465:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b27d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 8 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.808504:0:14120:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166781.808507:0:14120:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166781.808510:0:14120:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b276 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.808533:0:6538:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166781.808537:0:6538:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166781.808540:0:6538:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9b284 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.808555:0:6538:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9b284 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.808556:0:14120:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b276 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.808570:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9b206 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90731 expref: 13 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166781.808601:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9b206 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90731 expref: 13 pid: 12400 timeout: 502 lvb_type: 1 00000100:00100000:1.0:1762166781.808618:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765451908480:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166781.808633:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 872 00000100:00100000:3.0:1762166781.808640:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+13:2358:x1847765444214144:12345-192.168.203.35@tcp:4:lfs.0 00000100:00100000:0.0:1762166781.808651:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166781.808655:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b299 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.808682:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166781.808684:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166781.808687:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b299 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.808695:0:6539:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b299 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166781.808699:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2427373c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166781.808699:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166781.808727:0:6540:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444214528 00000100:00100000:1.0:1762166781.808732:0:6540:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444214528 00000100:00100000:1.0:1762166781.808803:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 874 00000100:00100000:1.0:1762166781.808817:0:6540:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+15:2359:x1847765444214528:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:1.0:1762166781.808836:0:6540:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b2a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.808862:0:6540:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166781.808868:0:6540:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166781.808872:0:6540:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b2a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.808883:0:6540:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b2a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166781.808955:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166781.808982:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444214656 00000100:00100000:3.0:1762166781.808986:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444214656 00000100:00100000:3.0:1762166781.809016:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 875 00000100:00100000:3.0:1762166781.809022:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee373e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:22b95110-b0b2-4d2b-9402-7e0d82812a7e+16:2358:x1847765444214656:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:3.0:1762166781.809037:0:26247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b2ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.809046:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166781.809048:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166781.809050:0:26247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b2ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.809057:0:26247:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b2ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166781.809590:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765451908480:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166781.809607:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b27d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166781.809891:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166781.810269:0:14120:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.810277:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b27d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.810278:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 12 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.810280:0:14120:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 12 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.810302:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b27d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 12 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.810304:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 12 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.813604:0:26247:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b2ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.813614:0:6540:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b2a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.813620:0:26247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b2ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.813630:0:6540:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b2a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.815832:0:14121:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee348245400/0xf915a5bdf3c9b28b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.815847:0:14121:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee348245400/0xf915a5bdf3c9b28b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.817098:0:6538:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9b284 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.817109:0:6538:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9b284 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166781.847786:0:14119:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:1.0:1762166781.847792:0:14119:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb mtime from disk: 0 -> 1762166782 00002000:00010000:1.0:1762166781.847796:0:14119:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb ctime from disk: 0 -> 1762166782 00002000:00010000:1.0:1762166781.847798:0:14119:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:1.0:1762166781.847812:0:14119:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b292 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.847824:0:14119:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b292 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.847840:0:14119:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b292 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.847846:0:14119:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348244800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166781.847850:0:14119:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b292 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.847856:0:14119:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b292 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.847875:0:14119:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b292 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.847883:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee348244800/0xf915a5bdf3c9b292 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166781.847981:0:14119:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:22b95110-b0b2-4d2b-9402-7e0d82812a7e+32:2358:x1847765444213888:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 39342us (39651us total) trans 17179869355 rc 0/0 00000100:00100000:1.0:1762166781.847989:0:14119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 871 00000100:00100000:3.0:1762166781.850454:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166781.850488:0:14119:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444214912 00000100:00100000:3.0:1762166781.850496:0:14119:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444214912 00000100:00100000:3.0:1762166781.850552:0:14119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 876 00000100:00100000:3.0:1762166781.850561:0:14119:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:22b95110-b0b2-4d2b-9402-7e0d82812a7e+32:2358:x1847765444214912:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:3.0:1762166781.850588:0:14119:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b2b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.850599:0:14119:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166781.850602:0:14119:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166781.850608:0:14119:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.850622:0:14119:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166781.872412:0:14120:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb size from disk: 8388608 -> 10485760 00002000:00010000:0.0:1762166781.872427:0:14120:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb blocks from disk: 2055 -> 18439 00010000:00010000:1.0:1762166781.872444:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b299 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.872456:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b299 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.872467:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b299 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.872468:0:14120:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.872502:0:14120:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.872511:0:14120:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.872513:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105da00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166781.872518:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.872530:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b2a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.872551:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b2a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.872553:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b299 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.872553:0:14120:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105c600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166781.872561:0:14120:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 12 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.872571:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348244400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166781.872579:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b2a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.872581:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b299 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 12 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.872584:0:14120:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b276 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 12 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.872601:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b2a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 12 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.872618:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b299 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.872632:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b2a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 12 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.872633:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37105da00/0xf915a5bdf3c9b299 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.872633:0:14120:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b276 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.872659:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b2a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 12 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.872668:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b276 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166781.872757:0:14120:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:22b95110-b0b2-4d2b-9402-7e0d82812a7e+38:2358:x1847765444213760:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 64375us (64577us total) trans 17179869359 rc 0/0 00000100:00100000:1.0:1762166781.872759:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+38:2358:x1847765444214144:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 64109us (64385us total) trans 17179869357 rc 0/0 00000100:00100000:3.0:1762166781.872791:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+38:2359:x1847765444214400:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 63945us (64099us total) trans 17179869358 rc 0/0 00000100:00100000:0.0:1762166781.872806:0:14120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 867 00000100:00100000:3.0:1762166781.872815:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 873 00000100:00100000:1.0:1762166781.872823:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 872 00010000:00010000:0.0:1762166781.872864:0:6540:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b2a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.872875:0:6540:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b2a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.872896:0:6540:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b2a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.872897:0:6538:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9b284 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.872916:0:6538:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9b284 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.872923:0:6540:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166781.872924:0:6538:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9b284 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.872930:0:6540:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b2a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 8 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.872938:0:6540:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b2a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 8 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.872963:0:6538:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166781.872970:0:6538:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9b284 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.872972:0:6540:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b2a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 8 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.872987:0:6538:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9b284 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.872989:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b2a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 8 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166781.873025:0:6540:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+34:2359:x1847765444214528:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 64211us (64329us total) trans 17179869356 rc 0/0 00000100:00100000:0.0:1762166781.873033:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 874 00010000:00010000:3.0:1762166781.873058:0:6538:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9b284 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.873068:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9b284 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.873072:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b27d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.873083:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b27d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.873091:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b27d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.873109:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166781.873112:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b27d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.873119:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b27d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.873130:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b27d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166781.873138:0:6538:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+32:2358:x1847765444214016:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 64721us (64916us total) trans 17179869362 rc 0/0 00010000:00010000:0.0:1762166781.873141:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b27d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166781.873151:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 869 00000100:00100000:0.0:1762166781.873183:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:22b95110-b0b2-4d2b-9402-7e0d82812a7e+30:2358:x1847765444214272:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 64798us (64932us total) trans 17179869360 rc 0/0 00000100:00100000:0.0:1762166781.873191:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 868 00010000:00010000:0.0:1762166781.873225:0:26247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b2ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.873233:0:26247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b2ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.873240:0:26247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b2ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.873246:0:26247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166781.873250:0:26247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b2ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.873265:0:26247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b2ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.873278:0:26247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b2ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.873287:0:26247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b2ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166781.873337:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee373e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:22b95110-b0b2-4d2b-9402-7e0d82812a7e+28:2358:x1847765444214656:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 64314us (64392us total) trans 17179869361 rc 0/0 00000100:00100000:0.0:1762166781.873344:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 875 00010000:00010000:0.0:1762166781.873381:0:14121:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee348245400/0xf915a5bdf3c9b28b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.873390:0:14121:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348245400/0xf915a5bdf3c9b28b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.873398:0:14121:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee348245400/0xf915a5bdf3c9b28b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.873403:0:14121:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348245400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166781.873407:0:14121:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348245400/0xf915a5bdf3c9b28b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.873414:0:14121:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348245400/0xf915a5bdf3c9b28b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.873437:0:14121:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee348245400/0xf915a5bdf3c9b28b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.873444:0:14121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee348245400/0xf915a5bdf3c9b28b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166781.873497:0:14121:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:22b95110-b0b2-4d2b-9402-7e0d82812a7e+26:2358:x1847765444213632:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 65056us (65205us total) trans 17179869363 rc 0/0 00000100:00100000:0.0:1762166781.873503:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 870 00000001:00080000:1.0:1762166781.873835:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869363 is committed 00000001:00080000:0.0:1762166781.891126:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869364 is committed 00002000:00010000:1.0:1762166781.891175:0:14119:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb blocks from disk: 18439 -> 20487 00010000:00010000:1.0:1762166781.891192:0:14119:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.891205:0:14119:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b2b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.891214:0:14119:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b2b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.891237:0:14119:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105c800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166781.891242:0:14119:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b2b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.891251:0:14119:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b2b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.891270:0:14119:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b2b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.891277:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b2b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166781.891377:0:14119:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:22b95110-b0b2-4d2b-9402-7e0d82812a7e+6:2358:x1847765444214912:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 40814us (40927us total) trans 17179869364 rc 0/0 00000100:00100000:1.0:1762166781.891391:0:14119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 876 00000100:00100000:0.0:1762166781.895558:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444215040 00000100:00100000:0.0:1762166781.895567:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444215040 00000100:00100000:0.0:1762166781.895628:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2379 00000100:00100000:0.0:1762166781.895639:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+41:37055:x1847765444215040:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:1.0:1762166781.911402:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968844 is committed 00000001:00080000:1.0:1762166781.911424:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968848 is committed 00000001:00080000:1.0:1762166781.911446:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968853 is committed 00000100:00100000:3.0:1762166781.913647:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444215168 00000100:00100000:3.0:1762166781.913656:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444215168 00000100:00100000:3.0:1762166781.913791:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 830 00000100:00100000:3.0:1762166781.913802:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+6:2361:x1847765444215168:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:3.0:1762166781.913906:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+6:2361:x1847765444215168:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 106us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166781.913913:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 830 00000100:00100000:3.0:1762166781.922633:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.924379:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444215552 00000100:00100000:0.0:1762166781.924384:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444215552 00000100:00100000:0.0:1762166781.924417:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2380 00000100:00100000:0.0:1762166781.924422:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+16:37055:x1847765444215552:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166781.924464:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166781.924486:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348245600/0xf915a5bdf3c9b1ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9072a expref: 16 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.924501:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9ee360714e00) 00010000:00010000:0.0:1762166781.924511:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166781.924540:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9b2c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.924560:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9b2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.924566:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9b2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00010000:0.0:1762166781.924755:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007356c667 reply state 000000005d8bf61d transno 4294968854 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9b2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166781.924785:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166781.924866:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+17:37055:x1847765444215552:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 442us (537us total) trans 4294968854 rc 0/0 00000100:00100000:0.0:1762166781.924873:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2380 00010000:00010000:1.0:1762166781.925833:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9b2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.925845:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9b2c3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.925851:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9b2c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.925857:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166781.925868:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9b2c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.925875:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9b2c3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.925891:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9ee36062b100) 00010000:00010000:1.0:1762166781.925894:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166781.925898:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9b2c3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.925904:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9b2c3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166781.926139:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444215680 00000100:00100000:0.0:1762166781.926145:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444215680 00000100:00100000:0.0:1762166781.926186:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2381 00000100:00100000:0.0:1762166781.926195:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+16:37055:x1847765444215680:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.926212:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.926225:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9b2ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90746 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.926259:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9b2ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90746 expref: 17 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.926272:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9b2ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90746 expref: 17 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.926286:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9ee36062b300) 00010000:00010000:0.0:1762166781.926289:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166781.926298:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3200, rc 0) 00000100:00100000:0.0:1762166781.926342:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+17:37055:x1847765444215680:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 147us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166781.926348:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2381 00000100:00100000:3.0:1762166781.927548:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166781.929063:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444215936 00000100:00100000:3.0:1762166781.929080:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444215936 00000100:00100000:3.0:1762166781.929123:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 833 00000100:00100000:3.0:1762166781.929132:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+7:2361:x1847765444215936:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:3.0:1762166781.929375:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb size from disk: 10485760 -> 10485760 00002000:00010000:3.0:1762166781.929379:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb mtime from disk: 1762166782 -> 1762166781 00002000:00010000:3.0:1762166781.929381:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb atime from disk: 0 -> 1762166781 00002000:00010000:3.0:1762166781.929383:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb ctime from disk: 1762166782 -> 1762166782 00002000:00010000:3.0:1762166781.929386:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb blocks from disk: 20487 -> 20487 00000100:00100000:3.0:1762166781.929435:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:2361:x1847765444215936:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 303us (503us total) trans 17179869365 rc 0/0 00000100:00100000:3.0:1762166781.929443:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 833 00000100:00100000:3.0:1762166781.930466:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.930505:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444216192 00000100:00100000:0.0:1762166781.930510:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444216192 00000100:00100000:0.0:1762166781.930542:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2382 00000100:00100000:0.0:1762166781.930548:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+17:37055:x1847765444216192:12345-192.168.203.35@tcp:55:lfs.0 00010000:00010000:0.0:1762166781.930586:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b2d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.930598:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b2d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.930605:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b2d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.930622:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b2d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.930626:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b2d8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.930630:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b2d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.930633:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166781.930636:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b2d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.930640:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b2d8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.930657:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9ee36062b300) 00010000:00010000:0.0:1762166781.930659:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1762166781.930663:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b2d8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.930666:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b2d8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166781.930709:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+17:37055:x1847765444216192:12345-192.168.203.35@tcp:55:lfs.0 Request processed in 160us (246us total) trans 0 rc -22/-22 00000100:00100000:0.0:1762166781.930715:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2382 00000100:00100000:0.0:1762166781.932093:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444216448 00000100:00100000:0.0:1762166781.932100:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444216448 00000100:00100000:0.0:1762166781.932135:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2383 00000100:00100000:0.0:1762166781.932143:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+17:37055:x1847765444216448:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166781.932176:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166781.932194:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b1f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90723 expref: 17 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.932217:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee343a13e00) 00010000:00010000:0.0:1762166781.932220:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166781.932246:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b2df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.932255:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b2df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.932263:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b2df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00010000:0.0:1762166781.932396:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000082c21cc2 reply state 00000000592f4e61 transno 4294968855 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b2df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166781.932404:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166781.932475:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:37055:x1847765444216448:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 332us (536us total) trans 4294968855 rc 0/0 00000100:00100000:0.0:1762166781.932482:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2383 00010000:00010000:0.0:1762166781.933579:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b2df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.933587:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b2df lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.933592:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b2df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.933597:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166781.933600:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b2df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.933608:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b2df lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.933621:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee343a13e00) 00010000:00010000:0.0:1762166781.933625:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.933629:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b2df lrc: 2/0,0 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.933635:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b2df lrc: 0/0,0 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166781.934190:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444216576 00000100:00100000:0.0:1762166781.934211:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444216576 00000100:00100000:0.0:1762166781.934260:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2384 00000100:00100000:0.0:1762166781.934268:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+17:37055:x1847765444216576:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.934289:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.934304:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9b2e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90754 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.934357:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9b2e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90754 expref: 18 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.934369:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9b2e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90754 expref: 18 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.934384:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee343a13e00) 00010000:00010000:0.0:1762166781.934386:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166781.934389:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3000, rc 0) 00000100:00100000:0.0:1762166781.934440:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:37055:x1847765444216576:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 172us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166781.934446:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2384 00000100:00100000:3.0:1762166781.936526:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444216704 00000100:00100000:3.0:1762166781.936535:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444216704 00000100:00100000:3.0:1762166781.936599:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 834 00000100:00100000:3.0:1762166781.936608:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+27:37055:x1847765444216704:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166781.936625:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166781.936641:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b2ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9075b expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.936667:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b229 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9073f expref: 28 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166781.936676:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166781.936678:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166781.936682:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b2ed lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9075b expref: 28 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.936732:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b229 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9073f expref: 28 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166781.936746:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b229 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9073f expref: 28 pid: 12400 timeout: 502 lvb_type: 1 00000100:00100000:3.0:1762166781.936759:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765451908608:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166781.936891:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166781.938643:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.938694:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444216832 00000100:00100000:0.0:1762166781.938702:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444216832 00010000:00010000:0.0:1762166781.938733:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b229 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9073f expref: 28 pid: 12400 timeout: 502 lvb_type: 1 00000100:00100000:1.0:1762166781.938808:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 528 00000100:00100000:1.0:1762166781.938820:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+28:2360:x1847765444216832:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166781.938834:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166781.938855:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b229 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9073f expref: 28 pid: 12400 timeout: 502 lvb_type: 1 00010000:00010000:1.0:1762166781.938869:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b229 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9073f expref: 28 pid: 12400 timeout: 502 lvb_type: 1 00010000:00010000:1.0:1762166781.938890:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b229 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9073f expref: 28 pid: 12400 timeout: 502 lvb_type: 1 00010000:00010000:1.0:1762166781.938913:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166781.938915:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166781.938920:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b2ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9075b expref: 27 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.938959:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b2ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9075b expref: 27 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.938991:0:5741:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b2ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9075b expref: 27 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166781.939008:0:5741:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5741:1847765451908736:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762166781.939071:0:5741:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485600 going to sleep for 11 seconds 00000100:00100000:1.0:1762166781.941205:0:5741:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5741:1847765451908736:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762166781.941227:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166781.941280:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+27:2360:x1847765444216832:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 2462us (2637us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166781.941290:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 528 00000100:00100000:3.0:1762166781.941797:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166781.944518:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444217216 00000100:00100000:1.0:1762166781.944536:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444217216 00000100:00100000:1.0:1762166781.944617:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 704 00000100:00100000:1.0:1762166781.944630:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3719f8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:37055:x1847765444217216:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166781.944728:0:5758:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000402:0x17:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244600/0xf915a5bdf3c9b214 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90738 expref: 18 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.944845:0:5758:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b2f4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.944862:0:5758:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9b2e6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90754 expref: 18 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.944896:0:5758:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b2f4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.944953:0:5758:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9b2e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90754 expref: 18 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.944969:0:5758:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9b2e6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90754 expref: 18 pid: 6558 timeout: 502 lvb_type: 0 00000100:00100000:1.0:1762166781.944987:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1847765451908864:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166781.945089:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485600 going to sleep for 11 seconds 00000100:00100000:1.0:1762166781.947547:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1847765451908864:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166781.947587:0:5758:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b2f4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00000100:00100000:1.0:1762166781.948173:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444217344 00000100:00100000:1.0:1762166781.948183:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444217344 00010000:00010000:1.0:1762166781.948220:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9b2e6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90754 expref: 19 pid: 6558 timeout: 502 lvb_type: 0 00000100:00100000:1.0:1762166781.948264:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 529 00000100:00100000:1.0:1762166781.948274:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+19:2360:x1847765444217344:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166781.948290:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166781.948297:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9b2e6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90754 expref: 19 pid: 6558 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1762166781.948309:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9b2e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90754 expref: 19 pid: 6558 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1762166781.948344:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9b2e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90754 expref: 19 pid: 6558 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1762166781.948361:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee343a13e00) 00010000:00010000:1.0:1762166781.948366:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b2f4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.948374:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b2f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.948382:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b2f4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.948413:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166781.948468:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:2360:x1847765444217344:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 195us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166781.948477:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 529 00010000:00010000:3.0:1762166781.948513:0:5758:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b2f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:3.0:1762166781.948523:0:5758:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b2f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:3.0:1762166781.948544:0:5758:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b2fb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5758 initiator: MDT0 00010000:00010000:3.0:1762166781.948557:0:5758:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9b2ca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90746 expref: 17 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.948564:0:5758:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b2fb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 00010000:00010000:3.0:1762166781.948595:0:5758:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9b2ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90746 expref: 17 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.948620:0:5758:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9b2ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90746 expref: 17 pid: 6558 timeout: 502 lvb_type: 0 00000100:00100000:3.0:1762166781.948634:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1847765451908992:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166781.948741:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166781.950149:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1847765451908992:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166781.950171:0:5758:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b2fb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00000100:00100000:1.0:1762166781.950875:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444217472 00000100:00100000:1.0:1762166781.950882:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444217472 00010000:00010000:1.0:1762166781.950909:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9b2ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90746 expref: 18 pid: 6558 timeout: 502 lvb_type: 0 00000100:00100000:1.0:1762166781.950935:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 530 00000100:00100000:1.0:1762166781.950957:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:2361:x1847765444217472:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166781.950969:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166781.950975:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9b2ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90746 expref: 18 pid: 6558 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1762166781.951004:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9b2ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90746 expref: 18 pid: 6558 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1762166781.951023:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9b2ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90746 expref: 18 pid: 6558 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1762166781.951038:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9ee36062b300) 00010000:00010000:1.0:1762166781.951042:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b2fb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.951050:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b2fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.951057:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b2fb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.951084:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166781.951117:0:5758:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b2fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:3.0:1762166781.951126:0:5758:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b2fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00000100:00100000:1.0:1762166781.951134:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+17:2361:x1847765444217472:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 190us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166781.951143:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 530 00000100:00100000:3.0:1762166781.951536:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451909120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166781.951575:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166781.951609:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157f00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166781.951660:0:11810:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451909120 00000100:00100000:0.0:1762166781.951666:0:11810:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451909120 00000100:00100000:0.0:1762166781.951705:0:11810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1762166781.951712:0:11810:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5758:x1847765451909120:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166781.951815:0:11810:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5758:x1847765451909120:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 102us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166781.951823:0:11810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1762166781.951912:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451909120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166781.951985:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451909248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166781.952013:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166781.952042:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2435c1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166781.952097:0:11810:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451909248 00000100:00100000:0.0:1762166781.952102:0:11810:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451909248 00000100:00100000:0.0:1762166781.952135:0:11810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1762166781.952142:0:11810:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5758:x1847765451909248:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166781.952203:0:11810:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5758:x1847765451909248:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 61us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166781.952209:0:11810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1762166781.952273:0:5758:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869354 gen 2 00000004:00080000:1.0:1762166781.952278:0:5758:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f77ad80, transno 17179869354 00000100:00100000:1.0:1762166781.952298:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451909248:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:1.0:1762166781.952886:0:5758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].13, 280 off37128 00000001:00080000:1.0:1762166781.952898:0:5758:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968856 00000100:00100000:1.0:1762166781.952964:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451909376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166781.952991:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166781.953022:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3639ac780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166781.953186:0:11810:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451909376 00000100:00100000:3.0:1762166781.953192:0:11810:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451909376 00000100:00100000:3.0:1762166781.953222:0:11810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1762166781.953229:0:11810:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5758:x1847765451909376:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166781.953379:0:11810:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5758:x1847765451909376:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 148us (385us total) trans 17179869366 rc 0/0 00000100:00100000:3.0:1762166781.953385:0:11810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1762166781.953441:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451909376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166781.953464:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451909504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166781.953491:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166781.953517:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3639ac780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166781.953533:0:11810:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451909504 00000100:00100000:3.0:1762166781.953545:0:11810:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451909504 00000100:00100000:3.0:1762166781.953572:0:11810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1762166781.953579:0:11810:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5758:x1847765451909504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166781.953702:0:11810:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5758:x1847765451909504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 123us (210us total) trans 21474836680 rc 0/0 00000100:00100000:3.0:1762166781.953709:0:11810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1762166781.953750:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451909504:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1762166781.953844:0:5758:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968857 00010000:00010000:1.0:1762166781.953870:0:5758:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b2fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.953879:0:5758:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b2fb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.953886:0:5758:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b2fb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.953891:0:5758:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166781.953895:0:5758:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b2fb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.953901:0:5758:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b2fb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.953914:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9ee36062b300) 00010000:00010000:1.0:1762166781.953917:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166781.953929:0:5758:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b2fb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.953935:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b2fb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.953981:0:5758:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b2f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.953987:0:5758:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b2f4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.953993:0:5758:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b2f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.953998:0:5758:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166781.954001:0:5758:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b2f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.954006:0:5758:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b2f4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.954015:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee343a13e00) 00010000:00010000:1.0:1762166781.954017:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166781.954020:0:5758:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b2f4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.954025:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b2f4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.954036:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee343a13e00) 00010000:00010000:1.0:1762166781.954039:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166781.954044:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244600/0xf915a5bdf3c9b214 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90738 expref: 19 pid: 6558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166781.954133:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3719f8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:37055:x1847765444217216:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 9506us (9702us total) trans 4294968858 rc 0/0 00000100:00100000:1.0:1762166781.954142:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 704 00000020:00080000:1.0:1762166781.954146:0:5758:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166781.957237:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444217600 00000100:00100000:1.0:1762166781.957245:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444217600 00000100:00100000:1.0:1762166781.957301:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2385 00000100:00100000:1.0:1762166781.957312:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:37055:x1847765444217600:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166781.957334:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166781.957355:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b302 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90762 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.957412:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b302 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90762 expref: 19 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.957426:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b302 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90762 expref: 19 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.957446:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee34c9faa00) 00010000:00010000:1.0:1762166781.957449:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166781.957452:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453600, rc 0) 00000100:00100000:1.0:1762166781.957517:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+19:37055:x1847765444217600:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 206us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166781.957525:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2385 00000100:00100000:1.0:1762166781.959399:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444217856 00000100:00100000:1.0:1762166781.959406:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444217856 00000100:00100000:1.0:1762166781.959462:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 705 00000100:00100000:1.0:1762166781.959471:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+19:37055:x1847765444217856:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166781.959691:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+20:37055:x1847765444217856:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 221us (347us total) trans 4294968859 rc 0/0 00000100:00100000:1.0:1762166781.959699:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 705 00000100:00100000:1.0:1762166781.961860:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444218112 00000100:00100000:1.0:1762166781.961872:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444218112 00000100:00100000:1.0:1762166781.961928:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 706 00000100:00100000:1.0:1762166781.961936:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+20:37055:x1847765444218112:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:1.0:1762166781.962177:0:5758:0:(mdd_object.c:3965:mdd_close()) Object [0x200000402:0x18:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1762166781.962285:0:5758:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9b309 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.962300:0:5758:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9b309 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.962310:0:5758:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9b309 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.962318:0:5758:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9b309 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.962324:0:5758:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9b309 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.962330:0:5758:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9b309 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166781.962353:0:5758:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1762166781.962466:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+21:37055:x1847765444218112:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 528us (780us total) trans 4294968860 rc 0/0 00000100:00100000:1.0:1762166781.962505:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 706 00000100:00100000:0.0:1762166781.964222:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444218368 00000100:00100000:0.0:1762166781.964230:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444218368 00000100:00100000:0.0:1762166781.964282:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2386 00000100:00100000:0.0:1762166781.964292:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+21:37055:x1847765444218368:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.964309:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.964324:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b310 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90769 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.964385:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b317 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964396:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b317 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964405:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b317 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964417:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b31e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964437:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b31e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964444:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b31e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964556:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9b325 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964564:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9b325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964571:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9b325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:0.0:1762166781.964580:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 10485760 00010000:00010000:0.0:1762166781.964649:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b317 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964656:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b317 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964662:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b317 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964667:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166781.964671:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b317 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964677:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b317 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964688:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9ee343a13500) 00010000:00010000:0.0:1762166781.964696:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.964701:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b317 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964706:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b317 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964719:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b31e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964725:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b31e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964730:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b31e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964734:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166781.964737:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b31e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964741:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b31e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964747:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x3d8b1ba3 (ffff9ee36062b700) 00010000:00010000:0.0:1762166781.964749:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.964752:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b31e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964756:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b31e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.964823:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b310 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90769 expref: 24 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.964846:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9b325 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90769 expref: 23 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.964853:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee34c9faa00) 00010000:00010000:0.0:1762166781.964855:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166781.964858:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2a00, rc 0) 00000100:00100000:0.0:1762166781.964897:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+23:37055:x1847765444218368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 607us (759us total) trans 4294968861 rc 0/0 00000100:00100000:0.0:1762166781.964904:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2386 00000100:00100000:3.0:1762166781.967048:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.967095:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444218624 00000100:00100000:0.0:1762166781.967102:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444218624 00000100:00100000:0.0:1762166781.967146:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2387 00000100:00100000:0.0:1762166781.967159:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+23:37055:x1847765444218624:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.967180:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.967195:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9b333 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90770 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.967616:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9b33a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.967628:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9b33a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.967643:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9b33a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:0.0:1762166781.967653:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 0 00010000:00010000:0.0:1762166781.967693:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9b333 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90770 expref: 26 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.967718:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9b33a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90770 expref: 25 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.967725:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9ee36062b900) 00010000:00010000:0.0:1762166781.967728:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166781.967731:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2e00, rc 0) 00000100:00100000:0.0:1762166781.967802:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+25:37055:x1847765444218624:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 647us (759us total) trans 4294968862 rc 0/0 00000100:00100000:0.0:1762166781.967810:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2387 00000100:00100000:1.0:1762166781.969951:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444218880 00000100:00100000:1.0:1762166781.969959:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444218880 00000100:00100000:1.0:1762166781.970014:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2388 00000100:00100000:1.0:1762166781.970023:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+25:37055:x1847765444218880:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166781.970045:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166781.970061:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b348 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90777 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.970143:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b34f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.970157:0:6558:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9b33a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90770 expref: 26 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.970165:0:6558:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b34f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.970200:0:6558:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9b33a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90770 expref: 26 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.970213:0:6558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9b33a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90770 expref: 26 pid: 6558 timeout: 502 lvb_type: 0 00000100:00100000:1.0:1762166781.970225:0:6558:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451909632:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166781.970297:0:6558:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3639ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1762166781.972134:0:6558:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451909632:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166781.972155:0:6558:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b34f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:1.0:1762166781.972844:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444219008 00000100:00100000:1.0:1762166781.972851:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444219008 00010000:00010000:1.0:1762166781.972885:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9b33a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90770 expref: 27 pid: 6558 timeout: 502 lvb_type: 0 00000100:00100000:1.0:1762166781.972923:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 531 00000100:00100000:1.0:1762166781.972932:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+27:2361:x1847765444219008:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166781.972956:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166781.972962:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9b33a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90770 expref: 27 pid: 6558 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1762166781.972974:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9b33a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90770 expref: 27 pid: 6558 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1762166781.972994:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9b33a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90770 expref: 27 pid: 6558 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1762166781.973009:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9ee36062b900) 00010000:00010000:1.0:1762166781.973013:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b34f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.973022:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b34f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.973029:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b34f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166781.973145:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166781.973190:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+26:2361:x1847765444219008:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 258us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166781.973206:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 531 00010000:00010000:0.0:1762166781.973249:0:6558:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b34f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.973256:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b34f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:0.0:1762166781.973275:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 0 00000004:00080000:0.0:1762166781.973549:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4d:0x0], index 0: 0 00010000:00010000:0.0:1762166781.973686:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b34f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.973694:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b34f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.973700:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b34f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.973706:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166781.973709:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b34f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.973726:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b34f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.973735:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9ee36062b900) 00010000:00010000:0.0:1762166781.973738:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166781.973741:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b34f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.973747:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b34f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.973824:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b348 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90777 expref: 26 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.973834:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9ee343a13500) 00010000:00010000:0.0:1762166781.973836:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166781.973840:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b348 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90777 expref: 26 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.973850:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452e00, rc 0) 00000100:00100000:0.0:1762166781.973888:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+25:37055:x1847765444218880:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3866us (4016us total) trans 4294968863 rc 301/301 00000100:00100000:0.0:1762166781.973895:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2388 00000100:00100000:1.0:1762166781.975699:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444219264 00000100:00100000:1.0:1762166781.975706:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444219264 00000100:00100000:1.0:1762166781.975792:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 707 00000100:00100000:1.0:1762166781.975803:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+25:37055:x1847765444219264:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166781.976077:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+26:37055:x1847765444219264:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 276us (430us total) trans 4294968864 rc 0/0 00000100:00100000:1.0:1762166781.976085:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 707 00000100:00100000:0.0:1762166781.977758:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444219392 00000100:00100000:0.0:1762166781.977778:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444219392 00000100:00100000:0.0:1762166781.977818:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2389 00000100:00100000:0.0:1762166781.977826:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+26:37055:x1847765444219392:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.977842:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.977877:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9b35d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9077e expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.977935:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b364 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.977964:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b364 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.977974:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b364 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:0.0:1762166781.978001:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 0 00000004:00200000:0.0:1762166781.978005:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166781.978017:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b364 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.978038:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9b35d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9077e expref: 28 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.978055:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b364 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9077e expref: 27 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.978063:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9ee36062b700) 00010000:00010000:0.0:1762166781.978066:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762166781.978069:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2200, rc 0) 00000100:00100000:0.0:1762166781.978108:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+27:37055:x1847765444219392:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 283us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166781.978115:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2389 00000100:00100000:3.0:1762166781.979655:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166781.983092:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444219776 00000100:00100000:0.0:1762166781.983099:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444219776 00000100:00100000:0.0:1762166781.983149:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2390 00000100:00100000:0.0:1762166781.983174:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+27:37055:x1847765444219776:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.983191:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.983207:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b372 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9078c expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.983289:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b379 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.983299:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b379 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166781.983306:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b379 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:0.0:1762166781.983317:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 10485760 00010000:00010000:0.0:1762166781.983426:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b372 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9078c expref: 30 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.983443:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b379 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9078c expref: 29 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.983450:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee34c9faa00) 00010000:00010000:0.0:1762166781.983453:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166781.983456:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3c00, rc 0) 00000100:00100000:0.0:1762166781.983508:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+29:37055:x1847765444219776:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 337us (466us total) trans 4294968865 rc 0/0 00000100:00100000:0.0:1762166781.983516:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2390 00000100:00100000:3.0:1762166781.985197:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166781.987069:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166781.987133:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444220032 00000100:00100000:1.0:1762166781.987139:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444220032 00010000:00010000:1.0:1762166781.987167:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9b2d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9074d expref: 9 pid: 12400 timeout: 502 lvb_type: 0 00000100:00100000:1.0:1762166781.987205:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 532 00000100:00100000:1.0:1762166781.987214:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+9:2361:x1847765444220032:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166781.987226:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166781.987246:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9b2d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9074d expref: 9 pid: 12400 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1762166781.987257:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9b2d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9074d expref: 9 pid: 12400 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1762166781.987276:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9b2d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9074d expref: 9 pid: 12400 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1762166781.987304:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166781.987306:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166781.987311:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b387 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.987319:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b387 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.987346:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166781.987391:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:2361:x1847765444220032:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 177us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166781.987408:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 532 00000100:00100000:3.0:1762166782.011703:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.016798:0:14119:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444220288 00000100:00100000:1.0:1762166782.016807:0:14119:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444220288 00000100:00100000:0.0:1762166782.016815:0:14121:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444220416 00000100:00100000:0.0:1762166782.016822:0:14121:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444220416 00000100:00100000:1.0:1762166782.016863:0:14119:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444220544 00000100:00100000:1.0:1762166782.016868:0:14119:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444220544 00000100:00100000:0.0:1762166782.016887:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 877 00000100:00100000:0.0:1762166782.016912:0:14121:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:22b95110-b0b2-4d2b-9402-7e0d82812a7e+10:2361:x1847765444220288:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:3.0:1762166782.016918:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 879 00000100:00100000:3.0:1762166782.016930:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:22b95110-b0b2-4d2b-9402-7e0d82812a7e+10:2360:x1847765444220544:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762166782.016963:0:26247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b395 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.016964:0:14121:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b3a3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.016984:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166782.016987:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166782.016992:0:26247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b395 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.017004:0:26247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b395 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.017023:0:14121:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166782.017027:0:14121:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166782.017033:0:14121:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b3a3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.017047:0:14121:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b3a3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166782.017826:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.018488:0:6540:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444220672 00000100:00100000:1.0:1762166782.018495:0:6540:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444220672 00000100:00100000:1.0:1762166782.018543:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 880 00000100:00100000:1.0:1762166782.018554:0:6540:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+14:2361:x1847765444220672:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762166782.018581:0:6540:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b3aa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.018595:0:6540:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.018597:0:6540:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.018601:0:6540:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b3aa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.018625:0:6540:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b3aa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166782.018737:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.018847:0:6538:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444220928 00000100:00100000:3.0:1762166782.018852:0:6538:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444220928 00000100:00100000:3.0:1762166782.018892:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 881 00000100:00100000:3.0:1762166782.018901:0:6538:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+16:2361:x1847765444220928:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762166782.018930:0:6538:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b3b1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.018952:0:6538:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166782.018955:0:6538:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166782.018959:0:6538:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b3b1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.018971:0:6538:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b3b1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166782.019196:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444220800 00000100:00100000:1.0:1762166782.019201:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444220800 00000100:00100000:1.0:1762166782.019236:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444221056 00000100:00100000:1.0:1762166782.019241:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444221056 00000100:00100000:1.0:1762166782.019267:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444221312 00000100:00100000:1.0:1762166782.019271:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444221312 00000100:00100000:1.0:1762166782.019305:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 883 00000100:00100000:1.0:1762166782.019320:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+21:2361:x1847765444221056:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762166782.019340:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b3bf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.019362:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.019367:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.019372:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b3bf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.019383:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b3bf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166782.019476:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 884 00000100:00100000:3.0:1762166782.019485:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+21:2360:x1847765444221184:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762166782.019504:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b3c6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.019514:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166782.019516:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166782.019521:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b3c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.019530:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b3c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166782.020328:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 885 00000100:00100000:1.0:1762166782.020339:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:22b95110-b0b2-4d2b-9402-7e0d82812a7e+23:2361:x1847765444221312:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762166782.020360:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3cd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.020383:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.020385:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.020389:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.020399:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.023033:0:14121:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b3a3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.023052:0:14121:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b3a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.023062:0:14121:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b3a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.023069:0:14121:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166782.023074:0:14121:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b3a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.023085:0:14121:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b3a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.023104:0:14121:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b3a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.023113:0:14121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9b3a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 11 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166782.023198:0:14121:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:22b95110-b0b2-4d2b-9402-7e0d82812a7e+24:2361:x1847765444220288:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 6288us (6488us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1762166782.023208:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 877 00010000:00010000:0.0:1762166782.026248:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9b39c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.026265:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9b39c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.026274:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9b39c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.026280:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348244c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166782.026284:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9b39c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.026290:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9b39c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.026323:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9b39c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.026331:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee348244c00/0xf915a5bdf3c9b39c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166782.026407:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:22b95110-b0b2-4d2b-9402-7e0d82812a7e+22:2361:x1847765444220416:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 9484us (9659us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1762166782.026417:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 878 00000100:00100000:0.0:1762166782.026744:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762166782.029254:0:26247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b395 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.029273:0:26247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b395 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.029283:0:26247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b395 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.029291:0:26247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105c400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166782.029296:0:26247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b395 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.029306:0:26247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b395 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.029325:0:26247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b395 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.029346:0:26247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b395 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166782.029464:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:22b95110-b0b2-4d2b-9402-7e0d82812a7e+22:2360:x1847765444220544:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 12533us (12645us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1762166782.029474:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 879 00010000:00010000:1.0:1762166782.030182:0:6540:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b3aa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.030194:0:6540:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b3aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.030201:0:6540:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b3aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.030208:0:6540:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166782.030212:0:6540:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b3aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.030220:0:6540:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b3aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.030235:0:6540:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b3aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.030241:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b3aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166782.030294:0:6540:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+20:2361:x1847765444220672:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 11741us (12469us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1762166782.030318:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 880 00010000:00010000:1.0:1762166782.031447:0:6538:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b3b1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 8 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.031460:0:6538:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b3b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 8 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.031469:0:6538:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b3b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 8 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.031476:0:6538:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105ce00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166782.031481:0:6538:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b3b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 8 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.031489:0:6538:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b3b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 8 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.031505:0:6538:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b3b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 8 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.031513:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b3b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 8 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166782.031594:0:6538:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:2361:x1847765444220928:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 12693us (12856us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1762166782.031606:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 881 00010000:00010000:1.0:1762166782.032478:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b3bf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.032502:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b3bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.032511:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b3bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.032518:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166782.032522:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b3bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.032530:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b3bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.032545:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b3bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.032553:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b3bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 7 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166782.032606:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+16:2361:x1847765444221056:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 13288us (13451us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1762166782.032612:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 883 00010000:00010000:0.0:1762166782.034209:0:26243:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee348245a00/0xf915a5bdf3c9b3b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.034222:0:26243:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348245a00/0xf915a5bdf3c9b3b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.034231:0:26243:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee348245a00/0xf915a5bdf3c9b3b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.034238:0:26243:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348245a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166782.034241:0:26243:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348245a00/0xf915a5bdf3c9b3b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.034250:0:26243:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348245a00/0xf915a5bdf3c9b3b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.034264:0:26243:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee348245a00/0xf915a5bdf3c9b3b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.034271:0:26243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee348245a00/0xf915a5bdf3c9b3b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166782.034368:0:26243:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:22b95110-b0b2-4d2b-9402-7e0d82812a7e+14:2361:x1847765444220800:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 15058us (15254us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1762166782.034378:0:26243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 882 00010000:00010000:0.0:1762166782.036899:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b3c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.036918:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b3c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.036927:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b3c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.036934:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105dc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166782.036939:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b3c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.036959:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b3c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.036976:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b3c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.036984:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b3c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166782.037109:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:2360:x1847765444221184:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 17622us (17913us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1762166782.037132:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 884 00010000:00010000:1.0:1762166782.038995:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.039011:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.039031:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.039039:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166782.039044:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.039053:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.039072:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.039080:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166782.039164:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:22b95110-b0b2-4d2b-9402-7e0d82812a7e+10:2361:x1847765444221312:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 18825us (19939us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1762166782.039174:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 885 00000100:00100000:3.0:1762166782.048468:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.049010:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.049096:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.049158:0:26243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 889 00000100:00100000:0.0:1762166782.049172:0:26243:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:22b95110-b0b2-4d2b-9402-7e0d82812a7e+31:2360:x1847765444221824:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:0.0:1762166782.049198:0:26243:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27c600/0xf915a5bdf3c9b3e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.049217:0:26243:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166782.049220:0:26243:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166782.049230:0:26243:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27c600/0xf915a5bdf3c9b3e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.049378:0:26243:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27c600/0xf915a5bdf3c9b3e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166782.049806:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.049972:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444221952 00000100:00100000:1.0:1762166782.049977:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444221952 00000100:00100000:1.0:1762166782.050014:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 890 00000100:00100000:1.0:1762166782.050023:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+32:2361:x1847765444221952:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:1.0:1762166782.050039:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.050061:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.050064:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.050066:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.050074:0:6539:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166782.050493:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.050622:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444222080 00000100:00100000:3.0:1762166782.050628:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444222080 00000100:00100000:3.0:1762166782.050667:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 891 00000100:00100000:3.0:1762166782.050682:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+33:2361:x1847765444222080:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:3.0:1762166782.050699:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b3f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.050709:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166782.050711:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166782.050714:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b3f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.050721:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b3f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166782.051425:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444222464 00000100:00100000:1.0:1762166782.051430:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444222464 00010000:00010000:1.0:1762166782.051453:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee348245400/0xf915a5bdf3c9b36b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90785 expref: 34 pid: 12400 timeout: 502 lvb_type: 1 00000100:00100000:0.0:1762166782.051473:0:6540:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444222208 00000100:00100000:0.0:1762166782.051479:0:6540:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444222208 00000100:00100000:1.0:1762166782.051494:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 533 00000100:00100000:1.0:1762166782.051503:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+35:2360:x1847765444222464:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166782.051514:0:6540:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444222336 00010000:00010000:1.0:1762166782.051515:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166782.051519:0:6540:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444222336 00010000:00010000:1.0:1762166782.051537:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee348245400/0xf915a5bdf3c9b36b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90785 expref: 36 pid: 12400 timeout: 502 lvb_type: 1 00010000:00010000:1.0:1762166782.051551:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee348245400/0xf915a5bdf3c9b36b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90785 expref: 36 pid: 12400 timeout: 502 lvb_type: 1 00000100:00100000:0.0:1762166782.051557:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 892 00000100:00100000:0.0:1762166782.051567:0:6540:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+36:2360:x1847765444222208:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:0.0:1762166782.051583:0:6540:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27ca00/0xf915a5bdf3c9b3fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.051669:0:6540:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166782.051672:0:6540:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166782.051675:0:6540:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27ca00/0xf915a5bdf3c9b3fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166782.051701:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 893 00000100:00100000:3.0:1762166782.051715:0:6538:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+36:2360:x1847765444222336:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:3.0:1762166782.051736:0:6538:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b405 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.052026:0:6538:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.052027:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee348245400/0xf915a5bdf3c9b36b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4d:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90785 expref: 37 pid: 12400 timeout: 502 lvb_type: 1 00010000:00010000:0.0:1762166782.052027:0:6540:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27ca00/0xf915a5bdf3c9b3fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 12 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.052032:0:6538:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166782.052039:0:6538:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 13 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.052058:0:6538:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 12 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.052072:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.052076:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.052080:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80f000/0xf915a5bdf3c9b3db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.052089:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80f000/0xf915a5bdf3c9b3db lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.052097:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.052100:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.052103:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80e600/0xf915a5bdf3c9b3e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.052111:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80e600/0xf915a5bdf3c9b3e2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.052118:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.052120:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.052123:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27c600/0xf915a5bdf3c9b3e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.052130:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27c600/0xf915a5bdf3c9b3e9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.052137:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.052139:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.052141:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.052160:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3f0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.052168:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.052170:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.052172:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b3f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.052179:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b3f7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.052185:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.052187:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.052190:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27ca00/0xf915a5bdf3c9b3fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.052198:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27ca00/0xf915a5bdf3c9b3fe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.052258:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166782.052298:0:6540:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27ca00/0xf915a5bdf3c9b3fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166782.052303:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+36:2360:x1847765444222464:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 801us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166782.052319:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 533 00010000:00010000:3.0:1762166782.052320:0:6540:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27ca00/0xf915a5bdf3c9b3fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.052373:0:6539:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.052382:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.055266:0:26243:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27c600/0xf915a5bdf3c9b3e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.055279:0:26243:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27c600/0xf915a5bdf3c9b3e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.056751:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80e600/0xf915a5bdf3c9b3e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.056786:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80e600/0xf915a5bdf3c9b3e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166782.057062:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.057229:0:11752:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444222720 00000100:00100000:3.0:1762166782.057236:0:11752:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444222720 00000100:00100000:3.0:1762166782.057300:0:11752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 895 00000100:00100000:3.0:1762166782.057310:0:11752:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+38:2361:x1847765444222720:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:3.0:1762166782.057343:0:11752:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b413 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.057354:0:11752:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166782.057356:0:11752:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166782.057361:0:11752:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b413 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.057371:0:11752:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b413 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.059451:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80f000/0xf915a5bdf3c9b3db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.059469:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80f000/0xf915a5bdf3c9b3db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.061180:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b3f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.061196:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b3f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762166782.116405:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836681 is committed 00000001:00080000:1.0:1762166782.116426:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836683 is committed 00000001:00080000:1.0:1762166782.116513:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836680 is committed 00002000:00010000:0.0:1762166782.116535:0:6538:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x4d:0x0] updating lvb size from disk: 0 -> 9437184 00002000:00010000:0.0:1762166782.116541:0:6538:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x4d:0x0] updating lvb mtime from disk: 0 -> 1762166782 00002000:00010000:0.0:1762166782.116545:0:6538:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x4d:0x0] updating lvb ctime from disk: 0 -> 1762166782 00002000:00010000:0.0:1762166782.116547:0:6538:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x4d:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:0.0:1762166782.116561:0:6538:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.116572:0:6538:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b405 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.116581:0:6538:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b405 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.116604:0:6538:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105dc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166782.116608:0:6538:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b405 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.116618:0:6538:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.116639:0:6538:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b405 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.116647:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37105dc00/0xf915a5bdf3c9b405 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 10 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166782.116821:0:6538:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+35:2360:x1847765444222336:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 65050us (65392us total) trans 21474836681 rc 0/0 00000100:00100000:0.0:1762166782.116832:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 893 00010000:00010000:0.0:1762166782.116891:0:6540:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27ca00/0xf915a5bdf3c9b3fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.116900:0:6540:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27ca00/0xf915a5bdf3c9b3fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.116907:0:6540:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27ca00/0xf915a5bdf3c9b3fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.116914:0:6540:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f27ca00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166782.116917:0:6540:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27ca00/0xf915a5bdf3c9b3fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.116954:0:6540:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27ca00/0xf915a5bdf3c9b3fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.116966:0:6540:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27ca00/0xf915a5bdf3c9b3fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.116972:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27ca00/0xf915a5bdf3c9b3fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166782.117008:0:6540:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22b95110-b0b2-4d2b-9402-7e0d82812a7e+33:2360:x1847765444222208:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 65441us (65672us total) trans 21474836682 rc 0/0 00000100:00100000:0.0:1762166782.117015:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 892 00010000:00010000:0.0:1762166782.117057:0:26243:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27c600/0xf915a5bdf3c9b3e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.117065:0:26243:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27c600/0xf915a5bdf3c9b3e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.117072:0:26243:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27c600/0xf915a5bdf3c9b3e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.117078:0:26243:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f27c600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166782.117081:0:26243:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27c600/0xf915a5bdf3c9b3e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.117095:0:26243:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27c600/0xf915a5bdf3c9b3e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.117118:0:26243:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27c600/0xf915a5bdf3c9b3e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.117125:0:26243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f27c600/0xf915a5bdf3c9b3e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166782.117156:0:26243:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:22b95110-b0b2-4d2b-9402-7e0d82812a7e+31:2360:x1847765444221824:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 67989us (68060us total) trans 21474836683 rc 0/0 00000100:00100000:0.0:1762166782.117163:0:26243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 889 00000100:00100000:3.0:1762166782.137605:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.137795:0:26243:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444222848 00000100:00100000:1.0:1762166782.137807:0:26243:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444222848 00000100:00100000:1.0:1762166782.137882:0:26243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 896 00000100:00100000:1.0:1762166782.137894:0:26243:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:22b95110-b0b2-4d2b-9402-7e0d82812a7e+31:2361:x1847765444222848:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:1.0:1762166782.137926:0:26243:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b41a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.137953:0:26243:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.137956:0:26243:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.137961:0:26243:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b41a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 8 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.137974:0:26243:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b41a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 8 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166782.142360:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x4d:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:0.0:1762166782.142370:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x4d:0x0] updating lvb blocks from disk: 6151 -> 18439 00010000:00010000:0.0:1762166782.142382:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80e600/0xf915a5bdf3c9b3e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 8 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.142393:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80e600/0xf915a5bdf3c9b3e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 8 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.142401:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80e600/0xf915a5bdf3c9b3e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 8 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.142407:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f80e600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166782.142411:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80e600/0xf915a5bdf3c9b3e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 8 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.142418:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80e600/0xf915a5bdf3c9b3e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 8 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.142594:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80f000/0xf915a5bdf3c9b3db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.142612:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80f000/0xf915a5bdf3c9b3db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.142619:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80f000/0xf915a5bdf3c9b3db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.142624:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f80f000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166782.142627:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80f000/0xf915a5bdf3c9b3db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.142633:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80f000/0xf915a5bdf3c9b3db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.142645:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80f000/0xf915a5bdf3c9b3db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.142652:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80f000/0xf915a5bdf3c9b3db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.142680:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.142691:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.142705:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.142711:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166782.142715:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.142722:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.142735:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166782.142744:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:22b95110-b0b2-4d2b-9402-7e0d82812a7e+33:2361:x1847765444221568:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 94071us (94275us total) trans 21474836687 rc 0/0 00010000:00010000:3.0:1762166782.142745:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b3f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166782.142796:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 887 00000001:00080000:1.0:1762166782.142836:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836684 is committed 00000001:00080000:1.0:1762166782.142855:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836686 is committed 00000001:00080000:1.0:1762166782.142868:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836689 is committed 00000100:00100000:3.0:1762166782.142893:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+19:2361:x1847765444221952:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 92869us (93086us total) trans 21474836685 rc 0/0 00000100:00100000:3.0:1762166782.142903:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 890 00010000:00010000:0.0:1762166782.142962:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80e600/0xf915a5bdf3c9b3e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.142972:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80e600/0xf915a5bdf3c9b3e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166782.143021:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:22b95110-b0b2-4d2b-9402-7e0d82812a7e+17:2361:x1847765444221696:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 93872us (94012us total) trans 21474836684 rc 0/0 00000100:00100000:0.0:1762166782.143030:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 888 00010000:00010000:0.0:1762166782.143069:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b3f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.143079:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b3f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.143087:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b3f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.143093:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105cc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166782.143097:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b3f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.143104:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b3f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.143116:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b3f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.143134:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37105cc00/0xf915a5bdf3c9b3f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166782.143180:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+15:2361:x1847765444222080:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 92499us (92688us total) trans 21474836689 rc 0/0 00000100:00100000:0.0:1762166782.143189:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 891 00010000:00010000:0.0:1762166782.143226:0:14120:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80ea00/0xf915a5bdf3c9b40c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.143235:0:14120:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80ea00/0xf915a5bdf3c9b40c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.143242:0:14120:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80ea00/0xf915a5bdf3c9b40c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.143248:0:14120:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f80ea00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166782.143253:0:14120:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80ea00/0xf915a5bdf3c9b40c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.143261:0:14120:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80ea00/0xf915a5bdf3c9b40c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.143273:0:14120:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80ea00/0xf915a5bdf3c9b40c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.143280:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80ea00/0xf915a5bdf3c9b40c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.144866:0:11752:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b413 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.144889:0:11752:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b413 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.144896:0:11752:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b413 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.144902:0:11752:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105ce00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166782.144905:0:11752:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b413 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.144912:0:11752:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b413 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.144924:0:11752:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b413 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.144931:0:11752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37105ce00/0xf915a5bdf3c9b413 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166782.145125:0:11752:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:2361:x1847765444222720:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 87815us (88067us total) trans 21474836686 rc 0/0 00000100:00100000:0.0:1762166782.145125:0:14120:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:22b95110-b0b2-4d2b-9402-7e0d82812a7e+12:2360:x1847765444222592:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 93369us (93472us total) trans 21474836688 rc 0/0 00000100:00100000:0.0:1762166782.145142:0:14120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 894 00000100:00100000:1.0:1762166782.145150:0:11752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 895 00002000:00010000:0.0:1762166782.162068:0:26243:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x4d:0x0] updating lvb blocks from disk: 18439 -> 20487 00010000:00010000:0.0:1762166782.162084:0:26243:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b41a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.162095:0:26243:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b41a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.162104:0:26243:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b41a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.162111:0:26243:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166782.162116:0:26243:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b41a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.162124:0:26243:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b41a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.162143:0:26243:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b41a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.162150:0:26243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b41a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26243 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166782.162245:0:26243:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:22b95110-b0b2-4d2b-9402-7e0d82812a7e+7:2361:x1847765444222848:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 24348us (24642us total) trans 21474836690 rc 0/0 00000100:00100000:0.0:1762166782.162265:0:26243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 896 00000100:00100000:3.0:1762166782.165759:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.165856:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444222976 00000100:00100000:1.0:1762166782.165866:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444222976 00000100:00100000:1.0:1762166782.165920:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2391 00000100:00100000:1.0:1762166782.165936:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+29:37055:x1847765444222976:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:1.0:1762166782.181278:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968865 is committed 00000020:00080000:1.0:1762166782.181318:0:5777:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee350485540 refcount 2 committed 0 result 0 batchid 35 00000020:00080000:1.0:1762166782.181324:0:5777:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee34373c000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee2435c1a80 00000020:00080000:1.0:1762166782.181328:0:5777:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2425f0100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee350485600 00000020:00080000:1.0:1762166782.181331:0:5777:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2425f0300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee247dcc800 00000020:00080000:1.0:1762166782.181334:0:5777:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].13 00000020:00080000:3.0:1762166782.181379:0:5788:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 35 committed batchid 34 00000020:00080000:3.0:1762166782.181537:0:5788:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 34 00000100:00100000:3.0:1762166782.183684:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444223104 00000100:00100000:3.0:1762166782.183692:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444223104 00000100:00100000:3.0:1762166782.183754:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 839 00000100:00100000:3.0:1762166782.183791:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+7:2360:x1847765444223104:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:3.0:1762166782.183945:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+7:2360:x1847765444223104:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 168us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166782.183978:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 839 00000100:00100000:0.0:1762166782.191227:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.191292:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444223232 00000100:00100000:3.0:1762166782.191301:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444223232 00000100:00100000:3.0:1762166782.191360:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 840 00000100:00100000:3.0:1762166782.191370:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:2361:x1847765444223232:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762166782.191410:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b421 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.191424:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166782.191426:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166782.191432:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b421 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.191445:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b421 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.191472:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b421 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.191479:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b421 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.191487:0:12400:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b421 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.191494:0:12400:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166782.191507:0:12400:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b421 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.191515:0:12400:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b421 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.191529:0:12400:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b421 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.191536:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b421 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166782.191614:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:2361:x1847765444223232:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 245us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166782.191621:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 840 00000100:00100000:1.0:1762166782.192998:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444223488 00000100:00100000:1.0:1762166782.193004:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444223488 00000100:00100000:1.0:1762166782.193048:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2392 00000100:00100000:1.0:1762166782.193058:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242cea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+17:37055:x1847765444223488:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762166782.193102:0:5755:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166782.193123:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9b364 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9077e expref: 17 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.193138:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9ee36062b700) 00010000:00010000:1.0:1762166782.193148:0:5755:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166782.193176:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b428 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.193187:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b428 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.193194:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b428 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000004:00010000:1.0:1762166782.193361:0:5755:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000117401f8 reply state 00000000dfa53be1 transno 4294968866 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b428 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000100:00100000:1.0:1762166782.193383:0:5755:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166782.193465:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242cea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:37055:x1847765444223488:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 408us (537us total) trans 4294968866 rc 0/0 00000100:00100000:1.0:1762166782.193473:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2392 00010000:00010000:1.0:1762166782.194395:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b428 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.194408:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b428 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.194414:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b428 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.194419:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166782.194423:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b428 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.194430:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b428 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.194439:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9ee34c9faf00) 00010000:00010000:1.0:1762166782.194442:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166782.194446:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b428 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.194452:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b428 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00000100:00100000:1.0:1762166782.195026:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444223616 00000100:00100000:1.0:1762166782.195032:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444223616 00000100:00100000:1.0:1762166782.195082:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2393 00000100:00100000:1.0:1762166782.195091:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+17:37055:x1847765444223616:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166782.195117:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166782.195137:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453c00/0xf915a5bdf3c9b42f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9079a expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.195178:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453c00/0xf915a5bdf3c9b42f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9079a expref: 18 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.195189:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453c00/0xf915a5bdf3c9b42f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9079a expref: 18 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.195204:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9ee34c9fa200) 00010000:00010000:1.0:1762166782.195207:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166782.195210:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453c00, rc 0) 00000100:00100000:1.0:1762166782.195255:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:37055:x1847765444223616:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 166us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166782.195262:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2393 00000100:00100000:3.0:1762166782.197265:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444223744 00000100:00100000:3.0:1762166782.197272:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444223744 00000100:00100000:3.0:1762166782.197319:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 841 00000100:00100000:3.0:1762166782.197329:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+7:37055:x1847765444223744:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166782.197344:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166782.197361:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b436 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f907a1 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166782.197382:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x4d:0x0] initial LVB size: 10485760, mtime: 0x690887fe, atime: 0x0, ctime: 0x690887fe, blocks: 0x5007 00010000:00010000:3.0:1762166782.197399:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166782.197401:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166782.197409:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b436 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907a1 expref: 8 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.197444:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b436 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907a1 expref: 8 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.197455:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105d000, rc 0) 00000100:00100000:3.0:1762166782.197503:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:37055:x1847765444223744:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 176us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166782.197510:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 841 00000100:00100000:0.0:1762166782.198827:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.198883:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444223872 00000100:00100000:3.0:1762166782.198889:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444223872 00000100:00100000:3.0:1762166782.198926:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 842 00000100:00100000:3.0:1762166782.198935:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:2360:x1847765444223872:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:3.0:1762166782.199158:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x4d:0x0] updating lvb size from disk: 10485760 -> 10485760 00002000:00010000:3.0:1762166782.199161:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x4d:0x0] updating lvb mtime from disk: 1762166782 -> 1762166781 00002000:00010000:3.0:1762166782.199164:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x4d:0x0] updating lvb atime from disk: 0 -> 1762166781 00002000:00010000:3.0:1762166782.199166:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x4d:0x0] updating lvb ctime from disk: 1762166782 -> 1762166782 00002000:00010000:3.0:1762166782.199168:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x4d:0x0] updating lvb blocks from disk: 20487 -> 20487 00000100:00100000:3.0:1762166782.199214:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+9:2360:x1847765444223872:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 280us (389us total) trans 21474836691 rc 0/0 00000100:00100000:3.0:1762166782.199222:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 842 00000100:00100000:1.0:1762166782.200602:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444224128 00000100:00100000:1.0:1762166782.200609:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444224128 00000100:00100000:1.0:1762166782.200749:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2394 00000100:00100000:1.0:1762166782.200759:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:37055:x1847765444224128:12345-192.168.203.35@tcp:55:lfs.0 00010000:00010000:1.0:1762166782.200977:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b43d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.200991:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b43d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.201001:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b43d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.201021:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b43d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.201037:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b43d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.201043:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b43d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.201048:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166782.201051:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b43d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.201057:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b43d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.201067:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9ee34c9fa200) 00010000:00010000:1.0:1762166782.201070:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1762166782.201074:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b43d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.201079:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b43d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00000100:00100000:1.0:1762166782.201159:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:37055:x1847765444224128:12345-192.168.203.35@tcp:55:lfs.0 Request processed in 399us (607us total) trans 0 rc -22/-22 00000100:00100000:1.0:1762166782.201167:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2394 00000100:00100000:1.0:1762166782.202509:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444224384 00000100:00100000:1.0:1762166782.202515:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444224384 00000100:00100000:1.0:1762166782.202551:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2395 00000100:00100000:1.0:1762166782.202559:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:37055:x1847765444224384:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762166782.202591:0:5755:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166782.202611:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9b325 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90769 expref: 18 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.202631:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee34c9faa00) 00010000:00010000:1.0:1762166782.202635:0:5755:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166782.202664:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9b444 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.202674:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9b444 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.202681:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9b444 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000004:00010000:1.0:1762166782.202829:0:5755:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000019bf9721 reply state 000000000a2535b8 transno 4294968867 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9b444 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000100:00100000:1.0:1762166782.202838:0:5755:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166782.202909:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+19:37055:x1847765444224384:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 350us (447us total) trans 4294968867 rc 0/0 00000100:00100000:1.0:1762166782.202916:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2395 00000100:00100000:3.0:1762166782.204325:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.204412:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444224512 00000100:00100000:0.0:1762166782.204419:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444224512 00000100:00100000:0.0:1762166782.204459:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 843 00000100:00100000:0.0:1762166782.204468:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:37055:x1847765444224512:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166782.204481:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166782.204495:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d800/0xf915a5bdf3c9b44b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f907a8 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.204520:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b38e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90793 expref: 9 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166782.204529:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166782.204531:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166782.204535:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d800/0xf915a5bdf3c9b44b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907a8 expref: 9 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.204567:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b38e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90793 expref: 9 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166782.204579:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b38e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90793 expref: 9 pid: 12400 timeout: 502 lvb_type: 1 00000100:00100000:0.0:1762166782.204593:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765451910016:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166782.204672:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166782.206159:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765451910016:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166782.206254:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d800/0xf915a5bdf3c9b44b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907a8 expref: 9 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.206287:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f27d800, rc 0) 00000100:00100000:3.0:1762166782.206343:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+9:37055:x1847765444224512:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1874us (2021us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166782.206351:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 843 00000100:00100000:1.0:1762166782.206373:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444224640 00000100:00100000:1.0:1762166782.206380:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444224640 00010000:00010000:1.0:1762166782.206406:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b38e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90793 expref: 9 pid: 12400 timeout: 502 lvb_type: 1 00000100:00100000:1.0:1762166782.206439:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 534 00000100:00100000:1.0:1762166782.206447:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+9:2361:x1847765444224640:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166782.206458:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166782.206475:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b38e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90793 expref: 9 pid: 12400 timeout: 502 lvb_type: 1 00010000:00010000:1.0:1762166782.206496:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b38e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90793 expref: 9 pid: 12400 timeout: 502 lvb_type: 1 00010000:00010000:1.0:1762166782.206513:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee348244400/0xf915a5bdf3c9b38e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90793 expref: 9 pid: 12400 timeout: 502 lvb_type: 1 00010000:00010000:1.0:1762166782.206524:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.206526:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.206530:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d800/0xf915a5bdf3c9b44b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907a8 expref: 8 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.206550:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d800/0xf915a5bdf3c9b44b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907a8 expref: 8 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.206577:0:5741:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d800/0xf915a5bdf3c9b44b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907a8 expref: 8 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166782.206588:0:5741:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5741:1847765451910144:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762166782.206640:0:5741:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e39dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166782.208113:0:5741:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5741:1847765451910144:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762166782.208124:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166782.208161:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:2361:x1847765444224640:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1714us (1831us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166782.208169:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 534 00000100:00100000:3.0:1762166782.208258:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444224768 00000100:00100000:3.0:1762166782.208264:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444224768 00000100:00100000:3.0:1762166782.208303:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 844 00000100:00100000:3.0:1762166782.208311:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+8:2360:x1847765444224768:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:3.0:1762166782.208492:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb size from disk: 10485760 -> 10485760 00002000:00010000:3.0:1762166782.208496:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb mtime from disk: 1762166781 -> 1762166781 00002000:00010000:3.0:1762166782.208498:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb atime from disk: 1762166781 -> 1762166781 00002000:00010000:3.0:1762166782.208501:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb ctime from disk: 1762166782 -> 1762166782 00002000:00010000:3.0:1762166782.208503:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb blocks from disk: 20487 -> 20487 00000100:00100000:3.0:1762166782.208534:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:22b95110-b0b2-4d2b-9402-7e0d82812a7e+9:2360:x1847765444224768:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 224us (482us total) trans 17179869367 rc 0/0 00000100:00100000:3.0:1762166782.208541:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 844 00000100:00100000:1.0:1762166782.210161:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444225024 00000100:00100000:1.0:1762166782.210175:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444225024 00000100:00100000:1.0:1762166782.210215:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 708 00000100:00100000:1.0:1762166782.210223:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:37055:x1847765444225024:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166782.210278:0:5758:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000402:0x17:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9b379 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9078c expref: 18 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.210310:0:5758:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b452 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166782.210323:0:5758:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b302 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90762 expref: 18 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.210330:0:5758:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b452 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166782.210356:0:5758:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b302 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90762 expref: 18 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.210379:0:5758:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b302 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90762 expref: 18 pid: 5755 timeout: 503 lvb_type: 0 00000100:00100000:1.0:1762166782.210392:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1847765451910272:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166782.210447:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e39d000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166782.211812:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1847765451910272:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166782.211829:0:5758:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b452 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00000100:00100000:1.0:1762166782.212325:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444225152 00000100:00100000:1.0:1762166782.212331:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444225152 00010000:00010000:1.0:1762166782.212362:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b302 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90762 expref: 19 pid: 5755 timeout: 503 lvb_type: 0 00000100:00100000:1.0:1762166782.212408:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 535 00000100:00100000:1.0:1762166782.212416:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+19:2360:x1847765444225152:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166782.212427:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166782.212434:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b302 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90762 expref: 19 pid: 5755 timeout: 503 lvb_type: 0 00010000:00010000:1.0:1762166782.212445:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b302 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90762 expref: 19 pid: 5755 timeout: 503 lvb_type: 0 00010000:00010000:1.0:1762166782.212461:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b302 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90762 expref: 19 pid: 5755 timeout: 503 lvb_type: 0 00010000:00010000:1.0:1762166782.212474:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee34c9faa00) 00010000:00010000:1.0:1762166782.212479:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b452 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166782.212486:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b452 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166782.212493:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b452 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166782.212516:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166782.212549:0:5758:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b452 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00000100:00100000:1.0:1762166782.212558:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:2360:x1847765444225152:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 140us (396us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166782.212562:0:5758:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b452 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00000100:00100000:1.0:1762166782.212570:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 535 00010000:00010000:3.0:1762166782.212586:0:5758:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b459 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5758 initiator: MDT0 00010000:00010000:3.0:1762166782.212599:0:5758:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453c00/0xf915a5bdf3c9b42f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9079a expref: 17 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.212614:0:5758:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b459 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 00010000:00010000:3.0:1762166782.212640:0:5758:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453c00/0xf915a5bdf3c9b42f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9079a expref: 17 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.212651:0:5758:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453c00/0xf915a5bdf3c9b42f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9079a expref: 17 pid: 5755 timeout: 503 lvb_type: 0 00000100:00100000:3.0:1762166782.212818:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1847765451910400:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166782.212874:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166782.214013:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1847765451910400:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166782.214030:0:5758:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b459 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00000100:00100000:0.0:1762166782.214406:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.214511:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444225280 00000100:00100000:1.0:1762166782.214544:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444225280 00010000:00010000:1.0:1762166782.214591:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453c00/0xf915a5bdf3c9b42f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9079a expref: 18 pid: 5755 timeout: 503 lvb_type: 0 00000100:00100000:1.0:1762166782.214646:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 536 00000100:00100000:1.0:1762166782.214660:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:2361:x1847765444225280:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166782.214678:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166782.214685:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453c00/0xf915a5bdf3c9b42f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9079a expref: 18 pid: 5755 timeout: 503 lvb_type: 0 00010000:00010000:1.0:1762166782.214697:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453c00/0xf915a5bdf3c9b42f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9079a expref: 18 pid: 5755 timeout: 503 lvb_type: 0 00010000:00010000:1.0:1762166782.214720:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453c00/0xf915a5bdf3c9b42f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9079a expref: 18 pid: 5755 timeout: 503 lvb_type: 0 00010000:00010000:1.0:1762166782.214742:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9ee34c9fa200) 00010000:00010000:1.0:1762166782.214748:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b459 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166782.214757:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b459 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166782.214833:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b459 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166782.214865:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166782.214951:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+17:2361:x1847765444225280:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 282us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166782.214962:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 536 00010000:00010000:0.0:1762166782.215005:0:5758:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b459 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166782.215033:0:5758:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c400/0xf915a5bdf3c9b459 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00000100:00100000:0.0:1762166782.215403:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451910528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166782.215451:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166782.215483:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166782.215507:0:11810:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451910528 00000100:00100000:3.0:1762166782.215523:0:11810:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451910528 00000100:00100000:3.0:1762166782.215569:0:11810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1762166782.215577:0:11810:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5758:x1847765451910528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166782.215652:0:11810:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5758:x1847765451910528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 75us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166782.215660:0:11810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1762166782.215866:0:5758:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836680 gen 2 00000004:00080000:0.0:1762166782.215872:0:5758:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836680 committed transno 21474836680 00000100:00100000:0.0:1762166782.215890:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451910528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166782.215927:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451910656:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166782.215965:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166782.215987:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166782.216018:0:5760:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451910656 00000100:00100000:1.0:1762166782.216023:0:5760:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451910656 00000100:00100000:1.0:1762166782.216055:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1762166782.216063:0:5760:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5758:x1847765451910656:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166782.216119:0:5760:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5758:x1847765451910656:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 58us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166782.216150:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451910656:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166782.216151:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1762166782.216187:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451910784:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166782.216210:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166782.216278:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166782.216316:0:5760:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451910784 00000100:00100000:1.0:1762166782.216321:0:5760:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451910784 00000100:00100000:1.0:1762166782.216352:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1762166782.216359:0:5760:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5758:x1847765451910784:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166782.216423:0:5760:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5758:x1847765451910784:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 64us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166782.216430:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1762166782.216997:0:5760:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451910912 00000100:00100000:1.0:1762166782.217004:0:5760:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451910912 00000100:00100000:1.0:1762166782.217039:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1762166782.217052:0:5760:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5758:x1847765451910912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166782.217213:0:5760:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5758:x1847765451910912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 166us (286us total) trans 21474836692 rc 0/0 00000100:00100000:1.0:1762166782.217221:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1762166782.221022:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.221228:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444225408 00000100:00100000:1.0:1762166782.221237:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444225408 00000100:00100000:1.0:1762166782.221292:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2396 00000100:00100000:1.0:1762166782.221303:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+18:37055:x1847765444225408:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166782.221324:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166782.221343:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453c00/0xf915a5bdf3c9b460 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f907af expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.221408:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453c00/0xf915a5bdf3c9b460 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907af expref: 19 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.221423:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453c00/0xf915a5bdf3c9b460 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907af expref: 19 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.221438:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee34c9faf00) 00010000:00010000:1.0:1762166782.221442:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166782.221445:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453c00, rc 0) 00000100:00100000:1.0:1762166782.221510:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b95110-b0b2-4d2b-9402-7e0d82812a7e+19:37055:x1847765444225408:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 209us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166782.221517:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2396 00000100:00100000:3.0:1762166782.223996:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.225927:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762166782.226529:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166782.226536:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80f800/0xf915a5bdf3c9b467 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166782.226545:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f80f800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166782.226558:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80f800/0xf915a5bdf3c9b467 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166782.226566:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80f800/0xf915a5bdf3c9b467 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166782.226578:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9ee360714900) 00010000:00010000:0.0:1762166782.226581:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166782.226586:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80f800/0xf915a5bdf3c9b467 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166782.226591:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80f800/0xf915a5bdf3c9b467 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166782.226607:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166782.226610:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166782.226614:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166782.240832:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.253915:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.258190:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.260740:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.260873:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444226688 00000100:00100000:1.0:1762166782.260888:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444226688 00010000:00010000:1.0:1762166782.260948:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80fa00/0xf915a5bdf3c9b483 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907b6 expref: 26 pid: 5755 timeout: 503 lvb_type: 0 00000100:00100000:1.0:1762166782.260994:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 537 00000100:00100000:1.0:1762166782.261005:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+26:2361:x1847765444226688:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166782.261027:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166782.261034:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80fa00/0xf915a5bdf3c9b483 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907b6 expref: 26 pid: 5755 timeout: 503 lvb_type: 0 00010000:00010000:1.0:1762166782.261044:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80fa00/0xf915a5bdf3c9b483 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907b6 expref: 26 pid: 5755 timeout: 503 lvb_type: 0 00010000:00010000:1.0:1762166782.261079:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80fa00/0xf915a5bdf3c9b483 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907b6 expref: 26 pid: 5755 timeout: 503 lvb_type: 0 00010000:00010000:1.0:1762166782.261094:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee34c9faf00) 00010000:00010000:1.0:1762166782.261097:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80fe00/0xf915a5bdf3c9b4a6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.261104:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80fe00/0xf915a5bdf3c9b4a6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.261109:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80fe00/0xf915a5bdf3c9b4a6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166782.261140:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166782.261210:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+25:2361:x1847765444226688:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 201us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166782.261231:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 537 00000100:00100000:0.0:1762166782.264059:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.264131:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444226816 00000100:00100000:3.0:1762166782.264148:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444226816 00000100:00100000:3.0:1762166782.264195:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 711 00000100:00100000:3.0:1762166782.264203:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+25:37059:x1847765444226816:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:3.0:1762166782.264322:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+25:37059:x1847765444226816:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 118us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166782.264330:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 711 00000100:00100000:1.0:1762166782.266424:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.266852:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444227072 00000100:00100000:3.0:1762166782.266861:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444227072 00000100:00100000:3.0:1762166782.266903:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 712 00000100:00100000:3.0:1762166782.266914:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+25:37059:x1847765444227072:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166782.267104:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+26:37059:x1847765444227072:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 192us (684us total) trans 4294968875 rc 0/0 00000100:00100000:3.0:1762166782.267111:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 712 00000100:00100000:0.0:1762166782.268484:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.270490:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.270545:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444227584 00000100:00100000:3.0:1762166782.270552:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444227584 00000100:00100000:3.0:1762166782.270592:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 713 00000100:00100000:3.0:1762166782.270601:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+26:37059:x1847765444227584:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:3.0:1762166782.270649:0:5759:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000402:0x17:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80ea00/0xf915a5bdf3c9b4bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907cb expref: 26 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.270675:0:5759:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b4c9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166782.270685:0:5759:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453c00/0xf915a5bdf3c9b460 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907af expref: 26 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.270693:0:5759:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b4c9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166782.270736:0:5759:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453c00/0xf915a5bdf3c9b460 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907af expref: 26 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.270748:0:5759:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453c00/0xf915a5bdf3c9b460 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907af expref: 26 pid: 5755 timeout: 503 lvb_type: 0 00000100:00100000:3.0:1762166782.270779:0:5759:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5759:1847765451911168:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166782.270850:0:5759:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157840 going to sleep for 11 seconds 00000100:00100000:1.0:1762166782.272434:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.272549:0:5759:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5759:1847765451911168:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166782.272568:0:5759:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b4c9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166782.273373:0:5759:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b4c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166782.273382:0:5759:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b4c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166782.273722:0:5759:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b4c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166782.273731:0:5759:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b4c9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166782.273737:0:5759:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b4c9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166782.273744:0:5759:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166782.273748:0:5759:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b4c9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166782.273787:0:5759:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b4c9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166782.273798:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee34c9faf00) 00010000:00010000:3.0:1762166782.273801:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166782.273805:0:5759:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b4c9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166782.273810:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b4c9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166782.273830:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee34c9faf00) 00010000:00010000:3.0:1762166782.273832:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166782.273838:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80ea00/0xf915a5bdf3c9b4bb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907cb expref: 25 pid: 5755 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166782.273989:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+25:37059:x1847765444227584:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 3388us (3502us total) trans 4294968877 rc -22/-22 00000100:00100000:3.0:1762166782.273996:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 713 00000100:00100000:1.0:1762166782.281840:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.281911:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444227840 00000100:00100000:0.0:1762166782.281921:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444227840 00000100:00100000:0.0:1762166782.281994:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2401 00000100:00100000:0.0:1762166782.282006:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+25:37059:x1847765444227840:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166782.282125:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166782.282147:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d200/0xf915a5bdf3c9b4d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f907d2 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.282203:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d200/0xf915a5bdf3c9b4d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907d2 expref: 26 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.282231:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d200/0xf915a5bdf3c9b4d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907d2 expref: 26 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.282959:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee36062b900) 00010000:00010000:0.0:1762166782.282964:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166782.282968:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f27d200, rc 0) 00000100:00100000:0.0:1762166782.283030:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+26:37059:x1847765444227840:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1025us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166782.283039:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2401 00000100:00100000:0.0:1762166782.286253:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.286790:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444228096 00000100:00100000:1.0:1762166782.286799:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444228096 00000100:00100000:1.0:1762166782.286857:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2402 00000100:00100000:1.0:1762166782.286867:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+26:37059:x1847765444228096:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166782.286885:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166782.286903:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b4d7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f907d9 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.287383:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b4de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.287410:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b4de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.287420:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b4de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:1.0:1762166782.287431:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1a:0x0]: returning size 0 00010000:00010000:1.0:1762166782.287476:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b4d7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907d9 expref: 29 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.287493:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b4de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907d9 expref: 28 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.287501:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9ee34c9fa000) 00010000:00010000:1.0:1762166782.287503:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166782.287507:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453a00, rc 0) 00000100:00100000:1.0:1762166782.287573:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+28:37059:x1847765444228096:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 707us (1327us total) trans 4294968878 rc 0/0 00000100:00100000:1.0:1762166782.287580:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2402 00000100:00100000:1.0:1762166782.290425:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444228352 00000100:00100000:1.0:1762166782.290434:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444228352 00000100:00100000:1.0:1762166782.290485:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2403 00000100:00100000:1.0:1762166782.290494:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+28:37059:x1847765444228352:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166782.290515:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166782.290533:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b4ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f907e0 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.290628:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b4f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.290647:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b4f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.290657:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b4f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:1.0:1762166782.290669:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 10485760 00010000:00010000:1.0:1762166782.290809:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b4ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x17:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907e0 expref: 31 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.290826:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b4f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907e0 expref: 30 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.290834:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee36062b900) 00010000:00010000:1.0:1762166782.290836:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166782.290839:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453400, rc 0) 00000100:00100000:1.0:1762166782.290900:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+30:37059:x1847765444228352:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 407us (590us total) trans 4294968879 rc 0/0 00000100:00100000:1.0:1762166782.290910:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2403 00000100:00100000:3.0:1762166782.292414:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.294319:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166782.296222:0:5759:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80f400/0xf915a5bdf3c9b501 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.296233:0:5759:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80f400/0xf915a5bdf3c9b501 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.296257:0:5759:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b508 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.296269:0:5759:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b4de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907d9 expref: 29 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.296287:0:5759:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b508 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.296315:0:5759:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b4de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907d9 expref: 29 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.296326:0:5759:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b4de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907d9 expref: 29 pid: 6558 timeout: 503 lvb_type: 0 00000100:00100000:1.0:1762166782.296338:0:5759:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5759:1847765451911424:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166782.296954:0:5759:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e39dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166782.298540:0:5759:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5759:1847765451911424:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166782.298560:0:5759:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b508 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00000100:00100000:0.0:1762166782.298983:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166782.299379:0:5759:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b508 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.299389:0:5759:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b508 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00000100:00100000:1.0:1762166782.300001:0:5759:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5759:1847765451911552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166782.300052:0:5759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166782.300091:0:5759:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e39dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166782.300136:0:5760:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451911552 00000100:00100000:3.0:1762166782.300143:0:5760:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451911552 00000100:00100000:3.0:1762166782.300187:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1762166782.300195:0:5760:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5759:x1847765451911552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166782.300300:0:5760:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5759:x1847765451911552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 106us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166782.300308:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1762166782.300598:0:5759:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5759:1847765451911552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166782.300639:0:5759:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5759:1847765451911680:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166782.300663:0:5759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166782.300696:0:5759:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee346b14e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166782.300748:0:11810:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451911680 00000100:00100000:0.0:1762166782.300752:0:11810:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451911680 00000100:00100000:0.0:1762166782.300811:0:11810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1762166782.300820:0:11810:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5759:x1847765451911680:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166782.300872:0:11810:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5759:x1847765451911680:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 54us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166782.300879:0:11810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1762166782.300962:0:5759:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5759:1847765451911680:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1762166782.301009:0:5759:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968880 00000001:00080000:1.0:1762166782.301095:0:5759:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968881 00010000:00010000:1.0:1762166782.301121:0:5759:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b508 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.301131:0:5759:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b508 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.301139:0:5759:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b508 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.301145:0:5759:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166782.301150:0:5759:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b508 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.301158:0:5759:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b508 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.301173:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9ee34c9fa000) 00010000:00010000:1.0:1762166782.301176:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166782.301181:0:5759:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b508 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.301187:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b508 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.301211:0:5759:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80f400/0xf915a5bdf3c9b501 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.301217:0:5759:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80f400/0xf915a5bdf3c9b501 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.301233:0:5759:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80f400/0xf915a5bdf3c9b501 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.301238:0:5759:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f80f400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166782.301241:0:5759:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80f400/0xf915a5bdf3c9b501 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.301247:0:5759:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80f400/0xf915a5bdf3c9b501 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.301254:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee36062b900) 00010000:00010000:1.0:1762166782.301257:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166782.301260:0:5759:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80f400/0xf915a5bdf3c9b501 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.301265:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80f400/0xf915a5bdf3c9b501 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.301277:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee36062b900) 00010000:00010000:1.0:1762166782.301280:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166782.301286:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b4f3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907e0 expref: 31 pid: 6558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166782.301391:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3719fac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+30:37059:x1847765444228608:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 8815us (8978us total) trans 4294968882 rc 0/0 00000100:00100000:1.0:1762166782.301400:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 714 00000020:00080000:1.0:1762166782.301404:0:5759:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166782.303014:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.303110:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444228992 00000100:00100000:1.0:1762166782.303119:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444228992 00000100:00100000:1.0:1762166782.303176:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2404 00000100:00100000:1.0:1762166782.303186:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+30:37059:x1847765444228992:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166782.303221:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166782.303254:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b50f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f907e7 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.303314:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b50f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907e7 expref: 31 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.303325:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b50f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907e7 expref: 31 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.303338:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee34c9fa300) 00010000:00010000:1.0:1762166782.303341:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166782.303343:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453000, rc 0) 00000100:00100000:1.0:1762166782.303390:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+31:37059:x1847765444228992:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 207us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166782.303395:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2404 00000100:00100000:3.0:1762166782.306306:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.306411:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444229248 00000100:00100000:1.0:1762166782.306421:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444229248 00000100:00100000:1.0:1762166782.306493:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 715 00000100:00100000:1.0:1762166782.306505:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+31:37059:x1847765444229248:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:1.0:1762166782.307117:0:5759:0:(mdd_object.c:3965:mdd_close()) Object [0x200000402:0x1a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1762166782.307280:0:5759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].103, 64 off16536 00000004:00080000:1.0:1762166782.307294:0:5759:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 403099530690ns, next at 404099528306ns, rc = 0 00000001:00080000:1.0:1762166782.307303:0:5759:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968883 00010000:00010000:1.0:1762166782.307359:0:5759:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b516 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.307376:0:5759:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b516 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.307405:0:5759:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b516 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.307414:0:5759:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b516 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.307420:0:5759:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b516 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.307425:0:5759:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b516 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5759 initiator: MDT0 00010000:00010000:1.0:1762166782.307455:0:5759:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1762166782.307607:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+33:37059:x1847765444229248:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 1102us (1308us total) trans 4294968884 rc 0/0 00000100:00100000:1.0:1762166782.307617:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 715 00000020:00080000:1.0:1762166782.307625:0:5759:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762166782.307629:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166782.307640:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b516 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166782.307651:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166782.307656:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b516 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166782.307665:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b516 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166782.307682:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9ee34c9fa600) 00010000:00010000:3.0:1762166782.307685:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166782.307691:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b516 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166782.307696:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b516 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166782.307719:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166782.307721:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166782.307723:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166782.311648:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.312618:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444229504 00000100:00100000:1.0:1762166782.312637:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444229504 00000100:00100000:1.0:1762166782.312717:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 716 00000100:00100000:1.0:1762166782.312734:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+33:37059:x1847765444229504:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166782.313156:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+34:37059:x1847765444229504:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 425us (1513us total) trans 4294968885 rc 0/0 00000100:00100000:1.0:1762166782.313167:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 716 00000100:00100000:0.0:1762166782.320816:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.320893:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444229632 00000100:00100000:1.0:1762166782.320911:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444229632 00000100:00100000:1.0:1762166782.321014:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2405 00000100:00100000:1.0:1762166782.321027:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+34:37060:x1847765444229632:12345-192.168.203.35@tcp:101:stat.0 00010000:00010000:1.0:1762166782.321080:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166782.321108:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b51d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f907ee expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.321189:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b524 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321207:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b524 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321220:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b524 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321248:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9b52b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321256:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9b52b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321263:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9b52b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321404:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b532 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321413:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b532 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321432:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b532 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:1.0:1762166782.321479:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 10485760 00000004:00200000:1.0:1762166782.321484:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166782.321510:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b532 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321529:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b532 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321539:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b524 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321545:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b524 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321552:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b524 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321558:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166782.321562:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b524 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321570:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b524 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321583:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9ee343a13500) 00010000:00010000:1.0:1762166782.321586:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166782.321593:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b524 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321597:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b524 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321613:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9b52b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321617:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9b52b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321622:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9b52b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321633:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166782.321637:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9b52b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321642:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9b52b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321650:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x3d8b1ba3 (ffff9ee34c9fa000) 00010000:00010000:1.0:1762166782.321652:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166782.321654:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9b52b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321659:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9b52b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166782.321695:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b51d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907ee expref: 36 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.321707:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b532 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907ee expref: 35 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.321714:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee34c9fa300) 00010000:00010000:1.0:1762166782.321717:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166782.321719:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452e00, rc 0) 00000100:00100000:1.0:1762166782.321856:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+35:37060:x1847765444229632:12345-192.168.203.35@tcp:101:stat.0 Request processed in 832us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166782.321865:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2405 00000100:00100000:1.0:1762166782.324207:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.324277:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444229760 00000100:00100000:3.0:1762166782.324291:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444229760 00000100:00100000:3.0:1762166782.324351:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 845 00000100:00100000:3.0:1762166782.324361:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:22b95110-b0b2-4d2b-9402-7e0d82812a7e+9:2360:x1847765444229760:12345-192.168.203.35@tcp:101:stat.0 00010000:00010000:3.0:1762166782.324376:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166782.324391:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b539 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f907f5 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166782.324442:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451911808:192.168.203.35@tcp:106: 00000100:00100000:3.0:1762166782.324528:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166782.325703:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451911808:192.168.203.35@tcp:106: 00010000:00010000:3.0:1762166782.325729:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b539 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907f5 expref: 10 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166782.325748:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b539 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907f5 expref: 10 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166782.325805:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105de00, rc 0) 00000100:00100000:1.0:1762166782.325996:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:22b95110-b0b2-4d2b-9402-7e0d82812a7e+9:2360:x1847765444229760:12345-192.168.203.35@tcp:101:stat.0 Request processed in 1627us (1790us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166782.326021:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 845 00000100:00100000:0.0:1762166782.653620:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.653968:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444230016 00000100:00100000:1.0:1762166782.653978:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444230016 00000100:00100000:1.0:1762166782.654050:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 717 00000100:00100000:1.0:1762166782.654060:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+35:37078:x1847765444230016:12345-192.168.203.35@tcp:35:umount.0 00000100:00100000:1.0:1762166782.654505:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+36:37078:x1847765444230016:12345-192.168.203.35@tcp:35:umount.0 Request processed in 441us (888us total) trans 4294968886 rc 0/0 00000100:00100000:1.0:1762166782.654513:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 717 00000100:00100000:3.0:1762166782.656005:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.656129:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444230272 00000100:00100000:1.0:1762166782.656136:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444230272 00000100:00100000:1.0:1762166782.656180:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 718 00000100:00100000:1.0:1762166782.656189:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+36:37078:x1847765444230272:12345-192.168.203.35@tcp:35:umount.0 00000100:00100000:1.0:1762166782.656486:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b95110-b0b2-4d2b-9402-7e0d82812a7e+37:37078:x1847765444230272:12345-192.168.203.35@tcp:35:umount.0 Request processed in 298us (485us total) trans 4294968887 rc 0/0 00000100:00100000:1.0:1762166782.656494:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 718 00000100:00100000:0.0:1762166782.659131:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.659171:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.659200:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.659243:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444230400 00000100:00100000:1.0:1762166782.659253:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444230400 00000100:00100000:3.0:1762166782.659280:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444230528 00000100:00100000:3.0:1762166782.659285:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444230528 00000100:00100000:1.0:1762166782.659314:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 261 00000100:00100000:1.0:1762166782.659329:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4640a11a-daef-4792-afea-61fb0f0c55bf+11:2361:x1847765444230400:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166782.659338:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 263 00010000:00010000:1.0:1762166782.659347:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166782.659353:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4640a11a-daef-4792-afea-61fb0f0c55bf+11:2361:x1847765444230528:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166782.659364:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166782.659370:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee37f7c8400/0xf915a5bdf3c999cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f900a1 expref: 11 pid: 5749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.659379:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee37f7c9600/0xf915a5bdf3c999d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f900cb expref: 11 pid: 5749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.659401:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166782.659402:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166782.659448:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4640a11a-daef-4792-afea-61fb0f0c55bf+8:2361:x1847765444230400:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 125us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166782.659475:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 261 00000100:00100000:3.0:1762166782.659594:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4640a11a-daef-4792-afea-61fb0f0c55bf+7:2361:x1847765444230528:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 246us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166782.659602:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 263 00000100:00100000:0.0:1762166782.668571:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.668654:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444231040 00000100:00100000:1.0:1762166782.668665:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444231040 00000100:00100000:1.0:1762166782.668725:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 846 00000100:00100000:1.0:1762166782.668736:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:22b95110-b0b2-4d2b-9402-7e0d82812a7e+9:2357:x1847765444231040:12345-192.168.203.35@tcp:9:umount.0 00000020:00000080:1.0:1762166782.668783:0:26444:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c999ef 00000020:00010000:1.0:1762166782.668790:0:26444:0:(genops.c:1938:obd_stale_export_put()) Put export ffff9ee243bc5000: total 0 00000100:00080000:1.0:1762166782.668794:0:26444:0:(import.c:65:import_set_state_nolock()) ffff9ee243bc2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1762166782.668858:0:26444:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869367 00000100:00100000:1.0:1762166782.669118:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:22b95110-b0b2-4d2b-9402-7e0d82812a7e+4:2357:x1847765444231040:12345-192.168.203.35@tcp:9:umount.0 Request processed in 383us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166782.669126:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 846 00000100:00100000:0.0:1762166782.677196:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.677268:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444231552 00000100:00100000:1.0:1762166782.677277:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444231552 00000100:00100000:1.0:1762166782.677332:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 847 00000100:00100000:1.0:1762166782.677343:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:22b95110-b0b2-4d2b-9402-7e0d82812a7e+9:2357:x1847765444231552:12345-192.168.203.35@tcp:9:umount.0 00000020:00000080:1.0:1762166782.677373:0:26444:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c999e8 00000020:00010000:1.0:1762166782.677379:0:26444:0:(genops.c:1938:obd_stale_export_put()) Put export ffff9ee243bc6000: total 0 00000100:00080000:1.0:1762166782.677389:0:26444:0:(import.c:65:import_set_state_nolock()) ffff9ee243bc4800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1762166782.677434:0:26444:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836692 00000100:00100000:1.0:1762166782.677679:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:22b95110-b0b2-4d2b-9402-7e0d82812a7e+7:2357:x1847765444231552:12345-192.168.203.35@tcp:9:umount.0 Request processed in 336us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166782.677688:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 847 00000020:00010000:3.0:1762166782.677754:0:5744:0:(genops.c:1924:obd_stale_export_get()) Get export ffff9ee243bc6000: total 0 00010000:00010000:3.0:1762166782.677828:0:5744:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff9ee243bc6000, canceled 0 locks, left on hash table 3. 00002000:00010000:3.0:1762166782.677855:0:5744:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x4b:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1762166782.677930:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37ffc5000/0xf915a5bdf3c9afcf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90690 expref: 6 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166782.677995:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b436 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907a1 expref: 5 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166782.678023:0:5744:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x4c:0x0] updating lvb blocks from disk: 1 -> 20487 00010000:00010000:3.0:1762166782.678031:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b2ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9075b expref: 4 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.678046:0:5744:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff9ee243bc6000, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1762166782.678059:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166782.678061:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166782.678063:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166782.682456:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.682551:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444232448 00000100:00100000:1.0:1762166782.682561:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444232448 00000100:00100000:1.0:1762166782.682619:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2406 00000100:00100000:1.0:1762166782.682630:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+37:2357:x1847765444232448:12345-192.168.203.35@tcp:39:umount.0 00000020:00000080:1.0:1762166782.682672:0:6558:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c999e1 00000020:00010000:1.0:1762166782.682679:0:6558:0:(genops.c:1938:obd_stale_export_put()) Put export ffff9ee37f4c2800: total 0 00000100:00080000:1.0:1762166782.682683:0:6558:0:(import.c:65:import_set_state_nolock()) ffff9ee37f4c1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1762166782.682712:0:6558:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294968887 00000100:00100000:1.0:1762166782.683081:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b95110-b0b2-4d2b-9402-7e0d82812a7e+36:2357:x1847765444232448:12345-192.168.203.35@tcp:39:umount.0 Request processed in 454us (635us total) trans 4294968888 rc 0/0 00000100:00100000:1.0:1762166782.683089:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2406 00000020:00010000:3.0:1762166782.683164:0:5743:0:(genops.c:1924:obd_stale_export_get()) Get export ffff9ee37f4c2800: total 0 00010000:00010000:3.0:1762166782.683168:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166782.683206:0:5743:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff9ee37f4c2800, canceled 0 locks, left on hash table 10. 00010000:00010000:3.0:1762166782.683234:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13b00) 00010000:00010000:3.0:1762166782.683237:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166782.683245:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b15e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906f2 expref: 35 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.683281:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee34c9fa300) 00010000:00010000:3.0:1762166782.683283:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166782.683288:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b532 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907ee expref: 34 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.683301:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:3.0:1762166782.683303:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166782.683314:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b085 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906c1 expref: 33 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.683332:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:3.0:1762166782.683335:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1762166782.683339:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348244200/0xf915a5bdf3c9ad3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f905d3 expref: 32 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.683350:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:3.0:1762166782.683352:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166782.683355:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc5600/0xf915a5bdf3c9aefd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x11:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9065f expref: 31 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.683368:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:3.0:1762166782.683371:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166782.683374:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37ffc4e00/0xf915a5bdf3c9b0f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906dd expref: 30 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.683385:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee34c9fa300) 00010000:00010000:3.0:1762166782.683387:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166782.683390:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b50f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x17:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f907e7 expref: 29 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.683404:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9ee343a13500) 00010000:00010000:3.0:1762166782.683406:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1762166782.683409:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b17a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f906f9 expref: 28 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.683431:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166782.683434:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166782.683443:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348245c00/0xf915a5bdf3c9ab99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9055c expref: 27 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.683455:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166782.683458:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1762166782.683461:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105ca00/0xf915a5bdf3c9aa34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f904ec expref: 26 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.683476:0:5743:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff9ee37f4c2800, canceled 10 locks, left on hash table 0. 00010000:00010000:3.0:1762166782.683487:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166782.683489:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166782.683491:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166782.695381:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000020:00010000:0.0:1762166782.696205:0:6548:0:(genops.c:1924:obd_stale_export_get()) Get export ffff9ee36e642800: total 0 00010000:00010000:0.0:1762166782.696252:0:6548:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff9ee36e642800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1762166782.696282:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee37fad5800/0xf915a5bdf3c999c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9009a expref: 3 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.696299:0:6548:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff9ee36e642800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1762166782.696311:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166782.696315:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166782.696319:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1762166782.696399:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee36e642800/4640a11a-daef-4792-afea-61fb0f0c55bf for MGS 00000020:00000080:0.0:1762166782.696441:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee37f2a6800 for MGS 00000100:00100000:0.0:1762166782.772477:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.778815:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.783638:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.788416:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.792289:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.794358:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.794398:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444233472 00000100:00100000:3.0:1762166782.794404:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444233472 00000100:00100000:3.0:1762166782.794436:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 466 00000100:00100000:3.0:1762166782.794442:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8c6f7ba-e013-470a-a501-8ea6afe8566b+7:37089:x1847765444233472:12345-192.168.203.35@tcp:503:mount.lustre.0 00000100:00100000:3.0:1762166782.794785:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8c6f7ba-e013-470a-a501-8ea6afe8566b+7:37089:x1847765444233472:12345-192.168.203.35@tcp:503:mount.lustre.0 Request processed in 320us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166782.794794:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 466 00000100:00100000:0.0:1762166782.796282:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.796481:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444233600 00000100:00100000:3.0:1762166782.796487:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444233600 00000100:00100000:3.0:1762166782.796522:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 467 00000100:00100000:3.0:1762166782.796531:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8c6f7ba-e013-470a-a501-8ea6afe8566b+7:37107:x1847765444233600:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1762166782.796817:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8c6f7ba-e013-470a-a501-8ea6afe8566b+7:37107:x1847765444233600:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 286us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166782.796825:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 467 00000100:00100000:0.0:1762166782.809523:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.809633:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444233728 00000100:00100000:3.0:1762166782.809643:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444233728 00000100:00100000:3.0:1762166782.809742:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 468 00000100:00100000:3.0:1762166782.809753:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8c6f7ba-e013-470a-a501-8ea6afe8566b+7:37107:x1847765444233728:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1762166782.810051:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8c6f7ba-e013-470a-a501-8ea6afe8566b+7:37107:x1847765444233728:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 299us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166782.810059:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 468 00000100:00100000:0.0:1762166782.812024:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.812229:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444233856 00000100:00100000:3.0:1762166782.812247:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444233856 00000100:00100000:3.0:1762166782.812292:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 469 00000100:00100000:3.0:1762166782.812301:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cb46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8c6f7ba-e013-470a-a501-8ea6afe8566b+7:37089:x1847765444233856:12345-192.168.203.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1762166782.812313:0:5751:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166782.812329:0:5751:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee37105ca00/0xf915a5bdf3c9b555 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9083b expref: -99 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.812355:0:5751:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee37105ca00/0xf915a5bdf3c9b555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9083b expref: 8 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.812365:0:5751:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee37105ca00/0xf915a5bdf3c9b555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9083b expref: 8 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.812373:0:5751:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105ca00, rc 0) 00000100:00100000:3.0:1762166782.812419:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cb46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8c6f7ba-e013-470a-a501-8ea6afe8566b+8:37089:x1847765444233856:12345-192.168.203.35@tcp:101:mount.lustre.0 Request processed in 119us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166782.812426:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 469 00000100:00100000:0.0:1762166782.817208:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.825868:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.828967:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.831673:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.838269:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.838443:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444234496 00000100:00100000:3.0:1762166782.838452:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444234496 00000100:00100000:3.0:1762166782.838510:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 474 00000100:00100000:3.0:1762166782.838530:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cb44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8c6f7ba-e013-470a-a501-8ea6afe8566b+9:37116:x1847765444234496:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1762166782.838805:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cb44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8c6f7ba-e013-470a-a501-8ea6afe8566b+9:37116:x1847765444234496:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 274us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166782.838813:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 474 00000100:00100000:0.0:1762166782.843984:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.845916:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.852966:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.853026:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.853093:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444235008 00000100:00100000:1.0:1762166782.853099:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444235008 00000100:00100000:1.0:1762166782.853161:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2408 00000100:00100000:1.0:1762166782.853172:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+7:37089:x1847765444235008:12345-192.168.203.35@tcp:41:mount.lustre.0 00000004:00000024:1.0:1762166782.853215:0:6558:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2260205568 avail 2258108416 00000100:00100000:1.0:1762166782.853314:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+7:37089:x1847765444235008:12345-192.168.203.35@tcp:41:mount.lustre.0 Request processed in 144us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166782.853322:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2408 00000100:00080000:3.0:1762166782.853647:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762166782.855248:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.861258:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.862411:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444235520 00000100:00100000:1.0:1762166782.862424:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444235520 00000100:00100000:1.0:1762166782.862478:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 719 00000100:00100000:1.0:1762166782.862489:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+6:37089:x1847765444235520:12345-192.168.203.35@tcp:33:mount.lustre.0 00000100:00100000:0.0:1762166782.862545:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.862584:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166782.862616:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444235264 00000100:00100000:0.0:1762166782.862618:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444235392 00000100:00100000:3.0:1762166782.862622:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444235264 00000100:00100000:0.0:1762166782.862624:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444235392 00000100:00100000:3.0:1762166782.862662:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 848 00000100:00100000:0.0:1762166782.862672:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 849 00000100:00100000:3.0:1762166782.862674:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2357:x1847765444235264:12345-192.168.203.35@tcp:8:mount.lustre.0 00000100:00100000:0.0:1762166782.862682:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2357:x1847765444235392:12345-192.168.203.35@tcp:8:mount.lustre.0 00010000:00080000:3.0:1762166782.862703:0:26444:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0000: connection from a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp t0 exp 0000000000000000 cur 403 last 0 00010000:00080000:0.0:1762166782.862711:0:12400:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0001: connection from a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp t0 exp 0000000000000000 cur 403 last 0 00000020:00000080:3.0:1762166782.862742:0:26444:0:(genops.c:1402:class_connect()) connect: client a8dc1ab7-d2d2-4e76-ade8-41da4d39281c, cookie 0xf915a5bdf3c9b56a 00000020:00000080:0.0:1762166782.862742:0:12400:0:(genops.c:1402:class_connect()) connect: client a8dc1ab7-d2d2-4e76-ade8-41da4d39281c, cookie 0xf915a5bdf3c9b571 00002000:00100000:0.0:1762166782.862753:0:12400:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0001: cli a8dc1ab7-d2d2-4e76-ade8-41da4d39281c/ffff9ee36e642800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1762166782.862757:0:26444:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0000: cli a8dc1ab7-d2d2-4e76-ade8-41da4d39281c/ffff9ee34a537000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000004:00200000:1.0:1762166782.862782:0:5759:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00002000:00100000:0.0:1762166782.862782:0:12400:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:3.0:1762166782.862789:0:26444:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1762166782.862870:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+6:37089:x1847765444235520:12345-192.168.203.35@tcp:33:mount.lustre.0 Request processed in 383us (1621us total) trans 0 rc 0/0 00000020:01000000:3.0:1762166782.862874:0:26444:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee247a17800 00000100:00100000:1.0:1762166782.862881:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 719 00002000:00080000:3.0:1762166782.862886:0:26444:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1762166782.862916:0:26444:0:(import.c:65:import_set_state_nolock()) ffff9ee34a530800 : changing import state from RECOVER to FULL 00000020:01000000:0.0:1762166782.862954:0:12400:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee36f323700 00000100:00100000:3.0:1762166782.862962:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+6:2357:x1847765444235264:12345-192.168.203.35@tcp:8:mount.lustre.0 Request processed in 291us (415us total) trans 0 rc 0/0 00002000:00080000:0.0:1762166782.862962:0:12400:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1762166782.862972:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 848 00000100:00080000:0.0:1762166782.862982:0:12400:0:(import.c:65:import_set_state_nolock()) ffff9ee36e647000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1762166782.863012:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+6:2357:x1847765444235392:12345-192.168.203.35@tcp:8:mount.lustre.0 Request processed in 330us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166782.863020:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 849 00000100:00100000:0.0:1762166782.933610:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166782.937408:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.942887:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166782.945887:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00080000:3.0:1762166782.946108:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166783.145046:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451911936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166783.145127:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166783.145172:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451911936 00000100:00100000:1.0:1762166783.145182:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451911936 00000100:00100000:1.0:1762166783.145264:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1762166783.145275:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765451911936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1762166783.145298:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3857711104 avail 3845128192 00000100:00100000:1.0:1762166783.145358:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765451911936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166783.145366:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1762166783.145392:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166783.145471:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451911936:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1762166783.335921:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166783.656143:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451912064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166783.656214:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166783.656335:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451912064 00000100:00100000:1.0:1762166783.656343:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451912064 00000100:00080000:3.0:1762166783.656395:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166783.656411:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1762166783.656420:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765451912064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1762166783.656457:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3835691008 avail 3833593856 00000100:00100000:1.0:1762166783.656516:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765451912064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166783.656524:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1762166783.656614:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451912064:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1762166784.359950:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166784.714531:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166784.714672:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444236288 00000100:00100000:1.0:1762166784.714683:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444236288 00000100:00080000:0.0:1762166784.714730:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166784.714757:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2414 00000100:00100000:1.0:1762166784.714846:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+9:37550:x1847765444236288:12345-192.168.203.35@tcp:36:rm.0 00010000:00010000:1.0:1762166784.714901:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166784.714943:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80e400/0xf915a5bdf3c9b5b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9087a expref: 9 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.714969:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee360714600) 00010000:00010000:1.0:1762166784.714983:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166784.715006:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b5c5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.715029:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b5c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.715040:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b5c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.715055:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9b5cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.715060:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9b5cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.715064:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9b5cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.715215:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b5d3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.715223:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b5d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.715230:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b5d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000040:00080000:1.0:1762166784.716377:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].103, 64 off16624 00000004:00080000:1.0:1762166784.716398:0:6558:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 405508634564ns, next at 406508629024ns, rc = 0 00000040:00080000:1.0:1762166784.716446:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].104, 64 off16688 00010000:00010000:1.0:1762166784.716566:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9b5da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.716578:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9b5da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.716589:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9b5da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.716606:0:6558:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9b5da lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.716612:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9b5da lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.716618:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9b5da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.716643:0:6558:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166784.716664:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b5d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.716671:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b5d3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166784.716677:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166784.716678:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b5d3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.716685:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166784.716690:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b5d3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.716701:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b5d3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166784.716705:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9b5da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166784.716716:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166784.716717:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee34c9fa400) 00010000:00010000:1.0:1762166784.716722:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1762166784.716728:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b5d3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166784.716729:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9b5da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.716744:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9b5d3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166784.716748:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9b5da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166784.716800:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9ee34c9fa400) 00010000:00010000:0.0:1762166784.716805:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166784.716809:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9b5da lrc: 1/0,0 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166784.716817:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9b5da lrc: 0/0,0 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166784.716851:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166784.716855:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166784.716858:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166784.716885:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b5c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.716893:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b5c5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.716899:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b5c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.716906:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166784.716910:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b5c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.716916:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b5c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.716938:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9ee360714d00) 00010000:00010000:1.0:1762166784.716942:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.716945:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b5c5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.716950:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9b5c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000004:00010000:1.0:1762166784.716962:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bb8cb72c reply state 00000000ada0fa88 transno 4294968889 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9b5cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:1.0:1762166784.716971:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166784.717089:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+10:37550:x1847765444236288:12345-192.168.203.35@tcp:36:rm.0 Request processed in 2242us (2559us total) trans 4294968889 rc 0/0 00000100:00100000:1.0:1762166784.717104:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2414 00010000:00010000:1.0:1762166784.718140:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9b5cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.718159:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9b5cc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.718166:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9b5cc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.718171:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166784.718175:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9b5cc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.718182:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9b5cc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.718195:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x3d8b1ba3 (ffff9ee34c9fad00) 00010000:00010000:1.0:1762166784.718198:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.718202:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9b5cc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166784.718208:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9b5cc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000001:02000400:3.0:1762166785.301660:0:29182:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 44e: basic FLR SOM tests + disable SOM ========================================================== 05:46:25 (1762166785) 00000100:00100000:0.0:1762166785.341448:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.341509:0:5764:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444236416 00000100:00100000:1.0:1762166785.341519:0:5764:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444236416 00000100:00100000:1.0:1762166785.341571:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2 00000100:00100000:1.0:1762166785.341584:0:5764:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+9:37700:x1847765444236416:12345-192.168.203.35@tcp:700:mkdir.0 00000100:00100000:1.0:1762166785.341679:0:5764:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+9:37700:x1847765444236416:12345-192.168.203.35@tcp:700:mkdir.0 Request processed in 97us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166785.341687:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2 00000100:00100000:1.0:1762166785.342861:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.342901:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444236672 00000100:00100000:0.0:1762166785.342907:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444236672 00000100:00100000:0.0:1762166785.342973:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2415 00000100:00100000:0.0:1762166785.342983:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+9:37700:x1847765444236672:12345-192.168.203.35@tcp:36:mkdir.0 00010000:00010000:0.0:1762166785.343028:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166785.343050:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80e000/0xf915a5bdf3c9b57f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9086c expref: 9 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.343062:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:0.0:1762166785.343070:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166785.343162:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c400/0xf915a5bdf3c9b5e1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.343174:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c400/0xf915a5bdf3c9b5e1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.343184:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c400/0xf915a5bdf3c9b5e1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.343196:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27cc00/0xf915a5bdf3c9b5e8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.343203:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27cc00/0xf915a5bdf3c9b5e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.343209:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27cc00/0xf915a5bdf3c9b5e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:0.0:1762166785.343953:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 512 00010000:00010000:0.0:1762166785.343963:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c400/0xf915a5bdf3c9b5e1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.343971:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c400/0xf915a5bdf3c9b5e1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.343977:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c400/0xf915a5bdf3c9b5e1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.343983:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f27c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166785.343986:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c400/0xf915a5bdf3c9b5e1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.343992:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c400/0xf915a5bdf3c9b5e1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.344003:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee36062bd00) 00010000:00010000:0.0:1762166785.344012:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166785.344015:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c400/0xf915a5bdf3c9b5e1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.344021:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c400/0xf915a5bdf3c9b5e1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000004:00010000:0.0:1762166785.344040:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006f6767b4 reply state 00000000922eee99 transno 4294968890 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27cc00/0xf915a5bdf3c9b5e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166785.344047:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166785.344117:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+10:37700:x1847765444236672:12345-192.168.203.35@tcp:36:mkdir.0 Request processed in 1135us (1260us total) trans 4294968890 rc 0/0 00000100:00100000:0.0:1762166785.344125:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2415 00010000:00010000:0.0:1762166785.345011:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27cc00/0xf915a5bdf3c9b5e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.345022:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27cc00/0xf915a5bdf3c9b5e8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.345028:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27cc00/0xf915a5bdf3c9b5e8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.345034:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f27cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166785.345038:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27cc00/0xf915a5bdf3c9b5e8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.345045:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27cc00/0xf915a5bdf3c9b5e8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.345057:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1ec0156 (ffff9ee36062bc00) 00010000:00010000:0.0:1762166785.345060:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166785.345064:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27cc00/0xf915a5bdf3c9b5e8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.345075:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27cc00/0xf915a5bdf3c9b5e8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166785.366837:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.366871:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444236800 00000100:00100000:0.0:1762166785.366881:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444236800 00000100:00100000:0.0:1762166785.366947:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2416 00000100:00100000:0.0:1762166785.366959:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+9:37708:x1847765444236800:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166785.366981:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166785.367002:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27cc00/0xf915a5bdf3c9b5ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90888 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.367061:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c400/0xf915a5bdf3c9b5f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.367073:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c400/0xf915a5bdf3c9b5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.367085:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c400/0xf915a5bdf3c9b5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:0.0:1762166785.367138:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:0.0:1762166785.367143:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166785.367166:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c400/0xf915a5bdf3c9b5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166785.367188:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27cc00/0xf915a5bdf3c9b5ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90888 expref: 11 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.367205:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c400/0xf915a5bdf3c9b5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90888 expref: 10 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.367225:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee36062bc00) 00010000:00010000:0.0:1762166785.367228:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166785.367232:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f27c400, rc 0) 00000100:00100000:0.0:1762166785.367286:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+10:37708:x1847765444236800:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 329us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166785.367294:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2416 00000100:00100000:0.0:1762166785.368481:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444236928 00000100:00100000:0.0:1762166785.368488:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444236928 00000100:00100000:0.0:1762166785.368527:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2417 00000100:00100000:0.0:1762166785.368536:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+10:37708:x1847765444236928:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166785.368551:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166785.368562:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d200/0xf915a5bdf3c9b5fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9088f expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.368602:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b604 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368612:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b604 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368621:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b604 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368634:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27de00/0xf915a5bdf3c9b60b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368640:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27de00/0xf915a5bdf3c9b60b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368646:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27de00/0xf915a5bdf3c9b60b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368744:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c000/0xf915a5bdf3c9b612 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368751:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c000/0xf915a5bdf3c9b612 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368758:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c000/0xf915a5bdf3c9b612 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000004:00200000:0.0:1762166785.368808:0:5755:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 512 00000004:00200000:0.0:1762166785.368811:0:5755:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166785.368825:0:5755:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c000/0xf915a5bdf3c9b612 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368835:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b604 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368840:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b604 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368847:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b604 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368852:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f27da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166785.368856:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b604 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368862:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b604 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368872:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee36062bc00) 00010000:00010000:0.0:1762166785.368875:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166785.368878:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b604 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368889:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b604 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368899:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27de00/0xf915a5bdf3c9b60b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368905:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27de00/0xf915a5bdf3c9b60b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368910:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27de00/0xf915a5bdf3c9b60b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368914:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f27de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166785.368929:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27de00/0xf915a5bdf3c9b60b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368935:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27de00/0xf915a5bdf3c9b60b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368941:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1ec0156 (ffff9ee36062bd00) 00010000:00010000:0.0:1762166785.368943:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166785.368946:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27de00/0xf915a5bdf3c9b60b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368951:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27de00/0xf915a5bdf3c9b60b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.368974:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d200/0xf915a5bdf3c9b5fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9088f expref: 12 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.368985:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c000/0xf915a5bdf3c9b612 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9088f expref: 11 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.369001:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9ee36062ba00) 00010000:00010000:0.0:1762166785.369003:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1762166785.369006:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f27c000, rc 0) 00000100:00100000:0.0:1762166785.369048:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+11:37708:x1847765444236928:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 512us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166785.369056:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2417 00000100:00100000:0.0:1762166785.369974:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.372308:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.374031:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.376270:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.376355:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444237440 00000100:00100000:1.0:1762166785.376364:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444237440 00000100:00100000:1.0:1762166785.376427:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2421 00000100:00100000:1.0:1762166785.376440:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+12:37708:x1847765444237440:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166785.376460:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166785.376480:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9b651 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f908ab expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.376540:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b658 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376552:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b658 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376563:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b658 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376579:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b65f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376586:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b65f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376593:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b65f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376665:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b658 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376673:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b658 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376679:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b658 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376694:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166785.376699:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b658 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376706:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b658 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376720:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9ee36062ba00) 00010000:00010000:1.0:1762166785.376724:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166785.376728:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b658 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376733:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b658 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376743:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b65f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376747:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b65f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376751:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b65f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376755:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166785.376757:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b65f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376801:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b65f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376813:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x5c9a3b0c (ffff9ee34c9fad00) 00010000:00010000:1.0:1762166785.376816:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166785.376825:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b65f lrc: 2/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376831:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9b65f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.376875:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9b651 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908ab expref: 13 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.376887:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9ee36062ba00) 00010000:00010000:1.0:1762166785.376890:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166785.376894:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9b651 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908ab expref: 13 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.376906:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453e00, rc 0) 00000100:00100000:1.0:1762166785.376979:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+12:37708:x1847765444237440:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 541us (714us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166785.376988:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2421 00000100:00100000:1.0:1762166785.378365:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.378406:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444237696 00000100:00100000:3.0:1762166785.378413:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444237696 00000100:00100000:3.0:1762166785.378453:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2422 00000100:00100000:3.0:1762166785.378462:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+12:37708:x1847765444237696:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166785.378474:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166785.378477:0:5755:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1762166785.378494:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80f800/0xf915a5bdf3c9b64a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908a4 expref: 12 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.378508:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9ee36062ba00) 00010000:00010000:3.0:1762166785.378512:0:5755:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166785.378522:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b666 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f908b2 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.378605:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b66d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.378617:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b66d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.378625:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b66d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.378636:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b674 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.378656:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b674 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.378664:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b674 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.379143:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b67b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.379151:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b67b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.379158:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b67b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000004:00200000:3.0:1762166785.379166:0:5755:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 0 00010000:00010000:3.0:1762166785.379186:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b66d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.379193:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b66d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.379199:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b66d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.379204:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166785.379207:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b66d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.379213:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b66d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.379220:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9ee36062ba00) 00010000:00010000:3.0:1762166785.379223:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166785.379232:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b66d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.379238:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b66d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00000004:00010000:3.0:1762166785.379257:0:5755:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000024083b92 reply state 00000000bd44884b transno 4294968891 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b674 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000100:00100000:3.0:1762166785.379265:0:5755:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1762166785.379285:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b666 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908b2 expref: 14 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.379304:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b67b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908b2 expref: 13 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.379311:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:3.0:1762166785.379313:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166785.379316:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105d200, rc 0) 00000100:00100000:3.0:1762166785.379365:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+14:37708:x1847765444237696:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 905us (1003us total) trans 4294968891 rc 0/0 00000100:00100000:3.0:1762166785.379372:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2422 00010000:00010000:1.0:1762166785.380080:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b674 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.380088:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b674 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.380092:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b674 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.380095:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166785.380097:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b674 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.380109:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b674 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.380116:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x5c9a3b0c (ffff9ee343a13500) 00010000:00010000:1.0:1762166785.380117:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166785.380119:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b674 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.380123:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d800/0xf915a5bdf3c9b674 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00000100:00100000:1.0:1762166785.380686:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.380752:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444237952 00000100:00100000:3.0:1762166785.380759:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444237952 00000100:00100000:3.0:1762166785.380862:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2423 00000100:00100000:3.0:1762166785.380870:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+13:37708:x1847765444237952:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166785.380886:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166785.380896:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b689 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f908b9 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.380971:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b690 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.380989:0:5755:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b67b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908b2 expref: 14 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.380996:0:5755:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b690 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.381026:0:5755:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b67b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908b2 expref: 14 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.381039:0:5755:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d200/0xf915a5bdf3c9b67b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908b2 expref: 14 pid: 5755 timeout: 506 lvb_type: 0 00000100:00100000:3.0:1762166785.381052:0:5755:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1847765451912192:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166785.381126:0:5755:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c593c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166785.381980:0:5755:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1847765451912192:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166785.381997:0:5755:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b690 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000100:00100000:1.0:1762166785.382169:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166785.382361:0:5755:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b690 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.382370:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b690 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000004:00200000:3.0:1762166785.382382:0:5755:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 0 00000004:00080000:3.0:1762166785.382674:0:5755:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4b:0x0], index 1: 0 00000004:00080000:3.0:1762166785.382684:0:5755:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4e:0x0], index 0: 0 00010000:00010000:3.0:1762166785.382817:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b690 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.382845:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b690 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.382851:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b690 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.382856:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105c000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166785.382859:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b690 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.382866:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b690 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.382874:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:3.0:1762166785.382877:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166785.382881:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b690 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.382886:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b690 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.382945:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b689 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908b9 expref: 14 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.382954:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9ee36062ba00) 00010000:00010000:3.0:1762166785.382956:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166785.382960:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b689 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908b9 expref: 14 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.382971:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105d000, rc 0) 00000100:00100000:3.0:1762166785.383003:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+13:37708:x1847765444237952:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2134us (2319us total) trans 4294968892 rc 301/301 00000100:00100000:3.0:1762166785.383016:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2423 00010000:00010000:1.0:1762166785.383855:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166785.384163:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.385323:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.406342:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.406420:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444238848 00000100:00100000:3.0:1762166785.406435:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444238848 00000100:00100000:3.0:1762166785.406490:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2424 00000100:00100000:3.0:1762166785.406502:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+15:37715:x1847765444238848:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166785.406524:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166785.406542:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b69e lrc: 2/0,0 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f908c0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.406701:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b6a5 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.406715:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b6a5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.406725:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b6a5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.406739:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b6ac lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.406745:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b6ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.406752:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b6ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.406849:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b6b3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.406857:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.406877:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000004:00200000:3.0:1762166785.406887:0:5755:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 0 00010000:00010000:3.0:1762166785.406989:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b6a5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.406996:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b6a5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.407002:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b6a5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.407008:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105c000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166785.407012:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b6a5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.407019:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b6a5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.407030:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9ee36062ba00) 00010000:00010000:3.0:1762166785.407032:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166785.407037:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b6a5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.407043:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c000/0xf915a5bdf3c9b6a5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.407064:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b6ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.407070:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b6ac lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.407085:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b6ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.407089:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105c200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166785.407092:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b6ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.407098:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b6ac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.407105:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x5c9a3b0c (ffff9ee343a13f00) 00010000:00010000:3.0:1762166785.407108:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166785.407110:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b6ac lrc: 2/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.407116:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b6ac lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.407157:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b69e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908c0 expref: 18 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.407178:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b6b3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908c0 expref: 17 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.407183:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:3.0:1762166785.407185:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166785.407186:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105d400, rc 0) 00000100:00100000:3.0:1762166785.407233:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+17:37715:x1847765444238848:12345-192.168.203.35@tcp:101:dd.0 Request processed in 735us (898us total) trans 4294968895 rc 0/0 00000100:00100000:3.0:1762166785.407238:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2424 00000100:00100000:1.0:1762166785.409378:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.409421:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444239104 00000100:00100000:3.0:1762166785.409428:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444239104 00000100:00100000:3.0:1762166785.409461:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2425 00000100:00100000:3.0:1762166785.409467:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+17:37715:x1847765444239104:12345-192.168.203.35@tcp:36:dd.0 00010000:00010000:3.0:1762166785.409503:0:5755:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166785.409523:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b6b3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908c0 expref: 17 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.409543:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:3.0:1762166785.409551:0:5755:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166785.409709:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b6c1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.409721:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.409729:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000001:00080000:3.0:1762166785.409810:0:5755:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968896 00000004:00010000:3.0:1762166785.409838:0:5755:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a4991bca reply state 00000000e6a4dcae transno 4294968897 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105de00/0xf915a5bdf3c9b6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000100:00100000:3.0:1762166785.409846:0:5755:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166785.409933:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+19:37715:x1847765444239104:12345-192.168.203.35@tcp:36:dd.0 Request processed in 449us (542us total) trans 4294968897 rc 0/0 00000100:00100000:3.0:1762166785.409946:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2425 00000020:00080000:3.0:1762166785.409951:0:5755:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166785.411003:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.411043:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444239232 00000100:00100000:3.0:1762166785.411050:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444239232 00000100:00100000:3.0:1762166785.411130:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2426 00000100:00100000:3.0:1762166785.411145:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+18:37715:x1847765444239232:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166785.411160:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166785.411172:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b6c8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f908c7 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.411205:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b6c8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908c7 expref: 19 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.411216:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b6c8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908c7 expref: 19 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.411232:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:3.0:1762166785.411235:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166785.411237:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105c800, rc 0) 00000100:00100000:3.0:1762166785.411267:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+19:37715:x1847765444239232:12345-192.168.203.35@tcp:101:dd.0 Request processed in 125us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166785.411272:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2426 00000100:00100000:0.0:1762166785.412220:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.412264:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444239488 00000100:00100000:3.0:1762166785.412269:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444239488 00000100:00100000:3.0:1762166785.412300:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2427 00000100:00100000:3.0:1762166785.412308:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+19:37715:x1847765444239488:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166785.412319:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166785.412322:0:5755:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1762166785.412336:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b6c8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908c7 expref: 19 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.412356:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:3.0:1762166785.412362:0:5755:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166785.412383:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b6cf lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f908ce expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.412413:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b6d6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.412422:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b6d6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.412429:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b6d6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000040:00080000:3.0:1762166785.412663:0:5755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].104, 88 off16624 00000004:00080000:3.0:1762166785.412671:0:5755:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 406204907604ns, next at 404099528306ns, rc = 0 00000040:00080000:3.0:1762166785.412706:0:5755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].105, 88 off16776 00000004:00080000:3.0:1762166785.412712:0:5755:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 406204949186ns, next at 406508629024ns, rc = 0 00000001:00080000:3.0:1762166785.426116:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968890 is committed 00000001:00080000:3.0:1762166785.426130:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968868 is committed 00000004:00080000:3.0:1762166785.426138:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 96 committed 00010000:00010000:0.0:1762166785.426148:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908ce expref: 19 pid: 5755 timeout: 0 lvb_type: 0 00000001:00100000:3.0:1762166785.426159:0:5777:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 22b95110-b0b2-4d2b-9402-7e0d82812a7e 00010000:00010000:0.0:1762166785.426163:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee343a13900) 00000001:00080000:3.0:1762166785.426164:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968888 is committed 00010000:00010000:0.0:1762166785.426167:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:3.0:1762166785.426180:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 94 committed 00010000:00010000:0.0:1762166785.426183:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d600/0xf915a5bdf3c9b6cf lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908ce expref: 19 pid: 5755 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1762166785.426208:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908ce expref: 18 pid: 5755 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166785.426210:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968894 is committed 00000001:00100000:3.0:1762166785.426221:0:5777:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a8dc1ab7-d2d2-4e76-ade8-41da4d39281c 00000020:00080000:3.0:1762166785.426241:0:5777:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee36e62fa80 refcount 2 committed 0 result 0 batchid 36 00010000:00010000:0.0:1762166785.426242:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee343a13900) 00000020:00080000:3.0:1762166785.426245:0:5777:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee241fa8700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee36e62f300 00010000:00010000:0.0:1762166785.426245:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1762166785.426249:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105c600, rc 0) 00000100:00100000:1.0:1762166785.426250:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451912320:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1762166785.426251:0:5777:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee241fa8800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee37f7b7400 00000001:00080000:3.0:1762166785.426270:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968898 is committed 00000004:00080000:3.0:1762166785.426276:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 97 committed 00000004:00080000:3.0:1762166785.426284:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 95 committed 00000100:00100000:0.0:1762166785.426311:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+10:37715:x1847765444239488:12345-192.168.203.35@tcp:101:dd.0 Request processed in 14003us (14090us total) trans 4294968898 rc 0/0 00000020:00000080:3.0:1762166785.426316:0:5777:0:(genops.c:904:class_export_put()) final put ffff9ee37f4c2800/22b95110-b0b2-4d2b-9402-7e0d82812a7e 00000100:00100000:1.0:1762166785.426325:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166785.426326:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2427 00000020:00080000:3.0:1762166785.426330:0:5777:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 35 batchid updated 00000020:00080000:3.0:1762166785.426347:0:5788:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 36 committed batchid 35 00000020:00000080:1.0:1762166785.426490:0:38:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee37f4c2800/22b95110-b0b2-4d2b-9402-7e0d82812a7e for lustre-MDT0000 00000020:00000080:1.0:1762166785.426561:0:38:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee37f4c1000 for lustre-MDT0000 00000100:00100000:1.0:1762166785.426623:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1762166785.426631:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451912704:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166785.426669:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166785.426699:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451912704 00000100:00100000:1.0:1762166785.426704:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451912704 00000100:00100000:1.0:1762166785.426735:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000020:00080000:3.0:1762166785.426744:0:5788:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 35 cancel update log [0x200000400:0x2:0x0].13: rc = 0 00000100:00100000:1.0:1762166785.426744:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765451912704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1762166785.426804:0:26444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:77 count 1 00000020:00080000:3.0:1762166785.426823:0:5788:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 35 00002000:00010000:1.0:1762166785.426825:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x4d:0x0] initial LVB size: 10485760, mtime: 0x690887fd, atime: 0x690887fd, ctime: 0x690887fe, blocks: 0x5007 00010000:00010000:1.0:1762166785.426835:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b6e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.426844:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166785.426846:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166785.426851:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b6e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.426860:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b6e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.426869:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b6e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.426875:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b6e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.426900:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1762166785.426930:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1762166785.426977:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166785.426984:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b6e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.426993:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166785.426998:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b6e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.427088:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b6e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.427104:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b6e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.427111:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b6e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.427129:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166785.427131:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166785.427133:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166785.427349:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765451912704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 605us (679us total) trans 21474836693 rc 0/0 00000100:00100000:1.0:1762166785.427356:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00100000:1.0:1762166785.427394:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451912832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166785.427419:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166785.427459:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762166785.427467:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451912960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166785.427511:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166785.427548:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166785.427557:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451912832 00000100:00100000:0.0:1762166785.427559:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451912960 00000100:00100000:3.0:1762166785.427564:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451912832 00000100:00100000:0.0:1762166785.427566:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451912960 00000100:00100000:1.0:1762166785.427583:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451912448 00000100:00100000:1.0:1762166785.427589:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451912448 00000100:00100000:3.0:1762166785.427603:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1762166785.427614:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765451912832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166785.427616:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:1.0:1762166785.427627:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:0.0:1762166785.427629:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3293:x1847765451912960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166785.427641:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765451912448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1762166785.427658:0:6535:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:74 count 1 00002000:00010000:1.0:1762166785.427683:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x4a:0x0] initial LVB size: 10485760, mtime: 0x690887fd, atime: 0x690887fd, ctime: 0x690887fe, blocks: 0x5007 00010000:00010000:1.0:1762166785.427690:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b6eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.427699:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166785.427701:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166785.427705:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b6eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.427717:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b6eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.427725:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b6eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.427731:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b6eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.427752:0:6535:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1762166785.427860:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765451912960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 235us (348us total) trans 17179869368 rc 0/0 00000100:00100000:0.0:1762166785.427869:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00080000:0.0:1762166785.427891:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166785.428199:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765451912448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 562us (650us total) trans 17179869369 rc 0/0 00000100:00100000:1.0:1762166785.428215:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:1.0:1762166785.428288:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.428327:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.428345:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444239744 00000100:00100000:1.0:1762166785.428350:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444239744 00000100:00100000:1.0:1762166785.428379:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 856 00000100:00100000:1.0:1762166785.428387:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+6:37715:x1847765444239744:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:1.0:1762166785.428395:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166785.428407:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b6f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f908d5 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166785.428420:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00100000:3.0:1762166785.428422:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444239616 00000100:00100000:3.0:1762166785.428427:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444239616 00010000:00010000:1.0:1762166785.428432:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166785.428435:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166785.428440:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b6f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908d5 expref: 7 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.428448:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80e800/0xf915a5bdf3c9b5be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90881 expref: 7 pid: 12400 timeout: 506 lvb_type: 1 00010000:00010000:1.0:1762166785.428456:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b6f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908d5 expref: 7 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.428467:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452000, rc 0) 00000100:00100000:3.0:1762166785.428487:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 542 00000100:00100000:3.0:1762166785.428501:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+7:2361:x1847765444239616:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166785.428501:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+7:37715:x1847765444239744:12345-192.168.203.35@tcp:101:dd.0 Request processed in 110us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166785.428515:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 856 00010000:00010000:3.0:1762166785.428516:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166785.428524:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80e800/0xf915a5bdf3c9b5be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90881 expref: 7 pid: 12400 timeout: 506 lvb_type: 1 00010000:00010000:3.0:1762166785.428537:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80e800/0xf915a5bdf3c9b5be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90881 expref: 7 pid: 12400 timeout: 506 lvb_type: 1 00000100:00080000:1.0:1762166785.428539:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1762166785.428545:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1762166785.428554:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80e800/0xf915a5bdf3c9b5be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90881 expref: 7 pid: 12400 timeout: 506 lvb_type: 1 00010000:00010000:3.0:1762166785.428566:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166785.428568:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166785.428571:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80fa00/0xf915a5bdf3c9b6dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762166785.428573:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fa9aa00/2, rc 0, transno 17179869368 00010000:00010000:3.0:1762166785.428580:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80fa00/0xf915a5bdf3c9b6dd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166785.428588:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451912960:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1762166785.428611:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166785.428631:0:12400:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80fa00/0xf915a5bdf3c9b6dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166785.428635:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+6:2361:x1847765444239616:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 139us (346us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166785.428643:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80fa00/0xf915a5bdf3c9b6dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166785.428649:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 542 00010000:00010000:0.0:1762166785.428659:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80fa00/0xf915a5bdf3c9b6dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.428666:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80fa00/0xf915a5bdf3c9b6dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.428684:0:12400:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166785.428707:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166785.428714:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80fa00/0xf915a5bdf3c9b6dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.428722:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f80fa00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166785.428727:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80fa00/0xf915a5bdf3c9b6dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.428735:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80fa00/0xf915a5bdf3c9b6dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.428747:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80fa00/0xf915a5bdf3c9b6dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.428755:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f80fa00/0xf915a5bdf3c9b6dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.428799:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166785.428802:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166785.428805:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166785.429129:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765451912320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2688us (2806us total) trans 21474836694 rc 0/0 00000100:00100000:0.0:1762166785.429137:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:1.0:1762166785.429569:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3293:x1847765451912832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1958us (2148us total) trans 21474836695 rc 0/0 00000100:00100000:1.0:1762166785.429576:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:1.0:1762166785.429832:0:26243:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444239872 00000100:00100000:1.0:1762166785.429836:0:26243:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444239872 00002000:00010000:1.0:1762166785.429854:0:26243:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/75 (0->18446744073709551615) 00002000:00100000:1.0:1762166785.429856:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa98e00 with x1847765444239872 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166785.429868:0:26243:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fa98e00. 00000100:00100000:1.0:1762166785.429890:0:26243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 897 00000100:00100000:1.0:1762166785.429900:0:26243:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+7:2361:x1847765444239872:12345-192.168.203.35@tcp:10:dd.0 00000001:00080000:0.0:1762166785.442611:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869368 is committed 00000001:00100000:0.0:1762166785.442635:0:23749:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a8dc1ab7-d2d2-4e76-ade8-41da4d39281c 00000001:00080000:0.0:1762166785.442644:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869370 is committed 00002000:00010000:1.0:1762166785.442646:0:26243:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x4b:0x0] updating lvb size from disk: 0 -> 0 00000001:00080000:0.0:1762166785.442649:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869369 is committed 00002000:00010000:1.0:1762166785.442652:0:26243:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x4b:0x0] updating lvb mtime from disk: 0 -> 1762166785 00000001:00100000:0.0:1762166785.442656:0:23749:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 22b95110-b0b2-4d2b-9402-7e0d82812a7e 00002000:00010000:1.0:1762166785.442657:0:26243:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x4b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166785.442662:0:26243:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x4b:0x0] updating lvb ctime from disk: 0 -> 1762166785 00002000:00010000:1.0:1762166785.442664:0:26243:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x4b:0x0] updating lvb blocks from disk: 1 -> 3 00000001:00080000:0.0:1762166785.442665:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869367 is committed 00000020:00000080:0.0:1762166785.442674:0:23749:0:(genops.c:904:class_export_put()) final put ffff9ee243bc5000/22b95110-b0b2-4d2b-9402-7e0d82812a7e 00000100:00100000:1.0:1762166785.442749:0:26243:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+6:2361:x1847765444239872:12345-192.168.203.35@tcp:10:dd.0 Request processed in 12846us (12941us total) trans 17179869370 rc 0/0 00000100:00100000:1.0:1762166785.442788:0:26243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 897 00002000:00010000:1.0:1762166785.442794:0:26243:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/75 (0->18446744073709551615) 00002000:00100000:1.0:1762166785.442799:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa98e00 with x1847765444239872 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166785.442806:0:26243:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fa98e00. 00000100:00100000:1.0:1762166785.455153:0:26243:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444240000 00000100:00100000:1.0:1762166785.455165:0:26243:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444240000 00002000:00100000:1.0:1762166785.455214:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (0->1048575) req@ffff9ee37fa9b100 x1847765444240000/t0(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/0 e 0 to 0 dl 1762166796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.455224:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa9b100 with x1847765444240000 ext(0->1048575) 00002000:00010000:1.0:1762166785.455229:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fa9b100 00000100:00100000:1.0:1762166785.455259:0:26243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 898 00000100:00100000:1.0:1762166785.455268:0:26243:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+6:2360:x1847765444240000:12345-192.168.203.35@tcp:4:dd.0 00000100:00100000:1.0:1762166785.462611:0:26243:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+8:2360:x1847765444240000:12345-192.168.203.35@tcp:4:dd.0 Request processed in 7334us (7553us total) trans 17179869371 rc 0/0 00000100:00100000:1.0:1762166785.462626:0:26243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 898 00002000:00100000:1.0:1762166785.462649:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (0->1048575) req@ffff9ee37fa9b100 x1847765444240000/t17179869371(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/448 e 0 to 0 dl 1762166796 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.462656:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa9b100 with x1847765444240000 ext(0->1048575) 00002000:00010000:1.0:1762166785.462661:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fa9b100 00000100:00100000:0.0:1762166785.464535:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.464599:0:26243:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444240128 00000100:00100000:1.0:1762166785.464608:0:26243:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444240128 00002000:00100000:1.0:1762166785.464652:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (1048576->2097151) req@ffff9ee242409180 x1847765444240128/t0(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/0 e 0 to 0 dl 1762166796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.464663:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242409180 with x1847765444240128 ext(1048576->2097151) 00002000:00010000:1.0:1762166785.464667:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242409180 00000100:00100000:1.0:1762166785.464692:0:26243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 899 00000100:00100000:1.0:1762166785.464698:0:26243:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+8:2361:x1847765444240128:12345-192.168.203.35@tcp:4:dd.0 00000100:00100000:1.0:1762166785.468481:0:26243:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+10:2361:x1847765444240128:12345-192.168.203.35@tcp:4:dd.0 Request processed in 3766us (3939us total) trans 17179869372 rc 0/0 00000100:00100000:1.0:1762166785.468499:0:26243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 899 00002000:00100000:1.0:1762166785.468515:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (1048576->2097151) req@ffff9ee242409180 x1847765444240128/t17179869372(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/448 e 0 to 0 dl 1762166796 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.468524:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242409180 with x1847765444240128 ext(1048576->2097151) 00002000:00010000:1.0:1762166785.468530:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242409180 00000100:00100000:0.0:1762166785.474495:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.474603:0:26243:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444240256 00000100:00100000:1.0:1762166785.474613:0:26243:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444240256 00002000:00100000:1.0:1762166785.474658:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (2097152->3145727) req@ffff9ee242409f80 x1847765444240256/t0(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/0 e 0 to 0 dl 1762166796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.474669:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242409f80 with x1847765444240256 ext(2097152->3145727) 00002000:00010000:1.0:1762166785.474686:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242409f80 00000100:00100000:1.0:1762166785.474716:0:26243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 900 00000100:00100000:1.0:1762166785.474724:0:26243:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+10:2359:x1847765444240256:12345-192.168.203.35@tcp:4:dd.0 00000100:00100000:1.0:1762166785.477631:0:26243:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+12:2359:x1847765444240256:12345-192.168.203.35@tcp:4:dd.0 Request processed in 2898us (3137us total) trans 17179869373 rc 0/0 00000100:00100000:1.0:1762166785.477644:0:26243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 900 00002000:00100000:1.0:1762166785.477657:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (2097152->3145727) req@ffff9ee242409f80 x1847765444240256/t17179869373(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/448 e 0 to 0 dl 1762166796 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.477667:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242409f80 with x1847765444240256 ext(2097152->3145727) 00002000:00010000:1.0:1762166785.477674:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242409f80 00000100:00100000:1.0:1762166785.483957:0:26243:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444240384 00000100:00100000:1.0:1762166785.483966:0:26243:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444240384 00002000:00100000:1.0:1762166785.484015:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (3145728->4194303) req@ffff9ee37fa9ad80 x1847765444240384/t0(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/0 e 0 to 0 dl 1762166796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.484025:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa9ad80 with x1847765444240384 ext(3145728->4194303) 00002000:00010000:1.0:1762166785.484032:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fa9ad80 00000100:00100000:1.0:1762166785.484064:0:26243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 901 00000100:00100000:1.0:1762166785.484072:0:26243:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+12:2358:x1847765444240384:12345-192.168.203.35@tcp:4:dd.0 00000100:00100000:1.0:1762166785.487238:0:26243:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+14:2358:x1847765444240384:12345-192.168.203.35@tcp:4:dd.0 Request processed in 3155us (3360us total) trans 17179869374 rc 0/0 00000100:00100000:1.0:1762166785.487250:0:26243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 901 00002000:00100000:1.0:1762166785.487262:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (3145728->4194303) req@ffff9ee37fa9ad80 x1847765444240384/t17179869374(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/448 e 0 to 0 dl 1762166796 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.487284:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa9ad80 with x1847765444240384 ext(3145728->4194303) 00002000:00010000:1.0:1762166785.487290:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fa9ad80 00000100:00100000:0.0:1762166785.492373:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.492435:0:26243:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444240512 00000100:00100000:1.0:1762166785.492443:0:26243:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444240512 00002000:00100000:1.0:1762166785.492485:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (4194304->5242879) req@ffff9ee24240a300 x1847765444240512/t0(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/0 e 0 to 0 dl 1762166796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.492492:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240a300 with x1847765444240512 ext(4194304->5242879) 00002000:00010000:1.0:1762166785.492498:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24240a300 00000100:00100000:1.0:1762166785.492521:0:26243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 902 00000100:00100000:1.0:1762166785.492527:0:26243:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+14:2359:x1847765444240512:12345-192.168.203.35@tcp:4:dd.0 00000100:00100000:1.0:1762166785.495688:0:26243:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+16:2359:x1847765444240512:12345-192.168.203.35@tcp:4:dd.0 Request processed in 3147us (3309us total) trans 17179869375 rc 0/0 00000100:00100000:1.0:1762166785.495701:0:26243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 902 00002000:00100000:1.0:1762166785.495714:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (4194304->5242879) req@ffff9ee24240a300 x1847765444240512/t17179869375(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/448 e 0 to 0 dl 1762166796 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.495725:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240a300 with x1847765444240512 ext(4194304->5242879) 00002000:00010000:1.0:1762166785.495731:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24240a300 00000100:00100000:0.0:1762166785.501142:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.501211:0:26243:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444240640 00000100:00100000:1.0:1762166785.501220:0:26243:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444240640 00002000:00100000:1.0:1762166785.501264:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (5242880->6291455) req@ffff9ee24240aa00 x1847765444240640/t0(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/0 e 0 to 0 dl 1762166796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.501275:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240aa00 with x1847765444240640 ext(5242880->6291455) 00002000:00010000:1.0:1762166785.501281:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24240aa00 00000100:00100000:1.0:1762166785.501325:0:26243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 903 00000100:00100000:1.0:1762166785.501333:0:26243:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+16:2359:x1847765444240640:12345-192.168.203.35@tcp:4:dd.0 00000100:00100000:1.0:1762166785.503881:0:26243:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+18:2359:x1847765444240640:12345-192.168.203.35@tcp:4:dd.0 Request processed in 2541us (2741us total) trans 17179869376 rc 0/0 00000100:00100000:1.0:1762166785.503895:0:26243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 903 00002000:00100000:1.0:1762166785.503906:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (5242880->6291455) req@ffff9ee24240aa00 x1847765444240640/t17179869376(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/448 e 0 to 0 dl 1762166796 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.503926:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240aa00 with x1847765444240640 ext(5242880->6291455) 00002000:00010000:1.0:1762166785.503933:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24240aa00 00000100:00100000:3.0:1762166785.510414:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.510488:0:26243:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444240768 00000100:00100000:1.0:1762166785.510498:0:26243:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444240768 00002000:00100000:1.0:1762166785.510543:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (6291456->7340031) req@ffff9ee37f2d1500 x1847765444240768/t0(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/0 e 0 to 0 dl 1762166796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.510556:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f2d1500 with x1847765444240768 ext(6291456->7340031) 00002000:00010000:1.0:1762166785.510562:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37f2d1500 00000100:00100000:1.0:1762166785.510593:0:26243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 904 00000100:00100000:1.0:1762166785.510602:0:26243:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+18:2360:x1847765444240768:12345-192.168.203.35@tcp:4:dd.0 00000100:00100000:1.0:1762166785.514298:0:26243:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+20:2360:x1847765444240768:12345-192.168.203.35@tcp:4:dd.0 Request processed in 3686us (3883us total) trans 17179869377 rc 0/0 00000100:00100000:1.0:1762166785.514313:0:26243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 904 00002000:00100000:1.0:1762166785.514326:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (6291456->7340031) req@ffff9ee37f2d1500 x1847765444240768/t17179869377(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/448 e 0 to 0 dl 1762166796 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.514337:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f2d1500 with x1847765444240768 ext(6291456->7340031) 00002000:00010000:1.0:1762166785.514351:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37f2d1500 00000100:00100000:0.0:1762166785.519410:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.519511:0:26243:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444240896 00000100:00100000:1.0:1762166785.519525:0:26243:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444240896 00002000:00100000:1.0:1762166785.519577:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (7340032->8388607) req@ffff9ee242409500 x1847765444240896/t0(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/0 e 0 to 0 dl 1762166796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.519587:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242409500 with x1847765444240896 ext(7340032->8388607) 00002000:00010000:1.0:1762166785.519592:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242409500 00000100:00100000:1.0:1762166785.519625:0:26243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 905 00000100:00100000:1.0:1762166785.519635:0:26243:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+20:2361:x1847765444240896:12345-192.168.203.35@tcp:4:dd.0 00000100:00100000:1.0:1762166785.523531:0:26243:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+22:2361:x1847765444240896:12345-192.168.203.35@tcp:4:dd.0 Request processed in 3883us (4122us total) trans 17179869378 rc 0/0 00000100:00100000:1.0:1762166785.523548:0:26243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 905 00002000:00100000:1.0:1762166785.523581:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (7340032->8388607) req@ffff9ee242409500 x1847765444240896/t17179869378(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/448 e 0 to 0 dl 1762166796 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.523597:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242409500 with x1847765444240896 ext(7340032->8388607) 00002000:00010000:1.0:1762166785.523606:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242409500 00000100:00100000:3.0:1762166785.529138:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.529379:0:26243:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444241024 00000100:00100000:1.0:1762166785.529397:0:26243:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444241024 00002000:00100000:1.0:1762166785.529469:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (8388608->9437183) req@ffff9ee37f2d0a80 x1847765444241024/t0(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/0 e 0 to 0 dl 1762166796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.529483:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f2d0a80 with x1847765444241024 ext(8388608->9437183) 00002000:00010000:1.0:1762166785.529490:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37f2d0a80 00000100:00100000:1.0:1762166785.529541:0:26243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 906 00000100:00100000:1.0:1762166785.529551:0:26243:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+22:2360:x1847765444241024:12345-192.168.203.35@tcp:4:dd.0 00000100:00100000:1.0:1762166785.534113:0:26243:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+24:2360:x1847765444241024:12345-192.168.203.35@tcp:4:dd.0 Request processed in 4554us (4975us total) trans 17179869379 rc 0/0 00000100:00100000:1.0:1762166785.534127:0:26243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 906 00002000:00100000:1.0:1762166785.534141:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (8388608->9437183) req@ffff9ee37f2d0a80 x1847765444241024/t17179869379(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/448 e 0 to 0 dl 1762166796 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.534151:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f2d0a80 with x1847765444241024 ext(8388608->9437183) 00002000:00010000:1.0:1762166785.534157:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37f2d0a80 00000100:00100000:0.0:1762166785.539372:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.539412:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.539500:0:26243:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444241152 00000100:00100000:1.0:1762166785.539509:0:26243:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444241152 00002000:00100000:1.0:1762166785.539553:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (9437184->10485759) req@ffff9ee242408e00 x1847765444241152/t0(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/0 e 0 to 0 dl 1762166796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.539564:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242408e00 with x1847765444241152 ext(9437184->10485759) 00002000:00010000:1.0:1762166785.539569:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242408e00 00000100:00100000:1.0:1762166785.539598:0:26243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 907 00000100:00100000:1.0:1762166785.539607:0:26243:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+24:2361:x1847765444241152:12345-192.168.203.35@tcp:4:dd.0 00000100:00100000:1.0:1762166785.543223:0:26243:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+26:2361:x1847765444241152:12345-192.168.203.35@tcp:4:dd.0 Request processed in 3606us (3799us total) trans 17179869380 rc 0/0 00000100:00100000:1.0:1762166785.543236:0:26243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 907 00002000:00100000:1.0:1762166785.543248:0:26243:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x4b:0x0] (9437184->10485759) req@ffff9ee242408e00 x1847765444241152/t17179869380(0) o4->a8dc1ab7-d2d2-4e76-ade8-41da4d39281c@192.168.203.35@tcp:571/0 lens 488/448 e 0 to 0 dl 1762166796 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166785.543258:0:26243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242408e00 with x1847765444241152 ext(9437184->10485759) 00002000:00010000:1.0:1762166785.543264:0:26243:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242408e00 00000100:00100000:0.0:1762166785.553553:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.553613:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444241536 00000100:00100000:3.0:1762166785.553626:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444241536 00000100:00100000:3.0:1762166785.553683:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2428 00000100:00100000:3.0:1762166785.553692:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+10:37717:x1847765444241536:12345-192.168.203.35@tcp:101:stat.0 00010000:00010000:3.0:1762166785.553714:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166785.553739:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b6f9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f908dc expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.553816:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b700 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.553829:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b700 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.553838:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b700 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.553851:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b707 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.553856:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b707 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.553861:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b707 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.553971:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b70e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.553991:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b70e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.553997:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b70e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000004:00200000:3.0:1762166785.554025:0:5755:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 10485760 00000004:00200000:3.0:1762166785.554029:0:5755:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166785.554045:0:5755:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b70e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.554054:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b70e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.554062:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b700 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.554067:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b700 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.554073:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b700 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.554078:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166785.554082:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b700 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.554087:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b700 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.554097:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9ee36062ba00) 00010000:00010000:3.0:1762166785.554100:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166785.554104:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b700 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.554115:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b700 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.554135:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b707 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.554141:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b707 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.554145:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b707 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.554150:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166785.554153:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b707 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.554158:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b707 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.554165:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x5c9a3b0c (ffff9ee343a13100) 00010000:00010000:3.0:1762166785.554167:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166785.554170:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b707 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.554175:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b707 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.554201:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b6f9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908dc expref: 12 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.554215:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b70e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908dc expref: 11 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.554231:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:3.0:1762166785.554233:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166785.554236:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105c200, rc 0) 00000100:00100000:3.0:1762166785.554292:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+11:37717:x1847765444241536:12345-192.168.203.35@tcp:101:stat.0 Request processed in 600us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166785.554299:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2428 00000100:00100000:3.0:1762166785.562235:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.562310:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444241792 00000100:00100000:0.0:1762166785.562320:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444241792 00000100:00100000:0.0:1762166785.562375:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2429 00000100:00100000:0.0:1762166785.562385:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+11:37718:x1847765444241792:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166785.562409:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166785.562426:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27cc00/0xf915a5bdf3c9b715 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f908e3 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.562515:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b71c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.562529:0:5755:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b70e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908dc expref: 12 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.562536:0:5755:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b71c lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.562587:0:5755:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b70e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908dc expref: 12 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.562604:0:5755:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3c9b70e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908dc expref: 12 pid: 5755 timeout: 506 lvb_type: 0 00000100:00100000:0.0:1762166785.562616:0:5755:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1847765451913088:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166785.562691:0:5755:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166785.563595:0:5755:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1847765451913088:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166785.563612:0:5755:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b71c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000100:00100000:3.0:1762166785.564336:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166785.564604:0:5755:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b71c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166785.564613:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b71c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000004:00200000:3.0:1762166785.564632:0:5755:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 10485760 00010000:00010000:3.0:1762166785.564829:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27cc00/0xf915a5bdf3c9b715 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908e3 expref: 13 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.564846:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b71c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908e3 expref: 12 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.564856:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:3.0:1762166785.564859:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166785.564868:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f27da00, rc 0) 00000100:00100000:0.0:1762166785.564985:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+12:37718:x1847765444241792:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2600us (2756us total) trans 4294968900 rc 0/0 00000100:00100000:0.0:1762166785.564992:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2429 00000100:00100000:3.0:1762166785.566360:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.566432:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444242048 00000100:00100000:0.0:1762166785.566439:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444242048 00000100:00100000:0.0:1762166785.566478:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2430 00000100:00100000:0.0:1762166785.566487:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+12:37718:x1847765444242048:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166785.566505:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166785.566519:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d200/0xf915a5bdf3c9b72a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f908ea expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.566579:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d000/0xf915a5bdf3c9b731 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.566590:0:5755:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b71c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908e3 expref: 13 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.566597:0:5755:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d000/0xf915a5bdf3c9b731 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.566636:0:5755:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b71c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908e3 expref: 13 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.566647:0:5755:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27da00/0xf915a5bdf3c9b71c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908e3 expref: 13 pid: 5755 timeout: 506 lvb_type: 0 00000100:00100000:0.0:1762166785.566660:0:5755:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1847765451913216:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166785.566726:0:5755:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166785.568074:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.568126:0:5755:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1847765451913216:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166785.568145:0:5755:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d000/0xf915a5bdf3c9b731 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.568336:0:5755:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d000/0xf915a5bdf3c9b731 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.568353:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d000/0xf915a5bdf3c9b731 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000004:00200000:0.0:1762166785.568390:0:5755:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 10485760 00000004:00200000:0.0:1762166785.568395:0:5755:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166785.568411:0:5755:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d000/0xf915a5bdf3c9b731 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.568436:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d200/0xf915a5bdf3c9b72a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908ea expref: 13 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.568449:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d000/0xf915a5bdf3c9b731 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908ea expref: 12 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.568479:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:0.0:1762166785.568482:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166785.568485:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f27d000, rc 0) 00000100:00100000:0.0:1762166785.568520:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+12:37718:x1847765444242048:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2034us (2162us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166785.568527:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2430 00000100:00100000:3.0:1762166785.569718:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.569756:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444242432 00000100:00100000:0.0:1762166785.569797:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444242432 00000100:00100000:0.0:1762166785.569836:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2431 00000100:00100000:0.0:1762166785.569846:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+12:37718:x1847765444242432:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166785.569861:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166785.569874:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c200/0xf915a5bdf3c9b738 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f908f1 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.569960:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27dc00/0xf915a5bdf3c9b73f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.569971:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27dc00/0xf915a5bdf3c9b73f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.569980:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27dc00/0xf915a5bdf3c9b73f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000004:00200000:0.0:1762166785.569990:0:5755:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 10485760 00010000:00010000:0.0:1762166785.570095:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c200/0xf915a5bdf3c9b738 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908f1 expref: 15 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.570109:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27dc00/0xf915a5bdf3c9b73f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908f1 expref: 14 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.570125:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:0.0:1762166785.570128:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166785.570131:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f27dc00, rc 0) 00000100:00100000:0.0:1762166785.570171:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+14:37718:x1847765444242432:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 326us (456us total) trans 4294968901 rc 0/0 00000100:00100000:0.0:1762166785.570177:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2431 00000100:00100000:1.0:1762166785.571316:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.571377:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444242560 00000100:00100000:3.0:1762166785.571383:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444242560 00000100:00100000:3.0:1762166785.571421:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 857 00000100:00100000:3.0:1762166785.571431:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+26:2360:x1847765444242560:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762166785.571458:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b74d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.571472:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b6f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908d5 expref: 26 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.571478:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166785.571480:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166785.571483:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b74d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.571512:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b6f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908d5 expref: 26 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.571524:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b6f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908d5 expref: 26 pid: 7858 timeout: 506 lvb_type: 0 00000100:00100000:3.0:1762166785.571538:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765451913344:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166785.571599:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166785.572410:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765451913344:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166785.572428:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b74d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166785.577466:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166785.577799:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b74d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.577811:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b74d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.577839:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b74d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.577849:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b74d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.577865:0:12402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b74d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.577874:0:12402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105c800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166785.577879:0:12402:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b74d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.577888:0:12402:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b74d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.577900:0:12402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b74d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.577928:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37105c800/0xf915a5bdf3c9b74d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166785.577997:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+25:2360:x1847765444242560:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 6567us (6686us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166785.578006:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 857 00000100:00100000:1.0:1762166785.579190:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.579238:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444242944 00000100:00100000:0.0:1762166785.579244:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444242944 00000100:00100000:0.0:1762166785.579283:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2432 00000100:00100000:0.0:1762166785.579291:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+14:37718:x1847765444242944:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166785.579332:0:5755:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762166785.579349:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d000/0xf915a5bdf3c9b731 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908ea expref: 14 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.579366:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c600/0xf915a5bdf3c9b6d6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f908ce expref: 13 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.579381:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:0.0:1762166785.579385:0:5755:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166785.579408:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d200/0xf915a5bdf3c9b754 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.579420:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d200/0xf915a5bdf3c9b754 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166785.579427:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d200/0xf915a5bdf3c9b754 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000040:00080000:0.0:1762166785.579783:0:5755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].105, 88 off16712 00000004:00080000:0.0:1762166785.579793:0:5755:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 406372029286ns, next at 404099528306ns, rc = 0 00000040:00080000:0.0:1762166785.579880:0:5755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].106, 88 off16864 00000004:00080000:0.0:1762166785.579886:0:5755:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 406372123099ns, next at 406508629024ns, rc = 0 00000001:00080000:3.0:1762166785.589994:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968902 is committed 00000004:00080000:3.0:1762166785.590015:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 98 committed 00000004:00080000:3.0:1762166785.590027:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 96 committed 00000020:00080000:3.0:1762166785.590072:0:5777:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 36 batchid updated 00000020:00080000:3.0:1762166785.590101:0:5788:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 36 00000020:00080000:3.0:1762166785.590113:0:5788:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 36 00010000:00010000:1.0:1762166785.590449:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d200/0xf915a5bdf3c9b754 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.590465:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d200/0xf915a5bdf3c9b754 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.590487:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d200/0xf915a5bdf3c9b754 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.590494:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f27d200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166785.590500:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d200/0xf915a5bdf3c9b754 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.590508:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d200/0xf915a5bdf3c9b754 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.590527:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:1.0:1762166785.590530:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166785.590535:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d200/0xf915a5bdf3c9b754 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.590541:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27d200/0xf915a5bdf3c9b754 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00000100:00100000:3.0:1762166785.590679:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451913600 00000100:00100000:3.0:1762166785.590689:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451913600 00000100:00100000:0.0:1762166785.590738:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451913472 00000100:00100000:0.0:1762166785.590744:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451913472 00000100:00100000:3.0:1762166785.590745:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:3.0:1762166785.590758:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765451913600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166785.590793:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:0.0:1762166785.590803:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765451913472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166785.591086:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765451913600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 329us (537us total) trans 17179869381 rc 0/0 00000100:00100000:0.0:1762166785.591087:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765451913472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 285us (442us total) trans 21474836696 rc 0/0 00000100:00100000:3.0:1762166785.591103:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:0.0:1762166785.591112:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:3.0:1762166785.591530:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.593087:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.594568:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.594630:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444243328 00000100:00100000:0.0:1762166785.594639:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444243328 00000100:00100000:0.0:1762166785.594686:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 860 00000100:00100000:0.0:1762166785.594698:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+25:2361:x1847765444243328:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166785.594710:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166785.594730:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d000/0xf915a5bdf3c9b770 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90906 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166785.594755:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x4b:0x0] initial LVB size: 10485760, mtime: 0x69088801, atime: 0x0, ctime: 0x69088801, blocks: 0x3 00010000:00010000:0.0:1762166785.594812:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166785.594816:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166785.594824:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d000/0xf915a5bdf3c9b770 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90906 expref: 26 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166785.594841:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d000/0xf915a5bdf3c9b770 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90906 expref: 26 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166785.594863:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f27d000, rc 0) 00000100:00100000:0.0:1762166785.594927:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+26:2361:x1847765444243328:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 224us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166785.594936:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 860 00000100:00100000:3.0:1762166785.621967:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.622007:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.622034:0:26243:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444243456 00000100:00100000:3.0:1762166785.622042:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.622043:0:26243:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444243456 00000100:00100000:3.0:1762166785.622090:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.622353:0:26243:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444243712 00000100:00100000:0.0:1762166785.622355:0:11752:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444243584 00000100:00100000:1.0:1762166785.622359:0:26243:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444243712 00000100:00100000:0.0:1762166785.622370:0:11752:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444243584 00000100:00100000:3.0:1762166785.622376:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.622418:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.622427:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 908 00000100:00100000:0.0:1762166785.622429:0:11752:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444244096 00000100:00100000:0.0:1762166785.622435:0:11752:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444244096 00000100:00100000:1.0:1762166785.622443:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+31:2360:x1847765444243456:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:3.0:1762166785.622452:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.622472:0:11752:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444244352 00000100:00100000:3.0:1762166785.622479:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.622479:0:11752:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444244352 00010000:00010000:1.0:1762166785.622481:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee350452200/0xf915a5bdf3c9b777 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.622496:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166785.622499:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166785.622507:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350452200/0xf915a5bdf3c9b777 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166785.622512:0:11752:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444244224 00000100:00100000:0.0:1762166785.622517:0:11752:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444244224 00000100:00100000:3.0:1762166785.622524:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166785.622526:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee350452200/0xf915a5bdf3c9b777 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166785.622550:0:11752:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444244480 00000100:00100000:0.0:1762166785.622556:0:11752:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444244480 00000100:00100000:3.0:1762166785.622570:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 910 00000100:00100000:3.0:1762166785.622581:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+34:2360:x1847765444243840:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762166785.622588:0:11752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 911 00000100:00100000:0.0:1762166785.622600:0:11752:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+34:2360:x1847765444243584:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762166785.622602:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b785 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.622617:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166785.622619:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166785.622621:0:11752:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27c200/0xf915a5bdf3c9b78c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.622623:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b785 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.622648:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b785 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.622648:0:11752:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166785.622653:0:11752:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166785.622658:0:11752:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27c200/0xf915a5bdf3c9b78c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.622671:0:11752:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27c200/0xf915a5bdf3c9b78c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166785.623390:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 912 00000100:00100000:3.0:1762166785.623401:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+38:2360:x1847765444243968:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:1.0:1762166785.623413:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 914 00010000:00010000:3.0:1762166785.623422:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b79a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166785.623427:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+38:2361:x1847765444244352:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762166785.623439:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166785.623443:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1762166785.623445:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 915 00010000:00010000:3.0:1762166785.623447:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b79a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.623455:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b7a1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.623457:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b79a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 10 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166785.623469:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+38:2360:x1847765444244224:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762166785.623486:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166785.623490:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166785.623496:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b7a1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 11 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.623498:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d400/0xf915a5bdf3c9b7a8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.623518:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166785.623519:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b7a1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 10 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.623520:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166785.623525:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d400/0xf915a5bdf3c9b7a8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 11 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.623549:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d400/0xf915a5bdf3c9b7a8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 10 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.630052:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b785 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 11 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.630069:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b785 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 11 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.630078:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b785 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 11 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.630085:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166785.630089:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b785 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 11 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.630098:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b785 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 11 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.630117:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b785 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 11 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.630146:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d400/0xf915a5bdf3c9b785 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 11 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166785.630247:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+42:2360:x1847765444243840:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 7665us (8152us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1762166785.630257:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 910 00010000:00010000:3.0:1762166785.634404:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee350452200/0xf915a5bdf3c9b777 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.634421:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350452200/0xf915a5bdf3c9b777 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.634435:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee350452200/0xf915a5bdf3c9b777 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166785.634447:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166785.634451:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166785.634455:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350452200/0xf915a5bdf3c9b777 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.634462:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350452200/0xf915a5bdf3c9b777 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.634480:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee350452200/0xf915a5bdf3c9b777 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.634487:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee350452200/0xf915a5bdf3c9b777 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166785.634567:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+38:2360:x1847765444243456:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 12128us (12607us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1762166785.634577:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 908 00000100:00100000:1.0:1762166785.634596:0:14120:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444244608 00000100:00100000:1.0:1762166785.634605:0:14120:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444244608 00000100:00100000:1.0:1762166785.634680:0:14120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 917 00000100:00100000:1.0:1762166785.634692:0:14120:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+38:2360:x1847765444244608:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762166785.634723:0:14120:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b7b6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.634737:0:14120:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166785.634740:0:14120:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166785.634747:0:14120:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b7b6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 9 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.634787:0:14120:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b7b6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 9 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.635448:0:11752:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27c200/0xf915a5bdf3c9b78c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.635461:0:11752:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27c200/0xf915a5bdf3c9b78c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.635469:0:11752:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27c200/0xf915a5bdf3c9b78c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.635477:0:11752:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f27c200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166785.635482:0:11752:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27c200/0xf915a5bdf3c9b78c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.635496:0:11752:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27c200/0xf915a5bdf3c9b78c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.635512:0:11752:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27c200/0xf915a5bdf3c9b78c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.635520:0:11752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27c200/0xf915a5bdf3c9b78c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166785.635577:0:11752:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+38:2360:x1847765444243584:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 12979us (13533us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1762166785.635586:0:11752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 911 00010000:00010000:3.0:1762166785.637744:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b79a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.638115:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b79a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.638123:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b79a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.638129:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37105d000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166785.638133:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b79a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.638145:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b79a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.638267:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b79a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.638275:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37105d000/0xf915a5bdf3c9b79a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.641241:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d400/0xf915a5bdf3c9b7a8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.641262:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d400/0xf915a5bdf3c9b7a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.641272:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d400/0xf915a5bdf3c9b7a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.641279:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f27d400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166785.641283:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d400/0xf915a5bdf3c9b7a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.641314:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d400/0xf915a5bdf3c9b7a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.641334:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d400/0xf915a5bdf3c9b7a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.641343:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d400/0xf915a5bdf3c9b7a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166785.641443:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+32:2360:x1847765444244224:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 17975us (18960us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1762166785.641453:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 915 00010000:00010000:1.0:1762166785.643097:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b7a1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.643115:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b7a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.643124:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b7a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.643131:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166785.643135:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b7a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.643142:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b7a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.643167:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b7a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.643175:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b7a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166785.643253:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+30:2361:x1847765444244352:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 19825us (20799us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1762166785.643263:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 914 00010000:00010000:1.0:1762166785.645131:0:14120:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b7b6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.645143:0:14120:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b7b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.645150:0:14120:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b7b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.645157:0:14120:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166785.645160:0:14120:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b7b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.645168:0:14120:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b7b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.645179:0:14120:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b7b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.645199:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee350453600/0xf915a5bdf3c9b7b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166785.645251:0:14120:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+26:2360:x1847765444244608:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 10561us (10810us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1762166785.645260:0:14120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 917 00000100:00100000:0.0:1762166785.652400:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.652437:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.652546:0:14120:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444244736 00000100:00100000:1.0:1762166785.652558:0:14120:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444244736 00000100:00100000:3.0:1762166785.652627:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.652683:0:14119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 918 00000100:00100000:3.0:1762166785.652696:0:14119:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+8:2358:x1847765444244864:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762166785.652745:0:14119:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166785.652754:0:14119:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9b7bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.652789:0:14119:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1762166785.652791:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 920 00010000:00010000:3.0:1762166785.652793:0:14119:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166785.652800:0:14119:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9b7bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166785.652804:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+8:2359:x1847765444244992:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:3.0:1762166785.652823:0:14119:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9b7bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.652826:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b7cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.652843:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166785.652845:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166785.652849:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b7cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.652859:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b7cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166785.654479:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.654544:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.654572:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.654592:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.654615:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444245120 00000100:00100000:3.0:1762166785.654627:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444245120 00000100:00100000:3.0:1762166785.654665:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444245248 00000100:00100000:3.0:1762166785.654667:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444245248 00000100:00100000:3.0:1762166785.654687:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444245376 00000100:00100000:3.0:1762166785.654690:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444245376 00000100:00100000:3.0:1762166785.654710:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444245504 00000100:00100000:3.0:1762166785.654712:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444245504 00000100:00100000:3.0:1762166785.654733:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 921 00000100:00100000:3.0:1762166785.654741:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+12:2358:x1847765444245120:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:3.0:1762166785.654856:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc67200/0xf915a5bdf3c9b7d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.654869:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166785.654871:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166785.654875:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc67200/0xf915a5bdf3c9b7d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.654887:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc67200/0xf915a5bdf3c9b7d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166785.655105:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 922 00000100:00100000:0.0:1762166785.655116:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+13:2358:x1847765444245248:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:0.0:1762166785.655135:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9b7d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.655150:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166785.655151:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166785.655155:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9b7d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.655166:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9b7d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166785.655197:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 923 00000100:00100000:1.0:1762166785.655207:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+14:2358:x1847765444245376:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:1.0:1762166785.655225:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b7e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.655234:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166785.655236:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166785.655239:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b7e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.655249:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9b7e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166785.657005:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 924 00000100:00100000:3.0:1762166785.657017:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+15:2358:x1847765444245504:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:3.0:1762166785.657037:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9b7e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.657046:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166785.657048:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166785.657051:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9b7e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 8 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.657070:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9b7e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 8 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166785.657400:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.657469:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.657486:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444245632 00000100:00100000:1.0:1762166785.657492:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444245632 00000100:00100000:1.0:1762166785.657524:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444245760 00000100:00100000:1.0:1762166785.657527:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444245760 00000100:00100000:1.0:1762166785.657555:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 925 00000100:00100000:1.0:1762166785.657563:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+18:2359:x1847765444245632:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:1.0:1762166785.657578:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b7ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.657586:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166785.657588:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166785.657591:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b7ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 9 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.657600:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b7ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 9 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762166785.681408:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836696 is committed 00000001:00100000:0.0:1762166785.681437:0:22362:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 22b95110-b0b2-4d2b-9402-7e0d82812a7e 00000001:00100000:0.0:1762166785.681456:0:22362:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a8dc1ab7-d2d2-4e76-ade8-41da4d39281c 00000001:00080000:0.0:1762166785.681464:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836691 is committed 00000020:00000080:0.0:1762166785.681468:0:22362:0:(genops.c:904:class_export_put()) final put ffff9ee243bc6000/22b95110-b0b2-4d2b-9402-7e0d82812a7e 00000020:00000080:1.0:1762166785.681668:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee243bc6000/22b95110-b0b2-4d2b-9402-7e0d82812a7e for lustre-OST0000 00000020:00000080:1.0:1762166785.681724:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee243bc4800 for lustre-OST0000 00000001:00080000:3.0:1762166785.713939:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836701 is committed 00002000:00010000:0.0:1762166785.713946:0:11752:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb size from disk: 0 -> 9437184 00002000:00010000:0.0:1762166785.713951:0:11752:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb mtime from disk: 0 -> 1762166785 00002000:00010000:0.0:1762166785.713953:0:11752:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb ctime from disk: 0 -> 1762166785 00002000:00010000:0.0:1762166785.713955:0:11752:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb blocks from disk: 1 -> 12295 00010000:00010000:1.0:1762166785.713966:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b7cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166785.713968:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836702 is committed 00010000:00010000:1.0:1762166785.713978:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b7cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.713986:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b7cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 11 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.713987:0:11752:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9b7f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 10 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.714003:0:11752:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9b7f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 10 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.714010:0:11752:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9b7f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 10 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.714036:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166785.714037:0:11752:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166785.714044:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b7cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 11 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.714054:0:11752:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9b7f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 12 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.714059:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b7cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 12 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.714071:0:11752:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9b7f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 12 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.714112:0:11752:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9b7f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 10 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.714114:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b7cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 12 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.714134:0:11752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9b7f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 12 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.714138:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b7cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166785.714216:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+25:2359:x1847765444244992:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 61407us (61580us total) trans 21474836697 rc 0/0 00000100:00100000:0.0:1762166785.714216:0:11752:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+25:2359:x1847765444245760:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 54819us (56738us total) trans 21474836700 rc 0/0 00000100:00100000:0.0:1762166785.714239:0:11752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 926 00000100:00100000:1.0:1762166785.714246:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 920 00010000:00010000:1.0:1762166785.714293:0:14119:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9b7bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.714303:0:14119:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9b7bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 8 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.714311:0:14119:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9b7bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 8 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.714335:0:14119:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166785.714342:0:14119:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9b7bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 8 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.714356:0:14119:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9b7bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.714384:0:14119:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9b7bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 8 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.714422:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9b7bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166785.714467:0:14119:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+20:2358:x1847765444244864:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 61772us (62026us total) trans 21474836699 rc 0/0 00000100:00100000:1.0:1762166785.714491:0:14119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 918 00010000:00010000:1.0:1762166785.714533:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9b7d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.714541:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9b7d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.714548:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9b7d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.714553:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166785.714557:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9b7d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.714563:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9b7d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.714573:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9b7d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.714579:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9b7d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166785.714627:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+17:2358:x1847765444245248:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 59515us (60117us total) trans 21474836701 rc 0/0 00000100:00100000:1.0:1762166785.714632:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 922 00000100:00100000:1.0:1762166785.717273:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000001:00080000:1.0:1762166785.728028:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836704 is committed 00000001:00080000:1.0:1762166785.728050:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836705 is committed 00002000:00010000:3.0:1762166785.728055:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:3.0:1762166785.728061:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb blocks from disk: 12295 -> 18439 00010000:00010000:3.0:1762166785.728100:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b7ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.728114:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b7ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.728124:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b7ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.728135:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166785.728142:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b7ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.728153:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b7ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.728174:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b7ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.728184:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b7ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166785.728292:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+12:2359:x1847765444245632:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 70719us (70883us total) trans 21474836703 rc 0/0 00000100:00100000:3.0:1762166785.728312:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 925 00010000:00010000:3.0:1762166785.728356:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc67200/0xf915a5bdf3c9b7d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.728366:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc67200/0xf915a5bdf3c9b7d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.728373:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc67200/0xf915a5bdf3c9b7d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.728378:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc67200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166785.728382:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc67200/0xf915a5bdf3c9b7d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.728388:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc67200/0xf915a5bdf3c9b7d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.728399:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc67200/0xf915a5bdf3c9b7d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.728406:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc67200/0xf915a5bdf3c9b7d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166785.728455:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+9:2358:x1847765444245120:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 73714us (73979us total) trans 21474836704 rc 0/0 00000100:00100000:3.0:1762166785.728574:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 921 00000001:00080000:1.0:1762166785.740469:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836706 is committed 00002000:00010000:3.0:1762166785.740500:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb blocks from disk: 18439 -> 20487 00010000:00010000:3.0:1762166785.740517:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9b7fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.740529:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9b7fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.740537:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9b7fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.740544:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166785.740549:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9b7fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.740557:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9b7fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.740576:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9b7fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.740583:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9b7fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166785.740687:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+5:2358:x1847765444245888:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 23139us (23413us total) trans 21474836706 rc 0/0 00000100:00100000:3.0:1762166785.740698:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 927 00000100:00100000:1.0:1762166785.751821:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166785.753485:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9b803 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.753496:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9b803 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.753503:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9b803 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.753508:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166785.753512:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9b803 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.753518:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9b803 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.753530:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:1.0:1762166785.753533:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166785.753536:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9b803 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166785.753542:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9b803 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00000100:00100000:1.0:1762166785.753787:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.753895:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444246272 00000100:00100000:0.0:1762166785.753902:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444246272 00000100:00100000:0.0:1762166785.753949:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 861 00000100:00100000:0.0:1762166785.753958:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+5:37718:x1847765444246272:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166785.753972:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166785.753989:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b80a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9090d expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166785.754011:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x4e:0x0] initial LVB size: 10485760, mtime: 0x69088801, atime: 0x0, ctime: 0x69088801, blocks: 0x5007 00010000:00010000:0.0:1762166785.754028:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166785.754030:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166785.754037:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b80a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9090d expref: 6 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.754064:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b80a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9090d expref: 6 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.754074:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158e00, rc 0) 00000100:00100000:0.0:1762166785.754136:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+6:37718:x1847765444246272:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 179us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166785.754143:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 861 00000100:00100000:0.0:1762166785.755500:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.755573:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444246400 00000100:00100000:3.0:1762166785.755580:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444246400 00002000:00010000:3.0:1762166785.755608:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/78 (10485760->18446744073709551615) 00002000:00100000:3.0:1762166785.755613:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc5aa00 with x1847765444246400 ext(10485760->18446744073709551615) 00002000:00010000:3.0:1762166785.755622:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fc5aa00. 00000100:00100000:3.0:1762166785.755650:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 928 00000100:00100000:3.0:1762166785.755659:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+6:2361:x1847765444246400:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762166785.755953:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb size from disk: 10485760 -> 10485760 00002000:00010000:3.0:1762166785.755957:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb mtime from disk: 1762166785 -> 1762166786 00002000:00010000:3.0:1762166785.755959:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166785.755961:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb ctime from disk: 1762166785 -> 1762166786 00002000:00010000:3.0:1762166785.755963:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb blocks from disk: 20487 -> 20487 00000100:00100000:3.0:1762166785.756006:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+7:2361:x1847765444246400:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 348us (510us total) trans 21474836707 rc 0/0 00000100:00100000:3.0:1762166785.756013:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 928 00002000:00010000:3.0:1762166785.756016:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/78 (10485760->18446744073709551615) 00002000:00100000:3.0:1762166785.756018:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc5aa00 with x1847765444246400 ext(10485760->18446744073709551615) 00002000:00010000:3.0:1762166785.756023:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fc5aa00. 00000100:00100000:3.0:1762166785.757329:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166785.758937:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.759026:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444246784 00000100:00100000:0.0:1762166785.759032:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444246784 00000100:00100000:0.0:1762166785.759068:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 862 00000100:00100000:0.0:1762166785.759077:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+26:37718:x1847765444246784:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166785.759089:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166785.759102:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9b818 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90914 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.759124:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d000/0xf915a5bdf3c9b770 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90906 expref: 27 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166785.759131:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166785.759133:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166785.759136:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9b818 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90914 expref: 27 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.759166:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d000/0xf915a5bdf3c9b770 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90906 expref: 27 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166785.759186:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f27d000/0xf915a5bdf3c9b770 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90906 expref: 27 pid: 12400 timeout: 506 lvb_type: 1 00000100:00100000:0.0:1762166785.759200:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765451913728:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166785.759274:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166785.760491:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765451913728:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166785.760516:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9b818 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90914 expref: 27 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.760530:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159800, rc 0) 00000100:00100000:0.0:1762166785.760585:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+27:37718:x1847765444246784:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1508us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166785.760595:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 862 00000100:00100000:3.0:1762166785.760636:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.763388:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166785.763487:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444247040 00000100:00100000:0.0:1762166785.763495:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444247040 00000100:00100000:0.0:1762166785.763542:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 863 00000100:00100000:0.0:1762166785.763552:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+27:2361:x1847765444247040:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166785.763732:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x4b:0x0] updating lvb size from disk: 10485760 -> 10485760 00002000:00010000:0.0:1762166785.763736:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x4b:0x0] updating lvb mtime from disk: 1762166785 -> 1762166785 00002000:00010000:0.0:1762166785.763739:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x4b:0x0] updating lvb atime from disk: 0 -> 1762166785 00002000:00010000:0.0:1762166785.763741:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x4b:0x0] updating lvb ctime from disk: 1762166785 -> 1762166786 00002000:00010000:0.0:1762166785.763749:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x4b:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762166785.763792:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a8dc1ab7-d2d2-4e76-ade8-41da4d39281c+27:2361:x1847765444247040:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 242us (411us total) trans 17179869382 rc 0/0 00000100:00100000:0.0:1762166785.763822:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 863 00000100:00100000:1.0:1762166785.764883:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.766338:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762166785.766665:0:5758:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9b81f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166785.766678:0:5758:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9b81f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00000040:00080000:0.0:1762166785.767079:0:5758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].106, 88 off16800 00000004:00080000:0.0:1762166785.767087:0:5758:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 406559323624ns, next at 404099528306ns, rc = 0 00000040:00080000:0.0:1762166785.767195:0:5758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].107, 88 off16952 00000004:00080000:0.0:1762166785.767200:0:5758:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 406559437639ns, next at 406508629024ns, rc = 0 00000001:00080000:3.0:1762166785.778796:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968906 is committed 00000004:00080000:3.0:1762166785.778816:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 99 committed 00000004:00080000:3.0:1762166785.778834:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 97 committed 00000100:00100000:3.0:1762166785.778986:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451914112:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1762166785.779038:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9b81f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 00000100:00100000:3.0:1762166785.779043:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166785.779050:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9b81f lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166785.779059:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9b81f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166785.779071:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166785.779076:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9b81f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166785.779084:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9b81f lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166785.779099:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:0.0:1762166785.779102:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166785.779108:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9b81f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166785.779126:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9b81f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 00000100:00100000:0.0:1762166785.779158:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451914240 00000100:00100000:0.0:1762166785.779164:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451914240 00000100:00100000:3.0:1762166785.779195:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451914112 00000100:00100000:3.0:1762166785.779200:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451914112 00000100:00100000:0.0:1762166785.779208:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:0.0:1762166785.779220:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3294:x1847765451914240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762166785.779439:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb size from disk: 10485760 -> 10485760 00002000:00010000:0.0:1762166785.779447:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb mtime from disk: 1762166786 -> 1762166786 00002000:00010000:0.0:1762166785.779453:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166785.779460:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb ctime from disk: 1762166786 -> 1762166786 00002000:00010000:0.0:1762166785.779467:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb blocks from disk: 20487 -> 20487 00000100:00100000:0.0:1762166785.779535:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765451914240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 316us (429us total) trans 21474836708 rc 0/0 00000100:00100000:0.0:1762166785.779543:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:1.0:1762166785.779571:0:3294:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836696 gen 2 00000004:00080000:1.0:1762166785.779577:0:3294:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836692 committed transno 21474836696 00000004:00080000:1.0:1762166785.779593:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550d500, transno 21474836693 00000004:00080000:1.0:1762166785.779604:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e62aa00, transno 21474836694 00000004:00080000:1.0:1762166785.779608:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550fb80, transno 21474836695 00000004:00080000:1.0:1762166785.779611:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550c380, transno 21474836696 00000100:00100000:1.0:1762166785.779621:0:3294:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee24550ea00 x1847765451914240/t21474836708(21474836708) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166801 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762166785.779632:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550ea00/2, rc 0, transno 21474836708 00000100:00100000:1.0:1762166785.779637:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451914240:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762166785.779662:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc59500/2, rc 0, transno 17179869383 00000100:00100000:3.0:1762166785.779670:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451914112:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762166785.779817:0:6728:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 1 in progress, 0 in flight, 4 done 00000100:00100000:1.0:1762166785.780195:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.782080:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.789172:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.798180:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166785.806317:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166786.090866:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166786.090924:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166786.091047:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 264 00000100:00100000:1.0:1762166786.091064:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 265 00000100:00100000:3.0:1762166786.091066:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8c6f7ba-e013-470a-a501-8ea6afe8566b+10:2361:x1847765444248448:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166786.091079:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8c6f7ba-e013-470a-a501-8ea6afe8566b+10:2360:x1847765444248320:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166786.091088:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166786.091090:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166786.091112:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee37f80ec00/0xf915a5bdf3c9b54e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90811 expref: 10 pid: 5749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166786.091113:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee37f80e600/0xf915a5bdf3c9b55c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90842 expref: 10 pid: 5749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166786.091131:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166786.091145:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166786.091204:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8c6f7ba-e013-470a-a501-8ea6afe8566b+8:2360:x1847765444248320:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 130us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166786.091206:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8c6f7ba-e013-470a-a501-8ea6afe8566b+8:2361:x1847765444248448:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 147us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166786.091218:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 265 00000100:00100000:3.0:1762166786.091226:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 264 00000100:00100000:0.0:1762166786.091241:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166786.091259:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444248576 00000100:00100000:3.0:1762166786.091265:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444248576 00000100:00100000:3.0:1762166786.091300:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 266 00000100:00100000:3.0:1762166786.091308:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8c6f7ba-e013-470a-a501-8ea6afe8566b+7:2361:x1847765444248576:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166786.091316:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166786.091325:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee37105ca00/0xf915a5bdf3c9b555 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9083b expref: 7 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166786.091392:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166786.091428:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8c6f7ba-e013-470a-a501-8ea6afe8566b+6:2361:x1847765444248576:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 120us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166786.091435:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 266 00000100:00100000:0.0:1762166786.099005:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000020:00010000:3.0:1762166786.099435:0:5743:0:(genops.c:1924:obd_stale_export_get()) Get export ffff9ee36e642800: total 0 00010000:00010000:3.0:1762166786.099498:0:5743:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff9ee36e642800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1762166786.099557:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9b818 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90914 expref: 25 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166786.099582:0:5743:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff9ee36e642800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1762166786.099597:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166786.099599:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166786.099600:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166786.115189:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000020:00010000:0.0:1762166786.115522:0:6548:0:(genops.c:1924:obd_stale_export_get()) Get export ffff9ee34a537000: total 0 00010000:00010000:0.0:1762166786.115528:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166786.115578:0:6548:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff9ee34a537000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1762166786.115633:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b80a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9090d expref: 6 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166786.115660:0:6548:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff9ee34a537000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1762166786.115677:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166786.115679:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166786.115693:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166786.119660:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00080000:1.0:1762166786.119788:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1762166786.119895:0:5744:0:(genops.c:1924:obd_stale_export_get()) Get export ffff9ee36e070800: total 0 00010000:00010000:1.0:1762166786.119950:0:5744:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff9ee36e070800, canceled 0 locks, left on hash table 5. 00010000:00010000:1.0:1762166786.119978:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9ee36062ba00) 00010000:00010000:1.0:1762166786.119981:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1762166786.119987:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c000/0xf915a5bdf3c9b612 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9088f expref: 10 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.120011:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee360714600) 00010000:00010000:1.0:1762166786.120013:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166786.120018:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9b826 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9091b expref: 9 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.120032:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee36062bc00) 00010000:00010000:1.0:1762166786.120034:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762166786.120038:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f27c400/0xf915a5bdf3c9b5f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90888 expref: 8 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.120058:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee360714600) 00010000:00010000:1.0:1762166786.120061:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166786.120065:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9b842 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90922 expref: 7 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.120099:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9ee360714d00) 00010000:00010000:1.0:1762166786.120101:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1762166786.120105:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f80e200/0xf915a5bdf3c9b59b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90873 expref: 7 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.120118:0:5744:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff9ee36e070800, canceled 5 locks, left on hash table 0. 00010000:00010000:1.0:1762166786.120131:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166786.120133:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166786.120135:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166786.126366:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166786.126453:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444249984 00000100:00100000:3.0:1762166786.126462:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444249984 00000100:00100000:3.0:1762166786.126517:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 476 00000100:00100000:3.0:1762166786.126526:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cb45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8c6f7ba-e013-470a-a501-8ea6afe8566b+6:2357:x1847765444249984:12345-192.168.203.35@tcp:251:umount.0 00000020:00000080:3.0:1762166786.126572:0:5751:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c9b540 00000020:00010000:3.0:1762166786.126578:0:5751:0:(genops.c:1938:obd_stale_export_put()) Put export ffff9ee36e077000: total 0 00000100:00080000:3.0:1762166786.126582:0:5751:0:(import.c:65:import_set_state_nolock()) ffff9ee36e071000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1762166786.126652:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cb45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8c6f7ba-e013-470a-a501-8ea6afe8566b+3:2357:x1847765444249984:12345-192.168.203.35@tcp:251:umount.0 Request processed in 126us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166786.126661:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 476 00000020:00000080:0.0:1762166786.126999:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee36e077000/f8c6f7ba-e013-470a-a501-8ea6afe8566b for MGS 00000020:00000080:0.0:1762166786.127054:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee36e071000 for MGS 00000100:00100000:1.0:1762166786.192708:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166786.192801:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444250112 00000100:00100000:3.0:1762166786.192811:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444250112 00000100:00100000:3.0:1762166786.192858:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 477 00000100:00100000:3.0:1762166786.192870:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cb47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2357:x1847765444250112:12345-192.168.203.35@tcp:250:mount.lustre.0 00010000:00080000:3.0:1762166786.192897:0:5751:0:(ldlm_lib.c:1428:target_handle_connect()) MGS: connection from 1d2907fd-ec36-418b-9892-2b7af8c34cb2@192.168.203.35@tcp t0 exp 0000000000000000 cur 406 last 0 00000020:00000080:3.0:1762166786.192950:0:5751:0:(genops.c:1402:class_connect()) connect: client 1d2907fd-ec36-418b-9892-2b7af8c34cb2, cookie 0xf915a5bdf3c9b849 00000020:01000000:3.0:1762166786.192957:0:5751:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee345786300 00000100:00080000:3.0:1762166786.192987:0:5751:0:(import.c:65:import_set_state_nolock()) ffff9ee34a537800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1762166786.193052:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cb47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+4:2357:x1847765444250112:12345-192.168.203.35@tcp:250:mount.lustre.0 Request processed in 181us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166786.193073:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 477 00000100:00100000:1.0:1762166786.194040:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166786.194082:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444250240 00000100:00100000:3.0:1762166786.194086:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444250240 00000100:00100000:3.0:1762166786.194115:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 478 00000100:00100000:3.0:1762166786.194123:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cb45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+4:37751:x1847765444250240:12345-192.168.203.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1762166786.194134:0:5751:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166786.194151:0:5751:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee37fc67200/0xf915a5bdf3c9b850 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90937 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166786.194172:0:5751:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee37fc67200/0xf915a5bdf3c9b850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90937 expref: 5 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166786.194182:0:5751:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee37fc67200/0xf915a5bdf3c9b850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90937 expref: 5 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166786.194190:0:5751:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fc67200, rc 0) 00000100:00100000:3.0:1762166786.194229:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cb45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+5:37751:x1847765444250240:12345-192.168.203.35@tcp:101:mount.lustre.0 Request processed in 106us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166786.194235:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 478 00000100:00100000:0.0:1762166786.195009:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166786.195088:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444250368 00000100:00100000:3.0:1762166786.195093:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444250368 00000100:00100000:3.0:1762166786.195128:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 479 00000100:00100000:3.0:1762166786.195136:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cb46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+5:37751:x1847765444250368:12345-192.168.203.35@tcp:501:mount.lustre.0 00000100:00100000:3.0:1762166786.195390:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cb46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+5:37751:x1847765444250368:12345-192.168.203.35@tcp:501:mount.lustre.0 Request processed in 254us (381us total) trans 0 rc -2/-2 00000100:00100000:3.0:1762166786.195398:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 479 00000100:00100000:1.0:1762166786.196370:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166786.196427:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444250496 00000100:00100000:3.0:1762166786.196439:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444250496 00000100:00100000:3.0:1762166786.196471:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 480 00000100:00100000:3.0:1762166786.196479:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cb46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+5:37751:x1847765444250496:12345-192.168.203.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1762166786.196489:0:5751:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166786.196500:0:5751:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee37fc67800/0xf915a5bdf3c9b857 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9093e expref: -99 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166786.196519:0:5751:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee37fc67800/0xf915a5bdf3c9b857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9093e expref: 6 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166786.196525:0:5751:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee37fc67800/0xf915a5bdf3c9b857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9093e expref: 6 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166786.196531:0:5751:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fc67800, rc 0) 00000100:00100000:3.0:1762166786.196561:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cb46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+6:37751:x1847765444250496:12345-192.168.203.35@tcp:101:mount.lustre.0 Request processed in 83us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166786.196567:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 480 00000100:00100000:1.0:1762166786.197291:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166786.197343:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444250624 00000100:00100000:3.0:1762166786.197348:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444250624 00000100:00100000:3.0:1762166786.197384:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 481 00000100:00100000:3.0:1762166786.197392:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cb47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+6:37751:x1847765444250624:12345-192.168.203.35@tcp:501:mount.lustre.0 00000100:00100000:3.0:1762166786.197495:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cb47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+7:37751:x1847765444250624:12345-192.168.203.35@tcp:501:mount.lustre.0 Request processed in 103us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166786.197503:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 481 00000100:00100000:0.0:1762166786.198323:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166786.198455:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444250752 00000100:00100000:3.0:1762166786.198461:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444250752 00000100:00100000:3.0:1762166786.198503:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 482 00000100:00100000:3.0:1762166786.198512:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cb46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+7:37751:x1847765444250752:12345-192.168.203.35@tcp:503:mount.lustre.0 00000100:00100000:3.0:1762166786.198859:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cb46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+7:37751:x1847765444250752:12345-192.168.203.35@tcp:503:mount.lustre.0 Request processed in 348us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166786.198867:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 482 00000100:00100000:1.0:1762166786.200055:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166786.200275:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444250880 00000100:00100000:3.0:1762166786.200282:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444250880 00000100:00100000:3.0:1762166786.200318:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 483 00000100:00100000:3.0:1762166786.200333:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cb44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+7:37770:x1847765444250880:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1762166786.200596:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cb44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+7:37770:x1847765444250880:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 264us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166786.200604:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 483 00000100:00100000:1.0:1762166786.209030:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166786.209096:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444251008 00000100:00100000:3.0:1762166786.209107:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444251008 00000100:00100000:3.0:1762166786.209159:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 484 00000100:00100000:3.0:1762166786.209168:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cb45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+7:37770:x1847765444251008:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1762166786.209424:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cb45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+7:37770:x1847765444251008:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 255us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166786.209432:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 484 00000100:00100000:0.0:1762166786.212512:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166786.212650:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444251136 00000100:00100000:3.0:1762166786.212661:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444251136 00000100:00100000:3.0:1762166786.212744:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 485 00000100:00100000:3.0:1762166786.212759:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+7:37751:x1847765444251136:12345-192.168.203.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1762166786.212814:0:5751:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166786.212836:0:5751:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee37fc66800/0xf915a5bdf3c9b85e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90968 expref: -99 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166786.212902:0:5751:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee37fc66800/0xf915a5bdf3c9b85e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90968 expref: 8 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166786.212925:0:5751:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee37fc66800/0xf915a5bdf3c9b85e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90968 expref: 8 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166786.212937:0:5751:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fc66800, rc 0) 00000100:00100000:3.0:1762166786.213014:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+8:37751:x1847765444251136:12345-192.168.203.35@tcp:101:mount.lustre.0 Request processed in 256us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166786.213022:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 485 00000100:00100000:1.0:1762166786.214865:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166786.214985:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444251264 00000100:00100000:3.0:1762166786.214995:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444251264 00000100:00100000:3.0:1762166786.215051:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 486 00000100:00100000:3.0:1762166786.215062:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+8:37751:x1847765444251264:12345-192.168.203.35@tcp:256:mount.lustre.0 20000000:01000000:3.0:1762166786.215090:0:5751:0:(mgs_nids.c:896:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1762166786.215118:0:5751:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1762166786.215123:0:5751:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1762166786.215126:0:5751:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1762166786.215129:0:5751:0:(mgs_nids.c:315:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 12 00000100:00100000:0.0:1762166786.216076:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451914368:0@lo:400:kworker.0 00000100:00100000:3.0:1762166786.216110:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1847765451914496:0@lo:400:kworker.0 00000100:00100000:0.0:1762166786.216142:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166786.216144:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166786.216196:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1847765451915008:0@lo:400:kworker.0 00000100:00100000:0.0:1762166786.216196:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765451914880:0@lo:400:kworker.0 00000100:00100000:1.0:1762166786.216214:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451914624:0@lo:400:kworker.0 00000100:00100000:3.0:1762166786.216229:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166786.216269:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451914752:0@lo:400:kworker.0 00000100:00100000:3.0:1762166786.216300:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451914496 00000100:00100000:3.0:1762166786.216305:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451914496 00000100:00100000:1.0:1762166786.216342:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166786.216352:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451915008 00000100:00100000:0.0:1762166786.216361:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451915008 00000100:00100000:0.0:1762166786.216425:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1762166786.216441:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1847765451915008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166786.216448:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1762166786.216455:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1847765451914496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166786.216500:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1847765451915008:12345-0@lo:400:kworker.0 Request processed in 65us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166786.216510:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1762166786.216513:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1847765451914496:12345-0@lo:400:kworker.0 Request processed in 59us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166786.216521:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:0.0:1762166786.216560:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762166786.216584:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166786.216612:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+8:37751:x1847765444251264:12345-192.168.203.35@tcp:256:mount.lustre.0 Request processed in 1551us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166786.216620:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 486 00000100:00100000:1.0:1762166786.216636:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166786.216652:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451914368:0@lo:400:kworker.0 00000100:00100000:0.0:1762166786.216702:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451914880 00000100:00100000:0.0:1762166786.216708:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451914880 00000100:00100000:1.0:1762166786.216744:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451914624:0@lo:400:kworker.0 00000100:00100000:0.0:1762166786.216756:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1762166786.216797:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765451914880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166786.216817:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1847765451914496:0@lo:400:kworker.0 00000100:00100000:3.0:1762166786.216843:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1847765451915008:0@lo:400:kworker.0 00000100:00100000:0.0:1762166786.216851:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765451914880:12345-0@lo:400:kworker.0 Request processed in 58us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166786.216865:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:1.0:1762166786.216881:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762166786.216903:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765451914880:0@lo:400:kworker.0 00000100:00100000:1.0:1762166786.216942:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451914752:0@lo:400:kworker.0 00000100:00100000:3.0:1762166786.219005:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166786.219124:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444251392 00000100:00100000:1.0:1762166786.219142:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444251392 00000100:00100000:1.0:1762166786.219217:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 488 00000100:00100000:1.0:1762166786.219232:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+8:37751:x1847765444251392:12345-192.168.203.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1762166786.219274:0:5751:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166786.219293:0:5751:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee350453c00/0xf915a5bdf3c9b865 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9096f expref: -99 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.219329:0:5751:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee350453c00/0xf915a5bdf3c9b865 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9096f expref: 9 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.219346:0:5751:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee350453c00/0xf915a5bdf3c9b865 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9096f expref: 9 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.219357:0:5751:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453c00, rc 0) 00000100:00100000:1.0:1762166786.219438:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:37751:x1847765444251392:12345-192.168.203.35@tcp:101:mount.lustre.0 Request processed in 209us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166786.219448:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 488 00000100:00100000:3.0:1762166786.220995:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166786.221221:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444251520 00000100:00100000:1.0:1762166786.221228:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444251520 00000100:00100000:1.0:1762166786.221278:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 489 00000100:00100000:1.0:1762166786.221287:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:37751:x1847765444251520:12345-192.168.203.35@tcp:501:mount.lustre.0 00000100:00100000:1.0:1762166786.221462:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:37751:x1847765444251520:12345-192.168.203.35@tcp:501:mount.lustre.0 Request processed in 176us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166786.221469:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 489 00000100:00100000:1.0:1762166786.222665:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444251648 00000100:00100000:1.0:1762166786.222671:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444251648 00000100:00100000:1.0:1762166786.222711:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 490 00000100:00100000:1.0:1762166786.222719:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:37751:x1847765444251648:12345-192.168.203.35@tcp:503:mount.lustre.0 00000100:00100000:1.0:1762166786.223069:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:37751:x1847765444251648:12345-192.168.203.35@tcp:503:mount.lustre.0 Request processed in 349us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166786.223088:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 490 00000100:00100000:3.0:1762166786.224492:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166786.224566:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444251776 00000100:00100000:1.0:1762166786.224572:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444251776 00000100:00100000:1.0:1762166786.224612:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 491 00000100:00100000:1.0:1762166786.224622:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:37775:x1847765444251776:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1762166786.224826:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:37775:x1847765444251776:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 205us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166786.224835:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 491 00000100:00100000:3.0:1762166786.225867:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166786.226174:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444251904 00000100:00100000:1.0:1762166786.226184:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444251904 00000100:00100000:1.0:1762166786.226245:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 492 00000100:00100000:1.0:1762166786.226256:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:37775:x1847765444251904:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1762166786.226532:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:37775:x1847765444251904:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 277us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166786.226542:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 492 00000100:00100000:0.0:1762166786.228514:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444252032 00000100:00100000:0.0:1762166786.228524:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444252032 00000100:00100000:0.0:1762166786.228579:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2440 00000100:00100000:0.0:1762166786.228587:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2357:x1847765444252032:12345-192.168.203.35@tcp:38:mount.lustre.0 00010000:00080000:0.0:1762166786.228631:0:20128:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp t0 exp 0000000000000000 cur 407 last 0 00000020:00000080:0.0:1762166786.228691:0:20128:0:(genops.c:1402:class_connect()) connect: client da9d93ea-d728-4b01-a76b-4b4ff9c19538, cookie 0xf915a5bdf3c9b86c 00000004:00100000:0.0:1762166786.228730:0:20128:0:(mdt_handler.c:7249:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:01000000:0.0:1762166786.228871:0:20128:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee345787400 00000100:00080000:0.0:1762166786.228930:0:20128:0:(import.c:65:import_set_state_nolock()) ffff9ee37f2fd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1762166786.229059:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2357:x1847765444252032:12345-192.168.203.35@tcp:38:mount.lustre.0 Request processed in 470us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166786.229068:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2440 00000100:00100000:3.0:1762166786.230950:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166786.231111:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166786.231206:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444252160 00000100:00100000:0.0:1762166786.231216:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444252160 00000100:00100000:0.0:1762166786.231299:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444252288 00000100:00100000:0.0:1762166786.231303:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444252288 00000100:00100000:1.0:1762166786.231340:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2441 00000100:00100000:0.0:1762166786.231354:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2442 00000100:00100000:0.0:1762166786.231374:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:37751:x1847765444252288:12345-192.168.203.35@tcp:41:mount.lustre.0 00000100:00100000:1.0:1762166786.231376:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:0:x1847765444252160:12345-192.168.203.35@tcp:41:mount.lustre.0 00000004:00000024:0.0:1762166786.231430:0:20128:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2260205568 avail 2258108416 00000004:00000024:1.0:1762166786.231434:0:5756:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2260205568 avail 2258108416 00000100:00100000:0.0:1762166786.231576:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:37751:x1847765444252288:12345-192.168.203.35@tcp:41:mount.lustre.0 Request processed in 160us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166786.231587:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2442 00000100:00100000:1.0:1762166786.231668:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:0:x1847765444252160:12345-192.168.203.35@tcp:41:mount.lustre.0 Request processed in 312us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166786.231678:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2441 00000100:00100000:3.0:1762166786.232830:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166786.232941:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444252416 00000100:00100000:1.0:1762166786.232949:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444252416 00000100:00100000:1.0:1762166786.232993:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2443 00000100:00100000:1.0:1762166786.233012:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:37751:x1847765444252416:12345-192.168.203.35@tcp:40:mount.lustre.0 00000100:00100000:1.0:1762166786.233078:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:37751:x1847765444252416:12345-192.168.203.35@tcp:40:mount.lustre.0 Request processed in 68us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166786.233085:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2443 00000100:00100000:0.0:1762166786.234313:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444252544 00000100:00100000:0.0:1762166786.234327:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444252544 00000100:00100000:0.0:1762166786.234356:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444252672 00000100:00100000:0.0:1762166786.234360:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444252672 00000100:00100000:0.0:1762166786.234398:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 868 00000100:00100000:0.0:1762166786.234405:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2357:x1847765444252544:12345-192.168.203.35@tcp:8:mount.lustre.0 00000100:00100000:3.0:1762166786.234419:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444252800 00000100:00100000:3.0:1762166786.234425:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444252800 00010000:00080000:0.0:1762166786.234434:0:12400:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0000: connection from da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp t0 exp 0000000000000000 cur 407 last 0 00000100:00100000:1.0:1762166786.234437:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 869 00000100:00100000:1.0:1762166786.234451:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1847765444252672:12345-192.168.203.35@tcp:8:mount.lustre.0 00000100:00100000:3.0:1762166786.234469:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 727 00000020:00000080:0.0:1762166786.234471:0:12400:0:(genops.c:1402:class_connect()) connect: client da9d93ea-d728-4b01-a76b-4b4ff9c19538, cookie 0xf915a5bdf3c9b873 00000100:00100000:3.0:1762166786.234483:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:37751:x1847765444252800:12345-192.168.203.35@tcp:33:mount.lustre.0 00002000:00100000:0.0:1762166786.234485:0:12400:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0000: cli da9d93ea-d728-4b01-a76b-4b4ff9c19538/ffff9ee374a95000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00010000:00080000:1.0:1762166786.234491:0:6533:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0001: connection from da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp t0 exp 0000000000000000 cur 407 last 0 00002000:00100000:0.0:1762166786.234503:0:12400:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000080:1.0:1762166786.234535:0:6533:0:(genops.c:1402:class_connect()) connect: client da9d93ea-d728-4b01-a76b-4b4ff9c19538, cookie 0xf915a5bdf3c9b87a 00002000:00100000:1.0:1762166786.234551:0:6533:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0001: cli da9d93ea-d728-4b01-a76b-4b4ff9c19538/ffff9ee248015800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1762166786.234564:0:6533:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000020:01000000:0.0:1762166786.234616:0:12400:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee247a17800 00002000:00080000:0.0:1762166786.234627:0:12400:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1762166786.234664:0:12400:0:(import.c:65:import_set_state_nolock()) ffff9ee374a04000 : changing import state from RECOVER to FULL 00000020:01000000:1.0:1762166786.234690:0:6533:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee36f323700 00002000:00080000:1.0:1762166786.234701:0:6533:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1762166786.234732:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2357:x1847765444252544:12345-192.168.203.35@tcp:8:mount.lustre.0 Request processed in 322us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166786.234742:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 868 00000004:00200000:3.0:1762166786.234743:0:5758:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000100:00080000:1.0:1762166786.234751:0:6533:0:(import.c:65:import_set_state_nolock()) ffff9ee248013000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1762166786.234860:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2357:x1847765444252672:12345-192.168.203.35@tcp:8:mount.lustre.0 Request processed in 407us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166786.234873:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 869 00000100:00100000:3.0:1762166786.234881:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:37751:x1847765444252800:12345-192.168.203.35@tcp:33:mount.lustre.0 Request processed in 401us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166786.234895:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 727 00000100:00100000:3.0:1762166786.692514:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166786.692567:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444252928 00000100:00100000:0.0:1762166786.692576:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444252928 00000100:00100000:0.0:1762166786.692634:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2444 00000100:00100000:0.0:1762166786.692646:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:37817:x1847765444252928:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166786.692668:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166786.692692:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9b881 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90999 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166786.692759:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9b888 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.692811:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9b888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.692840:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9b888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:0.0:1762166786.692904:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:0.0:1762166786.692920:0:20128:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166786.692945:0:20128:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9b888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.692969:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9b881 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90999 expref: 8 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166786.692982:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9b888 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90999 expref: 7 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166786.692988:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee36062b200) 00010000:00010000:0.0:1762166786.692990:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166786.692992:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158200, rc 0) 00000100:00100000:0.0:1762166786.693059:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:37817:x1847765444252928:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 412us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166786.693066:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2444 00000100:00100000:0.0:1762166786.694535:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444253056 00000100:00100000:0.0:1762166786.694547:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444253056 00000100:00100000:0.0:1762166786.694600:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2445 00000100:00100000:0.0:1762166786.694610:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:37817:x1847765444253056:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166786.694622:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166786.694635:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b88f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f909a0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166786.694686:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9b896 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.694705:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9b896 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.694715:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9b896 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.694730:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9b89d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.694737:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9b89d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.694744:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9b89d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.694982:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158c00/0xf915a5bdf3c9b8a4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.694991:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158c00/0xf915a5bdf3c9b8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.694997:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158c00/0xf915a5bdf3c9b8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:0.0:1762166786.695026:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 11776 00000004:00200000:0.0:1762166786.695029:0:20128:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166786.695049:0:20128:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158c00/0xf915a5bdf3c9b8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.695059:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9b896 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.695066:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9b896 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.695082:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9b896 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.695088:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166786.695092:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9b896 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.695099:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9b896 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.695110:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee36062b200) 00010000:00010000:0.0:1762166786.695114:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166786.695117:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9b896 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.695124:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9b896 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.695134:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9b89d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.695139:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9b89d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.695144:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9b89d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.695149:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166786.695151:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9b89d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.695156:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9b89d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.695175:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1ec0156 (ffff9ee36062b400) 00010000:00010000:0.0:1762166786.695177:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166786.695180:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9b89d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.695185:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9b89d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.695214:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b88f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909a0 expref: 9 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166786.695225:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158c00/0xf915a5bdf3c9b8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909a0 expref: 8 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166786.695231:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9ee36062b900) 00010000:00010000:0.0:1762166786.695233:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1762166786.695235:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158c00, rc 0) 00000100:00100000:0.0:1762166786.695285:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:37817:x1847765444253056:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 677us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166786.695292:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2445 00000100:00100000:3.0:1762166786.696672:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166786.696733:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444253312 00000100:00100000:0.0:1762166786.696740:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444253312 00000100:00100000:0.0:1762166786.696808:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2446 00000100:00100000:0.0:1762166786.696818:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:37817:x1847765444253312:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166786.696833:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166786.696847:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9b8ab lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f909a7 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166786.696936:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b8b2 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.696946:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b8b2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.696955:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b8b2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.696969:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b8b9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.696975:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b8b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.696981:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b8b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.697073:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b8b2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.697080:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b8b2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.697086:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b8b2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.697092:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166786.697096:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b8b2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.697103:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b8b2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.697138:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9ee36062b900) 00010000:00010000:0.0:1762166786.697141:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166786.697145:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b8b2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.697151:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b8b2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.697161:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b8b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.697167:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b8b9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.697172:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b8b9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.697178:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166786.697180:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b8b9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.697186:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b8b9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.697193:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x5c9a3b0c (ffff9ee36062b700) 00010000:00010000:0.0:1762166786.697195:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166786.697197:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b8b9 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.697203:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b8b9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.697235:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9b8ab lrc: 1/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909a7 expref: 9 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166786.697252:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9ee36062b900) 00010000:00010000:0.0:1762166786.697254:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166786.697258:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9b8ab lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909a7 expref: 9 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166786.697269:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159e00, rc 0) 00000100:00100000:0.0:1762166786.697318:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:37817:x1847765444253312:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 502us (651us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166786.697326:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2446 00000100:00100000:1.0:1762166786.698516:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166786.698575:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444253568 00000100:00100000:0.0:1762166786.698582:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444253568 00000100:00100000:0.0:1762166786.698625:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2447 00000100:00100000:0.0:1762166786.698636:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:37817:x1847765444253568:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166786.698649:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166786.698663:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9b8c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f909ae expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1762166786.698750:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 11776 00010000:00010000:0.0:1762166786.698896:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9b8c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909ae expref: 10 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166786.698923:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee36062b200) 00010000:00010000:0.0:1762166786.698927:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166786.698932:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9b8c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909ae expref: 10 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166786.698943:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159400, rc 0) 00000100:00100000:0.0:1762166786.699000:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:37817:x1847765444253568:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 366us (485us total) trans 4294968909 rc 301/301 00000100:00100000:0.0:1762166786.699007:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2447 00000100:00100000:3.0:1762166786.700662:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166786.700731:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444253824 00000100:00100000:0.0:1762166786.700738:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444253824 00000100:00100000:0.0:1762166786.700802:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2448 00000100:00100000:0.0:1762166786.700815:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:37817:x1847765444253824:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166786.700830:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166786.700843:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9b8ce lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f909b5 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166786.700916:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b8d5 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.700925:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b8d5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.700933:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b8d5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.700943:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b8dc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.700947:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b8dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.700951:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b8dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.701066:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9b8e3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.701073:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9b8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.701087:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9b8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:0.0:1762166786.701097:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 10485760 00010000:00010000:0.0:1762166786.701175:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b8d5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.701182:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b8d5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.701188:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b8d5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.701192:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166786.701196:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b8d5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.701202:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b8d5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.701212:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9ee36062b900) 00010000:00010000:0.0:1762166786.701215:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166786.701219:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b8d5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.701224:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b8d5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.701233:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b8dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.701238:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b8dc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.701253:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b8dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.701257:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166786.701260:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b8dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.701265:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b8dc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.701273:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x5c9a3b0c (ffff9ee36062b300) 00010000:00010000:0.0:1762166786.701276:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166786.701279:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b8dc lrc: 2/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.701285:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b8dc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166786.701322:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9b8ce lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909b5 expref: 12 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166786.701336:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9b8e3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909b5 expref: 11 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166786.701343:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee36062b100) 00010000:00010000:0.0:1762166786.701345:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166786.701347:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159c00, rc 0) 00000100:00100000:0.0:1762166786.701397:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:37817:x1847765444253824:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 587us (740us total) trans 4294968910 rc 0/0 00000100:00100000:0.0:1762166786.701402:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2448 00000100:00100000:3.0:1762166786.702946:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166786.704656:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166787.053472:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166787.431927:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166788.264051:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1762166788.264075:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451915136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166788.264146:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166788.264181:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451915136 00000100:00100000:1.0:1762166788.264190:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451915136 00000100:00100000:1.0:1762166788.264260:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1762166788.264269:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1847765451915136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1762166788.264304:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 61276160 pending 17039360 free 3857711104 avail 3855613952 00000100:00100000:1.0:1762166788.264359:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1847765451915136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166788.264382:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1762166788.264396:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451915136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762166788.776282:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451915264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762166788.776379:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1762166788.776621:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166788.776717:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451915264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166789.154473:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166789.154532:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444254720 00000100:00100000:1.0:1762166789.154542:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444254720 00000100:00100000:1.0:1762166789.154619:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2449 00000100:00100000:1.0:1762166789.154630:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:38253:x1847765444254720:12345-192.168.203.35@tcp:36:rm.0 00010000:00010000:1.0:1762166789.154680:0:20128:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166789.154704:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9b8e3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909b5 expref: 13 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166789.154721:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee36062b100) 00010000:00010000:1.0:1762166789.154732:0:20128:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166789.154752:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b8f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.154792:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b8f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.154801:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b8f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.154814:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b8f8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.154820:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b8f8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.154837:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b8f8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.154962:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b8ff lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.154971:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b8ff lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.154979:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b8ff lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000040:00080000:1.0:1762166789.155614:0:20128:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].107, 64 off16864 00000004:00080000:1.0:1762166789.155625:0:20128:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 409947861468ns, next at 410947858788ns, rc = 0 00000040:00080000:1.0:1762166789.155660:0:20128:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].108, 64 off17016 00000004:00080000:1.0:1762166789.155667:0:20128:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 409947904137ns, next at 410947902448ns, rc = 0 00010000:00010000:1.0:1762166789.155730:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b906 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.155740:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b906 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.155747:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b906 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.155755:0:20128:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b906 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.155788:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b906 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.155796:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b906 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.155828:0:20128:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166789.155842:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166789.155846:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b8ff lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166789.155850:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b906 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.155856:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b8ff lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.155867:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b8ff lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166789.155871:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166789.155873:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166789.155878:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b906 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.155879:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b8ff lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166789.155903:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b906 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.155910:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b8ff lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166789.155917:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee34c9fa900) 00010000:00010000:3.0:1762166789.155922:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166789.155926:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b906 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.155930:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9ee34c9fa900) 00010000:00010000:3.0:1762166789.155933:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9b906 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.155935:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1762166789.155941:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b8ff lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166789.155947:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166789.155949:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9b8ff lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166789.155950:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166789.155954:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166789.156019:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b8f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.156026:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b8f1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.156033:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b8f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.156048:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166789.156051:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b8f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.156057:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b8f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.156065:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9ee36062b900) 00010000:00010000:1.0:1762166789.156067:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166789.156070:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b8f1 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.156075:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9b8f1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000004:00010000:1.0:1762166789.156085:0:20128:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c3add3b9 reply state 0000000016bb0c6e transno 4294968913 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b8f8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:1.0:1762166789.156093:0:20128:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166789.156173:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:38253:x1847765444254720:12345-192.168.203.35@tcp:36:rm.0 Request processed in 1543us (1706us total) trans 4294968913 rc 0/0 00000100:00100000:1.0:1762166789.156181:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2449 00010000:00010000:0.0:1762166789.160413:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b8f8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.160428:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b8f8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.160437:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b8f8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.160444:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166789.160448:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b8f8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.160456:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b8f8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.160471:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x5c9a3b0c (ffff9ee34c9fa800) 00010000:00010000:0.0:1762166789.160474:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.160479:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b8f8 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.160485:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9b8f8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.480505:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1762166789.820996:0:29525:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 45: Verify setstripe/getstripe with YAML with FLR file ========================================================== 05:46:29 (1762166789) 00000100:00100000:0.0:1762166789.843337:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444254848 00000100:00100000:0.0:1762166789.843349:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444254848 00000100:00100000:0.0:1762166789.843411:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2450 00000100:00100000:0.0:1762166789.843428:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:38400:x1847765444254848:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:0.0:1762166789.843457:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166789.843478:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9b90d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f909bc expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.843617:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b914 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.843632:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b914 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.843643:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b914 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.844988:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b91b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.845013:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b91b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.845025:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b91b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.845123:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b914 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.845130:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b914 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.845136:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b914 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.845142:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166789.845146:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b914 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.845152:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b914 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.845177:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee36062b200) 00010000:00010000:0.0:1762166789.845180:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.845185:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b914 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.845191:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b914 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.845202:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b91b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.845207:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b91b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.845212:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b91b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.845216:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166789.845218:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b91b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.845224:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b91b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.845229:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1c89c56e (ffff9ee36062b400) 00010000:00010000:0.0:1762166789.845232:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.845234:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b91b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.845239:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b91b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.845282:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9b90d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909bc expref: 14 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.845297:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee36062b200) 00010000:00010000:0.0:1762166789.845300:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.845304:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9b90d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909bc expref: 14 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.845313:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158000, rc 0) 00000100:00100000:0.0:1762166789.845386:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:38400:x1847765444254848:12345-192.168.203.35@tcp:101:rm.0 Request processed in 1966us (2116us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166789.845396:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2450 00000100:00100000:3.0:1762166789.868903:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166789.868990:0:5764:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444254976 00000100:00100000:0.0:1762166789.869002:0:5764:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444254976 00000100:00100000:0.0:1762166789.869073:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3 00000100:00100000:0.0:1762166789.869084:0:5764:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:38410:x1847765444254976:12345-192.168.203.35@tcp:700:mkdir.0 00000100:00100000:0.0:1762166789.869189:0:5764:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:38410:x1847765444254976:12345-192.168.203.35@tcp:700:mkdir.0 Request processed in 107us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166789.869197:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3 00000100:00100000:3.0:1762166789.870467:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166789.870542:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444255232 00000100:00100000:0.0:1762166789.870547:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444255232 00000100:00100000:3.0:1762166789.870633:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2451 00000100:00100000:3.0:1762166789.870643:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:38410:x1847765444255232:12345-192.168.203.35@tcp:36:mkdir.0 00010000:00010000:3.0:1762166789.870685:0:5756:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166789.870706:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9b888 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90999 expref: 13 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166789.870719:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee36062b200) 00010000:00010000:3.0:1762166789.870727:0:5756:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166789.870877:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9b922 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.870902:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9b922 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.870910:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9b922 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.870920:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b929 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.870924:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b929 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.870929:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b929 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:3.0:1762166789.871675:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1:0x0]: returning size 512 00010000:00010000:3.0:1762166789.871686:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9b922 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.871693:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9b922 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.871710:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9b922 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.871717:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc67600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166789.871722:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9b922 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.871730:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9b922 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.871740:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:3.0:1762166789.871742:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166789.871746:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9b922 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.871752:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9b922 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000004:00010000:3.0:1762166789.871788:0:5756:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005b7c94cd reply state 00000000ad70ccdd transno 4294968914 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b929 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:3.0:1762166789.871797:0:5756:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166789.871916:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:38410:x1847765444255232:12345-192.168.203.35@tcp:36:mkdir.0 Request processed in 1274us (1450us total) trans 4294968914 rc 0/0 00000100:00100000:3.0:1762166789.871923:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2451 00010000:00010000:3.0:1762166789.874602:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b929 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.874615:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b929 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.874623:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b929 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.874636:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166789.874640:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b929 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.874648:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b929 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.874662:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1c89c56e (ffff9ee343a13f00) 00010000:00010000:3.0:1762166789.874665:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166789.874669:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b929 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.874675:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b929 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000100:00100000:3.0:1762166789.882625:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166789.882740:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444255360 00000100:00100000:1.0:1762166789.882759:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444255360 00000100:00100000:1.0:1762166789.882915:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2452 00000100:00100000:1.0:1762166789.882933:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:38412:x1847765444255360:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166789.882982:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166789.883039:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b930 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f909c3 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166789.883143:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b937 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166789.883166:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b937 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166789.883184:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b937 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:1.0:1762166789.883277:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:1.0:1762166789.883283:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166789.883325:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b937 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166789.883360:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9b930 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909c3 expref: 15 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166789.883395:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b937 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909c3 expref: 14 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166789.883406:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34c9fa000) 00010000:00010000:1.0:1762166789.883410:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762166789.883415:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452600, rc 0) 00000100:00100000:1.0:1762166789.883529:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:38412:x1847765444255360:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 602us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166789.883541:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2452 00000100:00100000:3.0:1762166789.886066:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444255488 00000100:00100000:3.0:1762166789.886080:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444255488 00000100:00100000:3.0:1762166789.886142:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2453 00000100:00100000:3.0:1762166789.886152:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:38412:x1847765444255488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166789.886173:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166789.886193:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9b93e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f909ca expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166789.886253:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b945 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886267:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b945 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886278:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b945 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886302:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9b94c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886309:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9b94c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886316:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9b94c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886445:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67400/0xf915a5bdf3c9b953 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886453:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67400/0xf915a5bdf3c9b953 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886460:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67400/0xf915a5bdf3c9b953 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:3.0:1762166789.886494:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1:0x0]: returning size 512 00000004:00200000:3.0:1762166789.886498:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166789.886522:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67400/0xf915a5bdf3c9b953 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886533:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b945 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886539:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b945 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886546:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b945 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886552:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166789.886557:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b945 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886572:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b945 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886584:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34c9fa000) 00010000:00010000:3.0:1762166789.886587:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166789.886591:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b945 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886596:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9b945 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886608:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9b94c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886614:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9b94c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886619:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9b94c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886624:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc67000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166789.886627:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9b94c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886633:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9b94c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886639:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1c89c56e (ffff9ee343a13f00) 00010000:00010000:3.0:1762166789.886641:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166789.886644:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9b94c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886649:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9b94c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166789.886685:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9b93e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909ca expref: 16 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166789.886698:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67400/0xf915a5bdf3c9b953 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909ca expref: 15 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166789.886704:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:3.0:1762166789.886706:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1762166789.886709:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fc67400, rc 0) 00000100:00100000:3.0:1762166789.886803:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:38412:x1847765444255488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 651us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166789.886812:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2453 00000100:00100000:3.0:1762166789.888996:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166789.889090:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444255616 00000100:00100000:0.0:1762166789.889097:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444255616 00000100:00100000:0.0:1762166789.889141:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2454 00000100:00100000:0.0:1762166789.889149:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:38412:x1847765444255616:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166789.889162:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166789.889174:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b95a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f909d1 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.889235:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b961 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889246:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b961 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889257:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b961 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889270:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b968 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889276:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b968 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889283:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b968 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889331:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b961 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889338:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b961 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889343:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b961 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889348:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166789.889352:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b961 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889358:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b961 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889379:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:0.0:1762166789.889382:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.889386:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b961 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889392:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b961 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889403:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b968 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889408:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b968 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889414:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b968 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889419:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166789.889422:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b968 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889427:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b968 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889434:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xcaa2b802 (ffff9ee36062b400) 00010000:00010000:0.0:1762166789.889436:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.889439:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b968 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889445:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b968 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.889476:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b95a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909d1 expref: 16 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.889494:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:0.0:1762166789.889497:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.889501:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b95a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909d1 expref: 16 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.889510:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158600, rc 0) 00000100:00100000:0.0:1762166789.889552:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:38412:x1847765444255616:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 404us (573us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166789.889560:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2454 00000100:00100000:0.0:1762166789.891003:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444255744 00000100:00100000:0.0:1762166789.891009:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444255744 00000100:00100000:0.0:1762166789.891053:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2455 00000100:00100000:0.0:1762166789.891061:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:38412:x1847765444255744:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166789.891073:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166789.891084:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9b96f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f909d8 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.891124:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9b976 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891134:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9b976 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891143:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9b976 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891155:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b97d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891173:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b97d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891179:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b97d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891218:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9b976 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891225:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9b976 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891231:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9b976 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891236:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166789.891239:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9b976 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891245:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9b976 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891254:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:0.0:1762166789.891256:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.891259:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9b976 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891264:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9b976 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891274:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b97d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891280:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b97d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891292:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b97d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891298:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166789.891302:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b97d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891307:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b97d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891317:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xcaa2b802 (ffff9ee36062b600) 00010000:00010000:0.0:1762166789.891320:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.891323:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b97d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891329:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9b97d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.891360:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9b96f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909d8 expref: 16 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.891370:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:0.0:1762166789.891373:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.891377:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9b96f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909d8 expref: 16 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.891392:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159e00, rc 0) 00000100:00100000:0.0:1762166789.891435:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:38412:x1847765444255744:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 373us (487us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166789.891442:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2455 00000100:00100000:3.0:1762166789.892950:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166789.893027:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444255872 00000100:00100000:0.0:1762166789.893034:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444255872 00000100:00100000:0.0:1762166789.893075:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2456 00000100:00100000:0.0:1762166789.893085:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:38412:x1847765444255872:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166789.893095:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166789.893106:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b984 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f909df expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.893142:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9b98b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.893151:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9b98b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.893159:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9b98b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:0.0:1762166789.893196:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1:0x0]: returning size 512 00000004:00200000:0.0:1762166789.893199:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166789.893217:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9b98b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.893249:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b984 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909df expref: 17 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.893271:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9b98b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909df expref: 16 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.893277:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:0.0:1762166789.893280:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166789.893282:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158800, rc 0) 00000100:00100000:0.0:1762166789.893326:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:38412:x1847765444255872:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 244us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166789.893331:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2456 00000100:00100000:3.0:1762166789.895951:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166789.896004:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444256000 00000100:00100000:0.0:1762166789.896011:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444256000 00000100:00100000:0.0:1762166789.896059:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2457 00000100:00100000:0.0:1762166789.896071:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:38412:x1847765444256000:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166789.896086:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166789.896100:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b992 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f909e6 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.896148:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b999 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896159:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b999 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896167:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b999 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896178:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9a0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896184:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896191:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896251:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b999 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896258:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b999 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896274:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b999 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896279:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166789.896282:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b999 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896289:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b999 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896300:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:0.0:1762166789.896303:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.896306:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b999 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896311:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b999 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896322:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896328:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9a0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896334:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896339:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166789.896342:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896348:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9a0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896365:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xcaa2b802 (ffff9ee36062b400) 00010000:00010000:0.0:1762166789.896367:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.896370:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9a0 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896375:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9a0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166789.896402:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b992 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909e6 expref: 17 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.896411:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:0.0:1762166789.896413:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.896418:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b992 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909e6 expref: 17 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.896426:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158600, rc 0) 00000100:00100000:0.0:1762166789.896475:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:38412:x1847765444256000:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 407us (530us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166789.896482:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2457 00000100:00100000:3.0:1762166789.900457:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166789.900499:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444256256 00000100:00100000:3.0:1762166789.900508:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444256256 00010000:00010000:1.0:1762166789.903875:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9b9b5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.903913:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9b9b5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.903922:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9b9b5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.903929:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166789.903933:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9b9b5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.903941:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9b9b5 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.903961:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xcaa2b802 (ffff9ee360714800) 00010000:00010000:1.0:1762166789.903965:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166789.903971:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9b9b5 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.903978:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9b9b5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:1.0:1762166789.908076:0:20128:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20128:1847765451915392:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166789.908096:0:20128:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9b9d1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.909697:0:20128:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9b9d1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.909719:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9b9d1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:1.0:1762166789.909738:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2:0x0]: returning size 0 00000004:00080000:1.0:1762166789.910282:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4f:0x0], index 0: 0 00000004:00080000:1.0:1762166789.910307:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4c:0x0], index 1: 0 00000004:00080000:1.0:1762166789.910321:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x50:0x0], index 0: 0 00000004:00080000:1.0:1762166789.910334:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x51:0x0], index 0: 0 00000004:00080000:1.0:1762166789.910348:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4d:0x0], index 1: 0 00000004:00080000:1.0:1762166789.910357:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x52:0x0], index 0: 0 00000004:00080000:1.0:1762166789.910369:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4e:0x0], index 1: 0 00010000:00010000:1.0:1762166789.910574:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9b9d1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.910584:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9b9d1 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.910591:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9b9d1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.910598:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166789.910602:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9b9d1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.910610:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9b9d1 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.910626:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff9ee360714900) 00010000:00010000:1.0:1762166789.910629:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166789.910634:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9b9d1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.910641:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9b9d1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.910703:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9b9ca lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909f4 expref: 18 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166789.910721:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166789.910725:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166789.910730:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9b9ca lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909f4 expref: 18 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166789.910743:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14e00, rc 0) 00000100:00100000:1.0:1762166789.910817:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:38412:x1847765444256512:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 4710us (4810us total) trans 4294968916 rc 301/301 00000100:00100000:1.0:1762166789.910826:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2459 00000100:00100000:0.0:1762166789.914195:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444256896 00000100:00100000:0.0:1762166789.914206:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444256896 00000100:00100000:0.0:1762166789.914266:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 731 00000100:00100000:0.0:1762166789.914277:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:38412:x1847765444256896:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166789.914563:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:38412:x1847765444256896:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 286us (424us total) trans 4294968917 rc 0/0 00000100:00100000:0.0:1762166789.914571:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 731 00000100:00100000:0.0:1762166789.916491:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444257152 00000100:00100000:0.0:1762166789.916498:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444257152 00000100:00100000:0.0:1762166789.916527:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 732 00000100:00100000:0.0:1762166789.916532:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:38412:x1847765444257152:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166789.916638:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:38412:x1847765444257152:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 104us (225us total) trans 4294968918 rc 0/0 00000100:00100000:0.0:1762166789.916644:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 732 00000100:00100000:3.0:1762166789.921784:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166789.921829:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444257408 00000100:00100000:0.0:1762166789.921838:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444257408 00000100:00100000:0.0:1762166789.921906:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2460 00000100:00100000:0.0:1762166789.921917:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:38414:x1847765444257408:12345-192.168.203.35@tcp:101:bash.0 00010000:00010000:0.0:1762166789.921939:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166789.921958:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b9df lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f909fb expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.922079:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9e6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.922093:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9e6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.922105:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9e6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.922134:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b9ed lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.922141:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b9ed lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.922148:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b9ed lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00080000:0.0:1762166789.922527:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4f:0x0], index 1: 0 00010000:00010000:0.0:1762166789.922714:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b9f4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.922723:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b9f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.922730:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b9f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.922785:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9e6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.922793:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9e6 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.922800:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9e6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.922806:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166789.922810:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9e6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.922817:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9e6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.922828:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:0.0:1762166789.922831:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.922835:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9e6 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.922841:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9b9e6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000004:00010000:0.0:1762166789.922865:0:20128:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007260cc77 reply state 00000000a71f84eb transno 4294968919 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b9ed lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:0.0:1762166789.922873:0:20128:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762166789.922914:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9b9df lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909fb expref: 22 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.922927:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b9f4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909fb expref: 21 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.922934:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3:0x0].0x0 (ffff9ee36062b600) 00010000:00010000:0.0:1762166789.922936:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166789.922939:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158e00, rc 0) 00000100:00100000:0.0:1762166789.923007:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:38414:x1847765444257408:12345-192.168.203.35@tcp:101:bash.0 Request processed in 1092us (1247us total) trans 4294968919 rc 0/0 00000100:00100000:0.0:1762166789.923014:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2460 00010000:00010000:3.0:1762166789.927258:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b9ed lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166789.927271:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b9ed lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166789.927278:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b9ed lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166789.927284:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166789.927295:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b9ed lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166789.927302:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b9ed lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166789.927319:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xe0d9f819 (ffff9ee36062b400) 00010000:00010000:3.0:1762166789.927322:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166789.927326:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b9ed lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166789.927332:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9b9ed lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:1.0:1762166789.927835:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6730:x1847765451915520:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17449us (17588us total) trans 21474836709 rc 0/0 00000100:00100000:1.0:1762166789.927846:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:3.0:1762166789.935093:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166789.935267:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444257664 00000100:00100000:0.0:1762166789.935277:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444257664 00000100:00100000:0.0:1762166789.935330:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2461 00000100:00100000:0.0:1762166789.935341:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:38414:x1847765444257664:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166789.935366:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166789.935385:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ba02 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a02 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.935465:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ba09 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935486:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ba09 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935515:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ba09 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935530:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba10 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935537:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba10 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935543:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba10 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935634:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ba09 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935642:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ba09 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935648:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ba09 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935654:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166789.935658:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ba09 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935670:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ba09 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935682:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:0.0:1762166789.935685:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.935690:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ba09 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935696:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ba09 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935713:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba10 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935720:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba10 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935725:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba10 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935730:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166789.935734:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba10 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935739:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba10 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935747:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xcaa2b802 (ffff9ee36062b800) 00010000:00010000:0.0:1762166789.935750:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.935753:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba10 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935758:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba10 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.935833:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ba02 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a02 expref: 22 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.935843:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:0.0:1762166789.935845:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166789.935849:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ba02 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a02 expref: 22 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.935868:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158600, rc 0) 00000100:00100000:0.0:1762166789.935930:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:38414:x1847765444257664:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 591us (847us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166789.935937:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2461 00000100:00100000:0.0:1762166789.938223:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444257920 00000100:00100000:0.0:1762166789.938231:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444257920 00000100:00100000:0.0:1762166789.938268:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2462 00000100:00100000:0.0:1762166789.938277:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:38414:x1847765444257920:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166789.938290:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166789.938304:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ba17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a09 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1762166789.938393:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1:0x0]: returning size 512 00010000:00010000:0.0:1762166789.938498:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ba17 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a09 expref: 23 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.938510:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34c9fa000) 00010000:00010000:0.0:1762166789.938513:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166789.938517:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ba17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a09 expref: 23 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.938527:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158a00, rc 0) 00000100:00100000:0.0:1762166789.938584:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:38414:x1847765444257920:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 307us (526us total) trans 4294968920 rc 301/301 00000100:00100000:0.0:1762166789.938592:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2462 00000100:00100000:0.0:1762166789.942191:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444258048 00000100:00100000:0.0:1762166789.942228:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444258048 00000100:00100000:0.0:1762166789.942306:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2463 00000100:00100000:0.0:1762166789.942319:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:38414:x1847765444258048:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166789.942414:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9ba25 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942433:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9ba25 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942452:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9ba25 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942469:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ba2c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942475:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ba2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942482:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ba2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942601:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9ba33 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942608:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9ba33 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942614:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9ba33 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:0.0:1762166789.942657:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2:0x0]: returning size 0 00000004:00200000:0.0:1762166789.942662:0:20128:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166789.942674:0:20128:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9ba33 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942698:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9ba25 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942705:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9ba25 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942711:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9ba25 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942717:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166789.942721:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9ba25 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942730:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9ba25 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942743:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:0.0:1762166789.942747:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.942751:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9ba25 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942757:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9ba25 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942806:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ba2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942812:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ba2c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942818:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ba2c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942823:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166789.942831:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ba2c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942837:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ba2c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942845:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xcaa2b802 (ffff9ee36062b500) 00010000:00010000:0.0:1762166789.942847:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.942850:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ba2c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942856:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ba2c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942871:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9ba33 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942882:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9ba33 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942900:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9ba33 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942906:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166789.942909:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9ba33 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942914:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9ba33 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942920:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff9ee36062b400) 00010000:00010000:0.0:1762166789.942923:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.942925:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9ba33 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.942940:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9ba33 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:0.0:1762166789.943040:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:38414:x1847765444258048:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 723us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166789.943050:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2463 00000100:00100000:0.0:1762166789.944551:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444258176 00000100:00100000:0.0:1762166789.944562:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444258176 00000100:00100000:0.0:1762166789.944613:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2464 00000100:00100000:0.0:1762166789.944623:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:38414:x1847765444258176:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166789.944642:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166789.944660:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ba3a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a10 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.944691:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ba3a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a10 expref: 23 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.944711:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ba3a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a10 expref: 23 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.944720:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:0.0:1762166789.944723:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.944727:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158200, rc 0) 00000100:00100000:0.0:1762166789.944822:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:38414:x1847765444258176:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 200us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166789.944830:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2464 00000100:00100000:0.0:1762166789.947047:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444258304 00000100:00100000:0.0:1762166789.947065:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444258304 00000100:00100000:0.0:1762166789.947111:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 733 00000100:00100000:0.0:1762166789.947119:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:38414:x1847765444258304:12345-192.168.203.35@tcp:37:lfs.0 00000100:00100000:0.0:1762166789.950070:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:38414:x1847765444258304:12345-192.168.203.35@tcp:37:lfs.0 Request processed in 2946us (3068us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166789.950082:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 733 00000100:00100000:1.0:1762166789.953978:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444258432 00000100:00100000:1.0:1762166789.953996:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444258432 00000100:00100000:1.0:1762166789.954071:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 871 00000100:00100000:1.0:1762166789.954081:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2361:x1847765444258432:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166789.954098:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166789.954118:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9ba41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a17 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166789.954142:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166789.954159:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166789.954161:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166789.954169:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9ba41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a17 expref: 7 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166789.954203:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9ba41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a17 expref: 7 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166789.954217:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452a00, rc 0) 00000100:00100000:1.0:1762166789.954274:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2361:x1847765444258432:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 194us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166789.954280:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 871 00000100:00100000:3.0:1762166789.958054:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166789.958501:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444258560 00000100:00100000:0.0:1762166789.958511:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444258560 00000100:00100000:0.0:1762166789.959156:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 872 00000100:00100000:0.0:1762166789.959168:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:38414:x1847765444258560:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166789.959186:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166789.959201:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9ba48 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a1e expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.959227:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9ba41 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a17 expref: 8 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166789.959234:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166789.959236:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166789.959239:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9ba48 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a1e expref: 8 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.959268:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9ba41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a17 expref: 8 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166789.959279:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9ba41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a17 expref: 8 pid: 6533 timeout: 510 lvb_type: 1 00000100:00100000:0.0:1762166789.959311:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765451915648:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166789.959392:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166789.961323:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765451915648:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166789.961349:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9ba48 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a1e expref: 8 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.961363:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158800, rc 0) 00000100:00100000:0.0:1762166789.961410:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:38414:x1847765444258560:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2244us (3362us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166789.961418:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 872 00000100:00100000:3.0:1762166789.962407:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444258688 00000100:00100000:3.0:1762166789.962415:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444258688 00010000:00010000:3.0:1762166789.962445:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9ba41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a17 expref: 8 pid: 6533 timeout: 510 lvb_type: 1 00000100:00100000:3.0:1762166789.962482:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 549 00000100:00100000:3.0:1762166789.962491:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2361:x1847765444258688:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166789.962502:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166789.962522:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9ba41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a17 expref: 8 pid: 6533 timeout: 510 lvb_type: 1 00010000:00010000:3.0:1762166789.962535:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9ba41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a17 expref: 8 pid: 6533 timeout: 510 lvb_type: 1 00010000:00010000:3.0:1762166789.962569:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9ba41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a17 expref: 8 pid: 6533 timeout: 510 lvb_type: 1 00010000:00010000:3.0:1762166789.962582:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166789.962584:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166789.962590:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9ba48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a1e expref: 7 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166789.962599:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9ba48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a1e expref: 7 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166789.962625:0:7415:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158800/0xf915a5bdf3c9ba48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a1e expref: 7 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166789.962637:0:7415:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7415:1847765451915776:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762166789.962695:0:7415:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72c00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166789.966323:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166789.966418:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444258944 00000100:00100000:0.0:1762166789.966426:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444258944 00000100:00100000:0.0:1762166789.966472:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 734 00000100:00100000:0.0:1762166789.966480:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:38414:x1847765444258944:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166789.966707:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:38414:x1847765444258944:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 227us (386us total) trans 4294968921 rc 0/0 00000100:00100000:0.0:1762166789.966714:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 734 00000100:00100000:3.0:1762166789.968524:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166789.977114:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166789.977185:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444259456 00000100:00100000:0.0:1762166789.977194:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444259456 00000100:00100000:0.0:1762166789.977259:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2465 00000100:00100000:0.0:1762166789.977269:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:38415:x1847765444259456:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166789.977300:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166789.977320:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ba4f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a25 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.977435:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9ba56 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.977449:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9ba56 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.977459:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9ba56 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:0.0:1762166789.977470:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x3:0x0]: returning size 21 00010000:00010000:0.0:1762166789.977595:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ba4f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a25 expref: 28 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.977613:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9ba56 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a25 expref: 27 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.977621:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3:0x0].0x0 (ffff9ee36062b600) 00010000:00010000:0.0:1762166789.977624:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166789.977627:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159400, rc 0) 00000100:00100000:0.0:1762166789.977687:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:38415:x1847765444259456:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 419us (583us total) trans 4294968923 rc 0/0 00000100:00100000:0.0:1762166789.977695:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2465 00000100:00100000:1.0:1762166789.982530:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166789.982622:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444259584 00000100:00100000:0.0:1762166789.982636:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444259584 00000100:00100000:0.0:1762166789.982706:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2466 00000100:00100000:0.0:1762166789.982718:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:38415:x1847765444259584:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166789.982742:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166789.982782:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ba64 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a2c expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.982861:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ba6b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.982874:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ba6b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.982895:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ba6b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.982910:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba72 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.982917:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.982923:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.982987:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ba6b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.982994:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ba6b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.983000:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ba6b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.983005:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166789.983009:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ba6b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.983021:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ba6b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.983043:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:0.0:1762166789.983052:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.983057:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ba6b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.983063:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ba6b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.983074:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.983080:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba72 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.983085:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba72 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.983090:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166789.983093:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba72 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.983098:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba72 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.983105:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xd6c8d217 (ffff9ee36062b400) 00010000:00010000:0.0:1762166789.983107:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.983110:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba72 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.983116:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ba72 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166789.983152:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ba64 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a2c expref: 28 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.983168:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:0.0:1762166789.983170:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166789.983174:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ba64 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a2c expref: 28 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.983183:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158a00, rc 0) 00000100:00100000:0.0:1762166789.983256:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:38415:x1847765444259584:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 540us (741us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166789.983264:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2466 00000100:00100000:0.0:1762166789.986278:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166789.986572:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444259840 00000100:00100000:1.0:1762166789.986590:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444259840 00000100:00100000:1.0:1762166789.986679:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2467 00000100:00100000:1.0:1762166789.986690:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:38415:x1847765444259840:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166789.986715:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166789.986718:0:20128:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166789.986748:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ba3a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a10 expref: 27 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166789.986822:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166789.986829:0:20128:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166789.986848:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9ba79 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a33 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166789.987036:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9ba80 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.987071:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9ba80 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.987080:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9ba80 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.987095:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9ba87 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.987102:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9ba87 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.987108:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9ba87 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.987678:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9ba8e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.987689:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9ba8e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.987695:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9ba8e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:1.0:1762166789.987707:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x4:0x0]: returning size 0 00010000:00010000:1.0:1762166789.987735:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9ba80 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.987742:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9ba80 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.987749:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9ba80 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.987801:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166789.987812:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9ba80 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.987822:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9ba80 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.987835:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166789.987838:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166789.987843:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9ba80 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.987850:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9ba80 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000004:00010000:1.0:1762166789.987863:0:20128:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000043a548 reply state 00000000edfaac7e transno 4294968924 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9ba87 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:1.0:1762166789.987873:0:20128:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762166789.987918:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9ba79 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a33 expref: 29 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166789.987931:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9ba8e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a33 expref: 28 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166789.987939:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4:0x0].0x0 (ffff9ee34c9fa600) 00010000:00010000:1.0:1762166789.987941:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166789.987944:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452e00, rc 0) 00000100:00100000:1.0:1762166789.988037:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:38415:x1847765444259840:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1348us (1766us total) trans 4294968924 rc 0/0 00000100:00100000:1.0:1762166789.988047:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2467 00010000:00010000:1.0:1762166789.989472:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9ba87 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.989509:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9ba87 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.989514:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9ba87 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.989518:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166789.989521:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9ba87 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.989527:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9ba87 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.989540:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xd6c8d217 (ffff9ee34c9fa300) 00010000:00010000:1.0:1762166789.989543:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166789.989547:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9ba87 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.989554:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9ba87 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:0.0:1762166789.990422:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166789.990513:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444260096 00000100:00100000:1.0:1762166789.990523:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444260096 00000100:00100000:1.0:1762166789.990639:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2468 00000100:00100000:1.0:1762166789.990651:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:38415:x1847765444260096:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166789.990677:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166789.990699:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9ba9c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a3a expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166789.990852:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9baa3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.990876:0:20128:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9ba8e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a33 expref: 29 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166789.990893:0:20128:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9baa3 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.990930:0:20128:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9ba8e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a33 expref: 29 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166789.990944:0:20128:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9ba8e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a33 expref: 29 pid: 20128 timeout: 510 lvb_type: 0 00000100:00100000:1.0:1762166789.990956:0:20128:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f620000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20128:1847765451915904:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166789.991041:0:20128:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3471f3000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166789.993205:0:20128:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f620000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20128:1847765451915904:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166789.993214:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166789.993234:0:20128:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9baa3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.993479:0:20128:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9baa3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.993487:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9baa3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:1.0:1762166789.993503:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x4:0x0]: returning size 0 00000004:00080000:1.0:1762166789.993784:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x53:0x0], index 0: 0 00000004:00080000:1.0:1762166789.993797:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x50:0x0], index 1: 0 00000004:00080000:1.0:1762166789.993805:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x54:0x0], index 0: 0 00000004:00080000:1.0:1762166789.993811:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x55:0x0], index 0: 0 00000004:00080000:1.0:1762166789.993827:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x51:0x0], index 1: 0 00000004:00080000:1.0:1762166789.993833:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x56:0x0], index 0: 0 00000004:00080000:1.0:1762166789.993838:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x52:0x0], index 1: 0 00010000:00010000:1.0:1762166789.994024:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9baa3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.994032:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9baa3 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.994038:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9baa3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.994044:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166789.994048:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9baa3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.994055:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9baa3 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.994064:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4:0x0].0x0 (ffff9ee34c9fa600) 00010000:00010000:1.0:1762166789.994068:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166789.994071:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9baa3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.994076:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9baa3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166789.994121:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9ba9c lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a3a expref: 29 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166789.994130:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166789.994134:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166789.994145:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9ba9c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a3a expref: 29 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166789.994154:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453400, rc 0) 00000100:00100000:1.0:1762166789.994195:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:38415:x1847765444260096:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3545us (3779us total) trans 4294968925 rc 301/301 00000100:00100000:1.0:1762166789.994208:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2468 00000100:00100000:0.0:1762166789.994345:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451916032 00000100:00100000:0.0:1762166789.994351:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451916032 00000100:00100000:0.0:1762166789.994389:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:0.0:1762166789.994398:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:7838:x1847765451916032:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1762166789.994854:0:12400:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 98 00000100:00100000:3.0:1762166789.998116:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166790.000106:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166790.004710:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:7838:x1847765451916032:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10308us (10409us total) trans 17179869384 rc 0/0 00000100:00100000:1.0:1762166790.004723:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00100000:2.0:1762166790.015287:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166790.015416:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444260992 00000100:00100000:1.0:1762166790.015428:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444260992 00000100:00100000:1.0:1762166790.015495:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2469 00000100:00100000:1.0:1762166790.015506:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:38418:x1847765444260992:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166790.015530:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166790.015548:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bab1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a41 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166790.015682:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bab8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.015696:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bab8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.015708:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bab8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.015722:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9babf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.015729:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9babf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.015743:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9babf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.015899:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bab8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.015907:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bab8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.015913:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bab8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.015919:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166790.015922:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bab8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.015929:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bab8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.015940:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166790.015943:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166790.015947:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bab8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.015953:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bab8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.015966:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9babf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.015972:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9babf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.015977:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9babf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.015987:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166790.015996:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9babf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.016002:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9babf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.016010:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xcaa2b802 (ffff9ee34c9fa600) 00010000:00010000:1.0:1762166790.016012:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166790.016014:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9babf lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.016020:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9babf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.016054:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bab1 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a41 expref: 31 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166790.016064:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166790.016066:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166790.016070:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bab1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a41 expref: 31 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166790.016080:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453400, rc 0) 00000100:00100000:1.0:1762166790.016145:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:38418:x1847765444260992:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 641us (867us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166790.016153:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2469 00000100:00100000:3.0:1762166790.018352:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166790.018475:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444261248 00000100:00100000:1.0:1762166790.018485:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444261248 00000100:00100000:1.0:1762166790.018546:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2470 00000100:00100000:1.0:1762166790.018559:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:38418:x1847765444261248:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166790.018573:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166790.018587:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bac6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a48 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166790.018675:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9bacd lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.018686:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9bacd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.018694:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9bacd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:1.0:1762166790.018704:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1:0x0]: returning size 512 00010000:00010000:1.0:1762166790.018878:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bac6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a48 expref: 33 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166790.018908:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9bacd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a48 expref: 32 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166790.018916:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166790.018919:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166790.018922:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452800, rc 0) 00000100:00100000:1.0:1762166790.018971:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:38418:x1847765444261248:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 417us (632us total) trans 4294968928 rc 0/0 00000100:00100000:1.0:1762166790.018978:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2470 00000100:00100000:3.0:1762166790.021025:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166790.021482:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444261376 00000100:00100000:1.0:1762166790.021493:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444261376 00000100:00100000:1.0:1762166790.021562:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2471 00000100:00100000:1.0:1762166790.021571:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:38418:x1847765444261376:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:1.0:1762166790.021628:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9badb lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.021640:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9badb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.021649:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9badb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.021662:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bae2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.021668:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bae2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.021673:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bae2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.021750:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bae9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.021757:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bae9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.021909:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bae9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:1.0:1762166790.021938:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2:0x0]: returning size 0 00000004:00200000:1.0:1762166790.021942:0:20128:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166790.021951:0:20128:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bae9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.021962:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9badb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.021974:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9badb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.021981:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9badb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.021986:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166790.021989:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9badb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.021995:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9badb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.022006:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166790.022009:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166790.022013:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9badb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.022019:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9badb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.022029:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bae2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.022035:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bae2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.022040:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bae2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.022045:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166790.022048:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bae2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.022063:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bae2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.022071:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xcaa2b802 (ffff9ee34c9fa300) 00010000:00010000:1.0:1762166790.022074:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166790.022077:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bae2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.022082:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bae2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.022096:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bae9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.022102:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bae9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.022108:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bae9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.022112:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166790.022115:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bae9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.022120:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bae9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.022128:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff9ee34c9faf00) 00010000:00010000:1.0:1762166790.022130:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166790.022132:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bae9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166790.022138:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bae9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:1.0:1762166790.022220:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:38418:x1847765444261376:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 649us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166790.022227:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2471 00010000:00010000:2.0:1762166790.504367:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1762166790.884935:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968923 is committed 00000001:00100000:3.0:1762166790.884999:0:5777:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of da9d93ea-d728-4b01-a76b-4b4ff9c19538 00000001:00080000:3.0:1762166790.885015:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968928 is committed 00000004:00080000:3.0:1762166790.885048:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 100 committed 00000004:00080000:3.0:1762166790.885069:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 98 committed 00000001:00100000:3.0:1762166790.885113:0:5777:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a8dc1ab7-d2d2-4e76-ade8-41da4d39281c 00000001:00080000:3.0:1762166790.885123:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968908 is committed 00000020:00000080:3.0:1762166790.885132:0:5777:0:(genops.c:904:class_export_put()) final put ffff9ee36e070800/a8dc1ab7-d2d2-4e76-ade8-41da4d39281c 00000020:00000080:2.0:1762166790.885280:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee36e070800/a8dc1ab7-d2d2-4e76-ade8-41da4d39281c for lustre-MDT0000 00000100:00100000:0.0:1762166790.885422:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451916160:0@lo:6:osp-syn-0-0.0 00000020:00000080:2.0:1762166790.885427:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee36e077800 for lustre-MDT0000 00000100:00100000:3.0:1762166790.885506:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451916288:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762166790.885518:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166790.885589:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166790.885635:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451916160 00000100:00100000:0.0:1762166790.885645:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451916160 00000100:00100000:2.0:1762166790.885693:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451916288 00000100:00100000:2.0:1762166790.885703:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451916288 00000100:00100000:0.0:1762166790.885747:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:0.0:1762166790.885795:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765451916160:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762166790.885803:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:2.0:1762166790.885817:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765451916288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1762166790.885824:0:12400:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:78 count 1 00002000:00080000:2.0:1762166790.885844:0:6533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:75 count 1 00002000:00010000:0.0:1762166790.885859:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x4e:0x0] initial LVB size: 10485760, mtime: 0x69088802, atime: 0x0, ctime: 0x69088802, blocks: 0x5007 00010000:00010000:0.0:1762166790.885872:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9baf0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166790.885896:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x4b:0x0] initial LVB size: 10485760, mtime: 0x69088801, atime: 0x69088801, ctime: 0x69088802, blocks: 0x5007 00010000:00010000:2.0:1762166790.885920:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9baf7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166790.885923:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166790.885928:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166790.885935:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9baf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166790.885941:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166790.885945:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166790.885954:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9baf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166790.885958:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9baf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166790.885979:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9baf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166790.885986:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9baf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166790.885988:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9baf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166790.886027:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9baf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166790.886039:0:12400:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166790.886041:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9baf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166790.886073:0:6533:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1762166790.886077:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1762166790.886088:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9baf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166790.886100:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166790.886106:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9baf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166790.886117:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9baf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166790.886141:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9baf0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166790.886150:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9baf0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166790.886175:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166790.886180:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9baf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166790.886200:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166790.886204:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9baf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166790.886211:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9baf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166790.886221:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9baf7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166790.886227:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9baf7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166790.886249:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166790.886252:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166790.886254:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1762166790.886298:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1762166790.886306:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1762166790.887022:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166790.887191:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765451916160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1430us (1675us total) trans 21474836710 rc 0/0 00000100:00100000:0.0:1762166790.887206:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000004:00080000:1.0:1762166790.887304:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fa98000/2, rc 0, transno 21474836710 00000100:00100000:1.0:1762166790.887318:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451916160:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166790.888173:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765451916288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2356us (2581us total) trans 17179869385 rc 0/0 00000100:00100000:3.0:1762166790.888185:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000004:00080000:3.0:1762166790.888336:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24354c700/2, rc 0, transno 17179869385 00000100:00100000:3.0:1762166790.888343:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451916288:0@lo:6:osp-syn-1-0.0 00000001:00100000:0.0:1762166790.894415:0:22362:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of da9d93ea-d728-4b01-a76b-4b4ff9c19538 00000001:00080000:0.0:1762166790.894436:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836708 is committed 00000001:00080000:0.0:1762166790.894448:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836709 is committed 00000001:00100000:0.0:1762166790.894458:0:22362:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a8dc1ab7-d2d2-4e76-ade8-41da4d39281c 00000001:00080000:0.0:1762166790.894468:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836707 is committed 00000020:00000080:0.0:1762166790.894472:0:22362:0:(genops.c:904:class_export_put()) final put ffff9ee34a537000/a8dc1ab7-d2d2-4e76-ade8-41da4d39281c 00000020:00000080:3.0:1762166790.894514:0:38:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee34a537000/a8dc1ab7-d2d2-4e76-ade8-41da4d39281c for lustre-OST0000 00000020:00000080:3.0:1762166790.894570:0:38:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee34a530800 for lustre-OST0000 00000001:00080000:0.0:1762166790.895894:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869382 is committed 00000001:00080000:0.0:1762166790.895907:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869384 is committed 00000001:00100000:0.0:1762166790.895912:0:23749:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of da9d93ea-d728-4b01-a76b-4b4ff9c19538 00000001:00100000:0.0:1762166790.895972:0:23749:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a8dc1ab7-d2d2-4e76-ade8-41da4d39281c 00000020:00000080:0.0:1762166790.895975:0:23749:0:(genops.c:904:class_export_put()) final put ffff9ee36e642800/a8dc1ab7-d2d2-4e76-ade8-41da4d39281c 00000020:00000080:2.0:1762166790.896046:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee36e642800/a8dc1ab7-d2d2-4e76-ade8-41da4d39281c for lustre-OST0001 00000020:00000080:2.0:1762166790.896082:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee36e647000 for lustre-OST0001 00000100:00100000:2.0:1762166791.269054:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166791.269678:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166791.269840:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166791.269903:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166791.269918:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444261632 00000100:00100000:0.0:1762166791.269930:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444261632 00000100:00100000:0.0:1762166791.269998:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 209 00000100:00080000:2.0:1762166791.270006:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762166791.270011:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444261632:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762166791.270056:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444261760 00000100:00100000:3.0:1762166791.270062:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444261760 00000100:00100000:0.0:1762166791.270088:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444261632:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 80us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166791.270098:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 209 00000100:00100000:3.0:1762166791.270103:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444261888 00000100:00100000:3.0:1762166791.270112:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444261888 00000100:00100000:3.0:1762166791.270146:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 166 00000100:00100000:3.0:1762166791.270154:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+5:2361:x1847765444261760:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762166791.270188:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+5:2361:x1847765444261760:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 35us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166791.270194:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 166 00000100:00100000:3.0:1762166791.270208:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 167 00000100:00100000:3.0:1762166791.270216:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2361:x1847765444261888:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762166791.270244:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2361:x1847765444261888:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 29us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166791.270251:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 167 00000100:00080000:0.0:1762166791.270292:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1762166791.270297:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166791.270307:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444261504 00000100:00100000:1.0:1762166791.270312:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444261504 00000100:00100000:1.0:1762166791.270339:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 493 00000100:00100000:1.0:1762166791.270356:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2361:x1847765444261504:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:1.0:1762166791.270400:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2361:x1847765444261504:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 54us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166791.270408:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 493 00000100:00100000:0.0:1762166791.336091:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1762166791.336116:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1847765451916544:0@lo:400:kworker.0 00000100:00100000:0.0:1762166791.336178:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166791.336198:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765451916928:0@lo:400:kworker.0 00000100:00100000:2.0:1762166791.336208:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451916672:0@lo:400:kworker.0 00000100:00100000:3.0:1762166791.336213:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451916800:0@lo:400:kworker.0 00000100:00100000:0.0:1762166791.336237:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f1807908-b95d-4027-b65a-753b7d69e554:3294:1847765451916416:0@lo:400:kworker.0 00000100:00100000:1.0:1762166791.336265:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166791.336269:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166791.336274:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166791.336290:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451916544 00000100:00100000:3.0:1762166791.336299:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451916544 00000100:00100000:1.0:1762166791.336307:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762166791.336317:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1847765451917056:0@lo:400:kworker.0 00000100:00100000:2.0:1762166791.336332:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451916928 00000100:00100000:2.0:1762166791.336338:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451916928 00000100:00100000:0.0:1762166791.336339:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451916416 00000100:00100000:0.0:1762166791.336342:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451916416 00000100:00100000:3.0:1762166791.336351:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1762166791.336352:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166791.336367:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1847765451916544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166791.336375:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1762166791.336384:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3294:x1847765451916416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166791.336419:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451917056 00000100:00100000:2.0:1762166791.336423:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451917056 00000100:00100000:3.0:1762166791.336435:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1847765451916544:12345-0@lo:400:kworker.0 Request processed in 72us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166791.336436:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3294:x1847765451916416:12345-0@lo:400:kworker.0 Request processed in 52us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166791.336443:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00080000:1.0:1762166791.336450:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762166791.336451:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1762166791.336455:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1762166791.336456:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1847765451916928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166791.336480:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1762166791.336494:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1847765451917056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166791.336499:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1847765451916928:12345-0@lo:400:kworker.0 Request processed in 45us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166791.336506:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1762166791.336511:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166791.336514:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1847765451916544:0@lo:400:kworker.0 00000100:00100000:0.0:1762166791.336529:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f1807908-b95d-4027-b65a-753b7d69e554:3294:1847765451916416:0@lo:400:kworker.0 00000100:00100000:2.0:1762166791.336537:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451916672 00000100:00100000:2.0:1762166791.336540:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451916672 00000100:00100000:1.0:1762166791.336547:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1847765451917056:12345-0@lo:400:kworker.0 Request processed in 58us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166791.336555:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1762166791.336570:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451916800 00000100:00100000:3.0:1762166791.336576:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1762166791.336576:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451916800 00000100:00100000:3.0:1762166791.336590:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765451916672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166791.336597:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1847765451917056:0@lo:400:kworker.0 00000100:00100000:2.0:1762166791.336601:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1762166791.336611:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765451916800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166791.336614:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765451916928:0@lo:400:kworker.0 00000100:00100000:3.0:1762166791.336645:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765451916672:12345-0@lo:400:kworker.0 Request processed in 58us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166791.336656:0:3295:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836709 gen 2 00000100:00100000:2.0:1762166791.336658:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765451916800:12345-0@lo:400:kworker.0 Request processed in 48us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166791.336665:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000004:00080000:1.0:1762166791.336672:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550ea00, transno 21474836708 00000100:00100000:0.0:1762166791.336673:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869384 gen 2 00000100:00100000:2.0:1762166791.336674:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000004:00080000:0.0:1762166791.336679:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240ad80, transno 17179869381 00000004:00080000:0.0:1762166791.336691:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc59500, transno 17179869383 00000100:00100000:1.0:1762166791.336702:0:3295:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee37fa98000 x1847765451916160/t21474836710(21474836710) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166806 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1762166791.336709:0:3296:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee24354c700 x1847765451916288/t17179869385(17179869385) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166806 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1762166791.336719:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451916672:0@lo:400:kworker.0 00000100:00100000:0.0:1762166791.336724:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451916800:0@lo:400:kworker.0 00010000:00010000:2.0:1762166791.528108:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166792.551945:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166793.200446:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166793.200524:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444262144 00000100:00100000:1.0:1762166793.200537:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444262144 00000100:00100000:1.0:1762166793.200616:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2472 00000100:00080000:0.0:1762166793.200617:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166793.200632:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:39121:x1847765444262144:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166793.200656:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166793.200674:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bafe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a4f expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166793.200744:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bb05 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.200759:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bb05 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.200793:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bb05 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.200808:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb0c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.200815:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb0c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.200822:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb0c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.201207:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bb05 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.201228:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bb05 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.201235:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bb05 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.201241:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166793.201245:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bb05 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.201253:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bb05 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.201265:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166793.201269:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166793.201273:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bb05 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.201280:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bb05 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.201294:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb0c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.201299:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb0c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.201305:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb0c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.201311:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166793.201313:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb0c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.201328:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb0c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.201336:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xd6c8d217 (ffff9ee34c9faf00) 00010000:00010000:1.0:1762166793.201339:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166793.201341:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb0c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.201347:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb0c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.201380:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bafe lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a4f expref: 12 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166793.201389:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166793.201392:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166793.201396:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bafe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a4f expref: 12 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166793.201405:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453600, rc 0) 00000100:00100000:1.0:1762166793.201468:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:39121:x1847765444262144:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 842us (1035us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166793.201476:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2472 00000100:00100000:3.0:1762166793.203021:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166793.203077:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444262272 00000100:00100000:1.0:1762166793.203088:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444262272 00000100:00100000:1.0:1762166793.203147:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2473 00000100:00100000:1.0:1762166793.203157:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:39121:x1847765444262272:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:1.0:1762166793.203214:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bb13 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203237:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bb13 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203245:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bb13 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203254:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb1a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203258:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb1a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203262:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb1a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203327:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bb21 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203331:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bb21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203335:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bb21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:1.0:1762166793.203360:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x4:0x0]: returning size 0 00000004:00200000:1.0:1762166793.203363:0:5757:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166793.203371:0:5757:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bb21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203379:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bb13 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203383:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bb13 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203394:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bb13 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203398:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166793.203400:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bb13 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203404:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bb13 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203413:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166793.203415:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166793.203418:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bb13 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203424:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bb13 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203436:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb1a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203441:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb1a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203446:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb1a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203451:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166793.203454:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb1a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203459:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb1a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203476:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xd6c8d217 (ffff9ee34c9fa300) 00010000:00010000:1.0:1762166793.203479:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166793.203482:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb1a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203488:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb1a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203504:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bb21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203509:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bb21 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203515:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bb21 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203519:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166793.203522:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bb21 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203527:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bb21 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203535:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4:0x0].0x0 (ffff9ee34c9faa00) 00010000:00010000:1.0:1762166793.203537:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166793.203539:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bb21 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166793.203544:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bb21 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00000100:00100000:1.0:1762166793.203611:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:39121:x1847765444262272:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 455us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166793.203624:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2473 00000100:00100000:1.0:1762166793.384076:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451917184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762166793.384206:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166793.384265:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451917184 00000100:00100000:2.0:1762166793.384287:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451917184 00000100:00080000:0.0:1762166793.384344:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166793.384367:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1762166793.384376:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765451917184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1762166793.384413:0:8383:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3847225344 avail 3845128192 00000100:00100000:2.0:1762166793.384787:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765451917184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 385us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166793.384795:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1762166793.384889:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451917184:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1762166793.576328:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166793.896047:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451917312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762166793.896118:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166793.896172:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451917312 00000100:00100000:2.0:1762166793.896180:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451917312 00000100:00080000:0.0:1762166793.896221:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166793.896244:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1762166793.896254:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765451917312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1762166793.896288:0:8383:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3846176768 avail 3844079616 00000100:00100000:2.0:1762166793.896343:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765451917312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166793.896350:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1762166793.896471:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451917312:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1762166794.600041:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166795.365547:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166795.365604:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166795.365655:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444262400 00000100:00100000:2.0:1762166795.365663:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444262400 00002000:00100000:2.0:1762166795.365723:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x4f:0x0] (0->3368) req@ffff9ee3819b9180 x1847765444262400/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:581/0 lens 3864/0 e 0 to 0 dl 1762166806 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166795.365735:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee3819b9180 with x1847765444262400 ext(0->3368) 00002000:00010000:2.0:1762166795.365740:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee3819b9180 00000100:00100000:2.0:1762166795.365789:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 929 00000100:00100000:2.0:1762166795.365799:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2359:x1847765444262400:12345-192.168.203.35@tcp:4:lfs.0 00000100:00080000:0.0:1762166795.365879:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166795.365907:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444262528 00000100:00100000:1.0:1762166795.365913:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444262528 00000100:00100000:1.0:1762166795.365952:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 876 00000100:00100000:1.0:1762166795.365962:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2359:x1847765444262528:12345-192.168.203.35@tcp:16:kworker.0 00000100:00100000:1.0:1762166795.366070:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2359:x1847765444262528:12345-192.168.203.35@tcp:16:kworker.0 Request processed in 110us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166795.366078:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 876 00000100:00100000:2.0:1762166795.366258:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2359:x1847765444262400:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 460us (655us total) trans 17179869386 rc 0/0 00000100:00100000:2.0:1762166795.366275:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 929 00002000:00100000:2.0:1762166795.366283:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x4f:0x0] (0->3368) req@ffff9ee3819b9180 x1847765444262400/t17179869386(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:581/0 lens 3864/448 e 0 to 0 dl 1762166806 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166795.366292:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee3819b9180 with x1847765444262400 ext(0->3368) 00002000:00010000:2.0:1762166795.366295:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee3819b9180 00010000:00010000:3.0:1762166795.623939:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1762166795.970571:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869386 is committed 00000001:00080000:0.0:1762166795.970587:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869385 is committed 00000001:00080000:3.0:1762166795.973380:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836710 is committed 00000100:00100000:3.0:1762166796.191174:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166796.191252:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444262656 00000100:00100000:1.0:1762166796.191262:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444262656 00000100:00080000:0.0:1762166796.191627:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166796.192103:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2474 00000100:00100000:2.0:1762166796.192116:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:39822:x1847765444262656:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:2.0:1762166796.192137:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166796.192155:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bb28 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a56 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166796.192212:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb2f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192225:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb2f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192236:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb2f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192248:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb36 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192254:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb36 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192260:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb36 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192356:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bb3d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192375:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bb3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192381:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bb3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:2.0:1762166796.192411:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2:0x0]: returning size 0 00000004:00200000:2.0:1762166796.192415:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166796.192430:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bb3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192439:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bb3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192447:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb2f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192453:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb2f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192458:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb2f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192463:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166796.192467:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb2f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192473:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb2f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192581:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:2.0:1762166796.192585:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166796.192591:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb2f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192603:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb2f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192618:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb36 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192623:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb36 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192628:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb36 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192633:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166796.192636:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb36 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192642:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb36 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192650:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xcaa2b802 (ffff9ee360714700) 00010000:00010000:2.0:1762166796.192653:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166796.192656:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb36 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192661:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb36 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.192691:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bb28 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a56 expref: 13 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166796.192704:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bb3d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a56 expref: 12 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166796.192719:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff9ee360714500) 00010000:00010000:2.0:1762166796.192720:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166796.192722:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15c00, rc 0) 00000100:00100000:2.0:1762166796.193197:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:39822:x1847765444262656:12345-192.168.203.35@tcp:101:rm.0 Request processed in 1082us (2030us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166796.193208:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2474 00000100:00100000:0.0:1762166796.196016:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166796.196095:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444262784 00000100:00100000:1.0:1762166796.196104:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444262784 00000100:00100000:1.0:1762166796.196175:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 877 00000100:00100000:1.0:1762166796.196187:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+5:2358:x1847765444262784:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:1.0:1762166796.196203:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166796.196221:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a5d expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166796.196494:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166796.196512:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166796.196514:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166796.196524:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a5d expref: 6 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166796.196559:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a5d expref: 6 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166796.196570:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453400, rc 0) 00000100:00100000:1.0:1762166796.196622:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2358:x1847765444262784:12345-192.168.203.35@tcp:101:rm.0 Request processed in 438us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166796.196628:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 877 00000100:00080000:0.0:1762166796.196734:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166796.200633:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166796.200722:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444263040 00000100:00100000:2.0:1762166796.200730:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444263040 00000100:00100000:2.0:1762166796.200805:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2475 00000100:00100000:2.0:1762166796.200814:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:39822:x1847765444263040:12345-192.168.203.35@tcp:36:rm.0 00010000:00010000:2.0:1762166796.200878:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166796.200902:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bb3d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a56 expref: 12 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166796.200921:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff9ee360714500) 00010000:00010000:2.0:1762166796.200932:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166796.200952:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bb4b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.200963:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bb4b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.200972:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bb4b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.200983:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb52 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.200989:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb52 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.201007:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb52 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.201120:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb59 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.201128:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb59 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.201134:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb59 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000040:00080000:2.0:1762166796.201860:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].109, 64 off17080 00000004:00080000:2.0:1762166796.201870:0:6558:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 416994106885ns, next at 417994104690ns, rc = 0 00000040:00080000:2.0:1762166796.201912:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].108, 64 off16928 00000004:00080000:2.0:1762166796.201918:0:6558:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 416994155153ns, next at 417994154253ns, rc = 0 00000040:00080000:2.0:1762166796.201934:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].110, 64 off17144 00000040:00080000:2.0:1762166796.201947:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].111, 64 off17208 00000040:00080000:2.0:1762166796.201960:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].109, 64 off16992 00000040:00080000:2.0:1762166796.201973:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].112, 64 off17272 00000040:00080000:2.0:1762166796.201987:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].110, 64 off17056 00010000:00010000:2.0:1762166796.202062:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bb60 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202071:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bb60 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202077:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bb60 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202084:0:6558:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bb60 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202100:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bb60 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202105:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bb60 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202129:0:6558:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166796.202144:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb59 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202150:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb59 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202159:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb59 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202164:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166796.202167:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb59 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202174:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb59 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202183:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff9ee360714e00) 00010000:00010000:2.0:1762166796.202186:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1762166796.202189:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb59 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202195:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bb59 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202247:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bb4b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202261:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bb4b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202266:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bb4b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202271:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166796.202273:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bb4b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202279:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bb4b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202286:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:2.0:1762166796.202288:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166796.202291:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bb4b lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.202295:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bb4b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000004:00010000:2.0:1762166796.202303:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009048c545 reply state 00000000c65122d7 transno 4294968929 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb52 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:2.0:1762166796.202310:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166796.202385:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:39822:x1847765444263040:12345-192.168.203.35@tcp:36:rm.0 Request processed in 1571us (1758us total) trans 4294968929 rc 0/0 00000100:00100000:2.0:1762166796.202392:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2475 00010000:00010000:3.0:1762166796.203147:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166796.203154:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bb60 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.203161:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166796.203164:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bb60 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.203169:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bb60 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.203179:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff9ee360714e00) 00010000:00010000:3.0:1762166796.203182:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166796.203184:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bb60 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.203188:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bb60 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.203200:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166796.203202:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166796.203203:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166796.203984:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb52 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.203992:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb52 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.204002:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb52 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.204006:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166796.204008:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb52 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.204012:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb52 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.204018:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xcaa2b802 (ffff9ee360714700) 00010000:00010000:2.0:1762166796.204020:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166796.204022:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb52 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.204026:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bb52 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:1.0:1762166796.204661:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166796.204720:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444263168 00000100:00100000:2.0:1762166796.204727:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444263168 00000100:00100000:2.0:1762166796.204823:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2476 00000100:00100000:2.0:1762166796.204833:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:39822:x1847765444263168:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:2.0:1762166796.204863:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166796.204878:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9bb67 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a64 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166796.204936:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bb6e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.204947:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bb6e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.204966:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bb6e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.204978:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bb75 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.204984:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bb75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.204989:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bb75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205123:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bb7c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205132:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bb7c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205136:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bb7c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:2.0:1762166796.205238:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x4:0x0]: returning size 0 00000004:00200000:2.0:1762166796.205241:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166796.205257:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bb7c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205267:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bb7c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205273:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bb6e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205279:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bb6e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205294:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bb6e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205299:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166796.205303:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bb6e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205309:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bb6e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205318:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:2.0:1762166796.205322:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166796.205325:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bb6e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205331:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bb6e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205343:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bb75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205349:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bb75 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205354:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bb75 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205359:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166796.205362:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bb75 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205367:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bb75 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205385:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xd6c8d217 (ffff9ee360714100) 00010000:00010000:2.0:1762166796.205387:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166796.205390:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bb75 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205395:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bb75 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.205423:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9bb67 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a64 expref: 14 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166796.205437:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bb7c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a64 expref: 13 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166796.205445:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4:0x0].0x0 (ffff9ee360714200) 00010000:00010000:2.0:1762166796.205447:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166796.205450:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15600, rc 0) 00000100:00100000:2.0:1762166796.205515:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:39822:x1847765444263168:12345-192.168.203.35@tcp:101:rm.0 Request processed in 683us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166796.205523:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2476 00000100:00100000:3.0:1762166796.207234:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166796.207290:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444263296 00000100:00100000:1.0:1762166796.207297:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444263296 00000100:00100000:1.0:1762166796.207345:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 878 00000100:00100000:1.0:1762166796.207355:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2360:x1847765444263296:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:1.0:1762166796.207367:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166796.207382:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb83 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a6b expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166796.207664:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166796.207682:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166796.207684:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166796.207693:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a6b expref: 7 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166796.207708:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a6b expref: 7 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166796.207736:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453a00, rc 0) 00000100:00100000:1.0:1762166796.208934:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2360:x1847765444263296:12345-192.168.203.35@tcp:101:rm.0 Request processed in 1576us (1701us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166796.208943:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 878 00000100:00100000:1.0:1762166796.212299:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166796.212348:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444263552 00000100:00100000:3.0:1762166796.212359:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444263552 00000100:00100000:3.0:1762166796.212427:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2477 00000100:00100000:3.0:1762166796.212445:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:39822:x1847765444263552:12345-192.168.203.35@tcp:36:rm.0 00010000:00010000:3.0:1762166796.212500:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166796.212528:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bb7c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a64 expref: 13 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.212555:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4:0x0].0x0 (ffff9ee360714200) 00010000:00010000:3.0:1762166796.212567:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166796.212588:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bb8a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.212611:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bb8a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.212622:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bb8a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.212650:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bb91 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.212658:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bb91 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.212664:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bb91 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.212793:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bb98 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.212804:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bb98 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.212823:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bb98 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000040:00080000:3.0:1762166796.214265:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].113, 64 off17336 00000040:00080000:3.0:1762166796.214295:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].111, 64 off17120 00000040:00080000:3.0:1762166796.214313:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].114, 64 off17400 00000040:00080000:3.0:1762166796.214326:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].115, 64 off17464 00000040:00080000:3.0:1762166796.214340:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].112, 64 off17184 00000040:00080000:3.0:1762166796.214352:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].116, 64 off17528 00000040:00080000:3.0:1762166796.214365:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].113, 64 off17248 00010000:00010000:3.0:1762166796.214434:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bb9f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.214445:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bb9f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.214454:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bb9f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.214461:0:6558:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bb9f lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.214467:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bb9f lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.214472:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bb9f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.214489:0:6558:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166796.214505:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bb98 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.214510:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bb98 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.214515:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166796.214523:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bb9f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.214545:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bb98 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.214546:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166796.214555:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166796.214555:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bb9f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.214561:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bb98 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.214569:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bb9f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.214571:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bb98 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.214581:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:3.0:1762166796.214585:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1762166796.214589:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bb98 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.214594:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:3.0:1762166796.214595:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bb98 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.214601:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166796.214607:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bb9f lrc: 1/0,0 mode: --/PW res: [0x200000404:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.214613:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bb9f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.214628:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166796.214631:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166796.214633:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166796.214667:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bb8a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.214673:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bb8a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.214678:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bb8a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.214682:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc67000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166796.214685:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bb8a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.214689:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bb8a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.214705:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:3.0:1762166796.214707:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166796.214710:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bb8a lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.214715:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bb8a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000004:00010000:3.0:1762166796.214722:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ee5ecf5e reply state 00000000a9a06805 transno 4294968930 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bb91 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166796.214729:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166796.214817:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:39822:x1847765444263552:12345-192.168.203.35@tcp:36:rm.0 Request processed in 2374us (2524us total) trans 4294968930 rc 0/0 00000100:00100000:3.0:1762166796.214825:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2477 00010000:00010000:1.0:1762166796.216219:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bb91 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166796.216233:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bb91 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166796.216239:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bb91 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166796.216245:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc67600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166796.216249:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bb91 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166796.216255:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bb91 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166796.216267:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xd6c8d217 (ffff9ee343a13f00) 00010000:00010000:1.0:1762166796.216271:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166796.216274:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bb91 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166796.216279:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bb91 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:1.0:1762166796.225036:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166796.225213:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444263680 00000100:00100000:3.0:1762166796.225224:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444263680 00000100:00100000:3.0:1762166796.225286:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2478 00000100:00100000:3.0:1762166796.225297:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:39823:x1847765444263680:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166796.225331:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166796.225351:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bba6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a72 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.225434:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bbad lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225456:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bbad lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225471:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bbad lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225492:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbb4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225500:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225505:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225565:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bbad lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225570:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bbad lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225576:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bbad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225582:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166796.225585:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bbad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225592:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bbad lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225603:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:3.0:1762166796.225606:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166796.225610:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bbad lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225616:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bbad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225628:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225639:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbb4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225644:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbb4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225649:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166796.225652:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbb4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225658:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbb4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225665:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xcaa2b802 (ffff9ee343a13800) 00010000:00010000:3.0:1762166796.225667:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166796.225670:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbb4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225675:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbb4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.225706:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bba6 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a72 expref: 14 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.225716:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:3.0:1762166796.225718:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166796.225722:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bba6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a72 expref: 14 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.225729:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fc67000, rc 0) 00000100:00100000:3.0:1762166796.225854:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:39823:x1847765444263680:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 558us (825us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166796.225868:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2478 00000100:00100000:0.0:1762166796.227479:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166796.227520:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444263808 00000100:00100000:3.0:1762166796.227527:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444263808 00000100:00100000:1.0:1762166796.228152:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2479 00000100:00100000:1.0:1762166796.228166:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:39823:x1847765444263808:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166796.228182:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166796.228198:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bbbb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a79 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.228251:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bbc2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228263:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228273:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228286:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bbc9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228292:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bbc9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228299:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bbc9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228353:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228359:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bbc2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228365:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bbc2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228371:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166796.228387:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bbc2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228395:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bbc2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228406:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166796.228409:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166796.228413:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bbc2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228423:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bbc2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228438:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bbc9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228445:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bbc9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228450:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bbc9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228458:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166796.228461:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bbc9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228467:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bbc9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228474:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xcaa2b802 (ffff9ee34c9fa200) 00010000:00010000:1.0:1762166796.228477:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166796.228479:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bbc9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228495:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bbc9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.228560:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bbbb lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a79 expref: 14 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.228569:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166796.228571:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166796.228575:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bbbb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a79 expref: 14 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.228583:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453000, rc 0) 00000100:00100000:1.0:1762166796.228645:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:39823:x1847765444263808:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 483us (1182us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166796.228651:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2479 00000100:00100000:0.0:1762166796.230860:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166796.230910:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444263936 00000100:00100000:1.0:1762166796.230919:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444263936 00000100:00100000:1.0:1762166796.230974:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2480 00000100:00100000:1.0:1762166796.230983:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:39823:x1847765444263936:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166796.231001:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166796.231018:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bbd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a80 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.231072:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bbd7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.231084:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.231105:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:1.0:1762166796.231162:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1:0x0]: returning size 11776 00000004:00200000:1.0:1762166796.231167:0:5757:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166796.231187:0:5757:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.231209:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bbd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a80 expref: 15 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.231230:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bbd7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a80 expref: 14 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.231238:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166796.231240:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762166796.231243:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453600, rc 0) 00000100:00100000:1.0:1762166796.231292:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:39823:x1847765444263936:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 309us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166796.231300:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2480 00000100:00100000:0.0:1762166796.233731:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166796.233911:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444264064 00000100:00100000:1.0:1762166796.233920:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444264064 00000100:00100000:1.0:1762166796.233982:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2481 00000100:00100000:1.0:1762166796.233993:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:39823:x1847765444264064:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166796.234012:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166796.234028:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bbde lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a87 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.234084:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bbe5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234114:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bbe5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234125:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bbe5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234139:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bbec lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234146:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bbec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234152:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bbec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234209:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bbe5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234216:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bbe5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234223:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bbe5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234228:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166796.234232:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bbe5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234240:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bbe5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234252:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166796.234255:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166796.234265:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bbe5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234271:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bbe5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234283:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bbec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234288:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bbec lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234292:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bbec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234296:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166796.234298:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bbec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234303:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bbec lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234309:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xcaa2b802 (ffff9ee34c9fae00) 00010000:00010000:1.0:1762166796.234311:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166796.234313:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bbec lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234318:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bbec lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.234346:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bbde lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a87 expref: 15 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.234354:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166796.234362:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166796.234366:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bbde lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a87 expref: 15 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.234374:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452c00, rc 0) 00000100:00100000:1.0:1762166796.234432:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:39823:x1847765444264064:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 442us (709us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166796.234439:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2481 00000100:00100000:0.0:1762166796.236585:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166796.237018:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444264320 00000100:00100000:3.0:1762166796.237026:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444264320 00000100:00100000:3.0:1762166796.237079:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2482 00000100:00100000:3.0:1762166796.237088:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:39823:x1847765444264320:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166796.237109:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166796.237112:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1762166796.237134:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bbd7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a80 expref: 14 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.237151:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:3.0:1762166796.237155:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166796.237167:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bbf3 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a8e expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.237274:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbfa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.237286:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbfa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.237295:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbfa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.237304:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bc01 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.237308:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bc01 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.237322:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bc01 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.237643:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bc08 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.237649:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bc08 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.237654:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bc08 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166796.237660:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5:0x0]: returning size 0 00010000:00010000:3.0:1762166796.237677:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbfa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.237681:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbfa lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.237685:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbfa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.237689:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166796.237691:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbfa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.237695:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbfa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.237699:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:3.0:1762166796.237701:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166796.237704:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbfa lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.237714:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bbfa lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000004:00010000:3.0:1762166796.237721:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000087aa541a reply state 000000009b610d54 transno 4294968931 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bc01 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166796.237726:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1762166796.237742:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bbf3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a8e expref: 16 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.237749:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bc08 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a8e expref: 15 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.237754:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5:0x0].0x0 (ffff9ee343a13000) 00010000:00010000:3.0:1762166796.237755:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166796.237757:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fc66a00, rc 0) 00000100:00100000:3.0:1762166796.237840:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:39823:x1847765444264320:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 752us (1260us total) trans 4294968931 rc 0/0 00000100:00100000:3.0:1762166796.237855:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2482 00010000:00010000:2.0:1762166796.239701:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bc01 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.239716:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bc01 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.239722:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bc01 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.239728:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166796.239732:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bc01 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.239739:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bc01 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.239752:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xcaa2b802 (ffff9ee343a13800) 00010000:00010000:2.0:1762166796.239754:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166796.239757:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bc01 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.239791:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bc01 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166796.240190:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166796.240455:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444264576 00000100:00100000:3.0:1762166796.240463:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444264576 00000100:00100000:3.0:1762166796.240838:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2483 00000100:00100000:3.0:1762166796.240857:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:39823:x1847765444264576:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166796.240878:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166796.240898:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9bc16 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a95 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.240992:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc1d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.241014:0:6558:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bc08 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a8e expref: 16 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.241022:0:6558:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc1d lrc: 4/0,1 mode: --/EX res: [0x200000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.241056:0:6558:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bc08 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a8e expref: 16 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.241069:0:6558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bc08 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a8e expref: 16 pid: 6558 timeout: 517 lvb_type: 0 00000100:00100000:3.0:1762166796.241083:0:6558:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee3819bbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451917440:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166796.241173:0:6558:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242737240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166796.243057:0:6558:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee3819bbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451917440:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166796.243082:0:6558:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc1d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166796.243162:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166796.243220:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444264704 00000100:00100000:2.0:1762166796.243228:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444264704 00010000:00010000:2.0:1762166796.243266:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bc08 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a8e expref: 17 pid: 6558 timeout: 517 lvb_type: 0 00000100:00100000:2.0:1762166796.243306:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 551 00000100:00100000:2.0:1762166796.243317:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444264704:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166796.243329:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166796.243337:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bc08 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a8e expref: 17 pid: 6558 timeout: 517 lvb_type: 0 00010000:00010000:2.0:1762166796.243349:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bc08 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a8e expref: 17 pid: 6558 timeout: 517 lvb_type: 0 00010000:00010000:2.0:1762166796.243368:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bc08 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a8e expref: 17 pid: 6558 timeout: 517 lvb_type: 0 00010000:00010000:2.0:1762166796.243384:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5:0x0].0x0 (ffff9ee343a13000) 00010000:00010000:2.0:1762166796.243388:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc1d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.243395:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc1d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.243402:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc1d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166796.243436:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166796.243472:0:6558:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc1d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.243480:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc1d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:2.0:1762166796.243487:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444264704:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 171us (325us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166796.243498:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5:0x0]: returning size 0 00000100:00100000:2.0:1762166796.243511:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 551 00000004:00080000:3.0:1762166796.243923:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x57:0x0], index 0: 0 00000004:00080000:3.0:1762166796.243935:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x53:0x0], index 1: 0 00000004:00080000:3.0:1762166796.243940:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x58:0x0], index 0: 0 00000004:00080000:3.0:1762166796.243946:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x59:0x0], index 0: 0 00000004:00080000:3.0:1762166796.243959:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x54:0x0], index 1: 0 00000004:00080000:3.0:1762166796.243964:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5a:0x0], index 0: 0 00000004:00080000:3.0:1762166796.243969:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x55:0x0], index 1: 0 00010000:00010000:3.0:1762166796.244136:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc1d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.244146:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc1d lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.244152:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc1d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.244158:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc67600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166796.244161:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc1d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.244168:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc1d lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.244178:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5:0x0].0x0 (ffff9ee343a13000) 00010000:00010000:3.0:1762166796.244181:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166796.244184:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc1d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.244189:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc1d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.244236:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9bc16 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a95 expref: 16 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.244245:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:3.0:1762166796.244248:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166796.244257:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9bc16 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a95 expref: 16 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.244266:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fc66200, rc 0) 00000100:00100000:3.0:1762166796.244309:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:39823:x1847765444264576:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3454us (4121us total) trans 4294968932 rc 301/301 00000100:00100000:3.0:1762166796.244316:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2483 00000100:00100000:0.0:1762166796.246722:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166796.246867:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444264960 00000100:00100000:2.0:1762166796.246875:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444264960 00000100:00100000:2.0:1762166796.246924:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 738 00000100:00100000:2.0:1762166796.246935:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:39823:x1847765444264960:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166796.247242:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:39823:x1847765444264960:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 307us (526us total) trans 4294968933 rc 0/0 00000100:00100000:2.0:1762166796.247250:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 738 00000100:00100000:0.0:1762166796.249639:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166796.249714:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444265216 00000100:00100000:2.0:1762166796.249723:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444265216 00000100:00100000:2.0:1762166796.250356:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 739 00000100:00100000:2.0:1762166796.250367:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:39823:x1847765444265216:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166796.250558:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:39823:x1847765444265216:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 193us (925us total) trans 4294968934 rc 0/0 00000100:00100000:2.0:1762166796.250566:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 739 00000100:00100000:1.0:1762166796.255912:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166796.255985:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444265472 00000100:00100000:3.0:1762166796.255995:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444265472 00000100:00100000:3.0:1762166796.256051:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2484 00000100:00100000:3.0:1762166796.256061:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:39824:x1847765444265472:12345-192.168.203.35@tcp:101:bash.0 00010000:00010000:3.0:1762166796.256083:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166796.256102:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9bc2b lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a9c expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.256189:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc32 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.256203:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.256212:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166796.256222:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x3:0x0]: returning size 21 00010000:00010000:3.0:1762166796.256382:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9bc2b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a9c expref: 20 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.256398:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc32 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a9c expref: 19 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.256423:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3:0x0].0x0 (ffff9ee36062b600) 00010000:00010000:3.0:1762166796.256425:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166796.256429:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fc67600, rc 0) 00000100:00100000:3.0:1762166796.256485:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:39824:x1847765444265472:12345-192.168.203.35@tcp:101:bash.0 Request processed in 426us (581us total) trans 4294968935 rc 0/0 00000100:00100000:3.0:1762166796.256492:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2484 00000100:00100000:0.0:1762166796.258616:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166796.258840:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444265728 00000100:00100000:3.0:1762166796.258857:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444265728 00000100:00100000:3.0:1762166796.258893:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2485 00000100:00100000:3.0:1762166796.258899:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:39824:x1847765444265728:12345-192.168.203.35@tcp:36:bash.0 00010000:00010000:3.0:1762166796.258938:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1762166796.258956:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc32 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a9c expref: 19 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.258971:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9b9f4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909fb expref: 18 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.258977:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3:0x0].0x0 (ffff9ee36062b600) 00010000:00010000:3.0:1762166796.258980:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166796.259185:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bc40 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.259197:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bc40 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.259205:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bc40 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000001:00080000:3.0:1762166796.259278:0:6558:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968936 00000004:00010000:3.0:1762166796.259303:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000915b875d reply state 0000000013723f83 transno 4294968937 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bc40 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166796.259311:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166796.259393:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:39824:x1847765444265728:12345-192.168.203.35@tcp:36:bash.0 Request processed in 492us (781us total) trans 4294968937 rc 0/0 00000100:00100000:3.0:1762166796.259400:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2485 00000020:00080000:3.0:1762166796.259405:0:6558:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762166796.261014:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bc40 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166796.261015:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166796.261026:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bc40 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166796.261033:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bc40 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166796.261037:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc67000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166796.261041:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bc40 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166796.261046:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bc40 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166796.261056:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3:0x0].0x0 (ffff9ee36062b600) 00010000:00010000:1.0:1762166796.261058:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166796.261061:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bc40 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166796.261065:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bc40 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:2.0:1762166796.261447:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444265856 00000100:00100000:2.0:1762166796.261456:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444265856 00002000:00010000:2.0:1762166796.261490:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/79 (0->18446744073709551615) 00002000:00100000:2.0:1762166796.261495:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e62b100 with x1847765444265856 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166796.261504:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e62b100. 00000100:00100000:2.0:1762166796.261533:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 930 00000100:00100000:2.0:1762166796.261542:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2360:x1847765444265856:12345-192.168.203.35@tcp:10:bash.0 00002000:00010000:2.0:1762166796.262030:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x4f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166796.262035:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x4f:0x0] updating lvb mtime from disk: 0 -> 1762166796 00002000:00010000:2.0:1762166796.262047:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x4f:0x0] updating lvb atime from disk: 0 -> 1762166790 00002000:00010000:2.0:1762166796.262050:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x4f:0x0] updating lvb ctime from disk: 0 -> 1762166796 00002000:00010000:2.0:1762166796.262053:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x4f:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1762166796.262118:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2360:x1847765444265856:12345-192.168.203.35@tcp:10:bash.0 Request processed in 576us (1107us total) trans 17179869387 rc 0/0 00000100:00100000:2.0:1762166796.262127:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 930 00002000:00010000:2.0:1762166796.262132:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/79 (0->18446744073709551615) 00002000:00100000:2.0:1762166796.262135:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e62b100 with x1847765444265856 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166796.262140:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e62b100. 00000100:00100000:0.0:1762166796.268498:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166796.268597:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444266112 00000100:00100000:3.0:1762166796.268607:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444266112 00000100:00100000:3.0:1762166796.268664:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2486 00000100:00100000:3.0:1762166796.268680:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:39824:x1847765444266112:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166796.268704:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166796.268723:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc47 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90aa3 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.268859:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9bc4e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.268874:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9bc4e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.268886:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9bc4e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.268898:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bc55 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.268905:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bc55 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.268926:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bc55 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.269020:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9bc4e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.269026:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9bc4e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.269032:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9bc4e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.269038:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166796.269042:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9bc4e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.269049:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9bc4e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.269072:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:3.0:1762166796.269076:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166796.269081:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9bc4e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.269087:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9bc4e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.269098:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bc55 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.269104:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bc55 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.269109:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bc55 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.269120:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166796.269123:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bc55 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.269129:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bc55 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.269138:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xcaa2b802 (ffff9ee343a13000) 00010000:00010000:3.0:1762166796.269140:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166796.269143:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bc55 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.269148:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bc55 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.269182:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc47 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90aa3 expref: 20 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.269192:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:3.0:1762166796.269194:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166796.269198:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc47 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90aa3 expref: 20 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.269206:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fc67600, rc 0) 00000100:00100000:3.0:1762166796.269269:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:39824:x1847765444266112:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 595us (783us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166796.269277:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2486 00000100:00100000:1.0:1762166796.271379:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166796.271430:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444266240 00000100:00100000:3.0:1762166796.271438:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444266240 00000100:00100000:3.0:1762166796.271504:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2487 00000100:00100000:3.0:1762166796.271514:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:39824:x1847765444266240:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:3.0:1762166796.271576:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bc5c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271590:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bc5c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271599:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bc5c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271611:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bc63 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271618:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bc63 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271622:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bc63 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271705:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bc6a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271713:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bc6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271719:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bc6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166796.271751:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5:0x0]: returning size 0 00000004:00200000:3.0:1762166796.271756:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166796.271800:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bc6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271813:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bc5c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271825:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bc5c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271831:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bc5c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271836:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166796.271855:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bc5c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271862:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bc5c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271873:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:3.0:1762166796.271880:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166796.271884:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bc5c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271890:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bc5c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271904:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bc63 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271910:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bc63 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271915:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bc63 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271924:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166796.271926:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bc63 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271942:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bc63 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271950:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xcaa2b802 (ffff9ee343a13200) 00010000:00010000:3.0:1762166796.271952:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166796.271955:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bc63 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271961:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bc63 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271974:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bc6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271979:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bc6a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271984:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bc6a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271989:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc67c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166796.271992:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bc6a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.271998:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bc6a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.272008:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5:0x0].0x0 (ffff9ee343a13a00) 00010000:00010000:3.0:1762166796.272011:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166796.272013:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bc6a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.272018:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bc6a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166796.272090:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:39824:x1847765444266240:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 577us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166796.272099:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2487 00000100:00100000:0.0:1762166796.273531:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166796.273644:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444266368 00000100:00100000:3.0:1762166796.273650:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444266368 00000100:00100000:3.0:1762166796.273696:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2488 00000100:00100000:3.0:1762166796.273705:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:39824:x1847765444266368:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166796.273721:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166796.273735:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bc71 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90aaa expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.273783:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bc71 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90aaa expref: 20 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.273797:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bc71 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90aaa expref: 20 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.273806:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:3.0:1762166796.273809:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166796.273812:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fc67000, rc 0) 00000100:00100000:3.0:1762166796.273872:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:39824:x1847765444266368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 168us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166796.273881:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2488 00000100:00100000:0.0:1762166796.278027:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166796.278079:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444266496 00000100:00100000:3.0:1762166796.278090:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444266496 00000100:00100000:3.0:1762166796.278145:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 740 00000100:00100000:3.0:1762166796.278159:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:39824:x1847765444266496:12345-192.168.203.35@tcp:37:lfs.0 00000100:00100000:3.0:1762166796.282035:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:39824:x1847765444266496:12345-192.168.203.35@tcp:37:lfs.0 Request processed in 3870us (4010us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166796.282048:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 740 00000100:00100000:0.0:1762166796.284905:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166796.285004:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444266624 00000100:00100000:3.0:1762166796.285012:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444266624 00000100:00100000:3.0:1762166796.285062:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2489 00000100:00100000:3.0:1762166796.285071:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:39824:x1847765444266624:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166796.285090:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166796.285106:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc78 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ab1 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.285176:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bc7f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.285188:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bc7f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.285198:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bc7f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166796.285219:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x3:0x0]: returning size 0 00000004:00200000:3.0:1762166796.285222:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166796.285237:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bc7f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166796.285260:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bc78 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ab1 expref: 22 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.285276:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bc7f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ab1 expref: 21 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.285303:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3:0x0].0x0 (ffff9ee36062b600) 00010000:00010000:3.0:1762166796.285306:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166796.285309:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fc66e00, rc 0) 00000100:00100000:3.0:1762166796.285368:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:39824:x1847765444266624:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 298us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166796.285375:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2489 00000100:00100000:0.0:1762166796.292867:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166796.292945:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444266880 00000100:00100000:3.0:1762166796.292955:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444266880 00000100:00100000:3.0:1762166796.293007:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 741 00000100:00100000:3.0:1762166796.293017:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:39824:x1847765444266880:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166796.293330:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:39824:x1847765444266880:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 312us (602us total) trans 4294968938 rc 0/0 00000100:00100000:3.0:1762166796.293337:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 741 00000100:00100000:0.0:1762166796.301700:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166796.301798:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444267136 00000100:00100000:1.0:1762166796.301808:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444267136 00000100:00100000:1.0:1762166796.301883:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2490 00000100:00100000:1.0:1762166796.301893:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:39825:x1847765444267136:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166796.301917:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166796.301936:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bc86 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ab8 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.302002:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bc8d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302015:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bc8d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302026:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bc8d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302039:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bc94 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302046:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bc94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302052:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bc94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302171:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bc9b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302180:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bc9b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302200:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bc9b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:1.0:1762166796.302209:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x3:0x0]: returning size 21 00010000:00010000:1.0:1762166796.302303:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bc8d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302312:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bc8d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302317:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bc8d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302323:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166796.302327:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bc8d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302334:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bc8d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302345:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166796.302348:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166796.302353:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bc8d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302359:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bc8d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302371:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bc94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302377:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bc94 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302393:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bc94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302397:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166796.302401:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bc94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302406:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bc94 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302414:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xe0d9f819 (ffff9ee34c9fae00) 00010000:00010000:1.0:1762166796.302416:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166796.302419:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bc94 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302424:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bc94 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.302461:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bc86 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ab8 expref: 25 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.302473:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bc9b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ab8 expref: 24 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.302480:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3:0x0].0x0 (ffff9ee36062b600) 00010000:00010000:1.0:1762166796.302482:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166796.302484:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452400, rc 0) 00000100:00100000:1.0:1762166796.302546:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:39825:x1847765444267136:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 655us (856us total) trans 4294968939 rc 0/0 00000100:00100000:1.0:1762166796.302554:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2490 00000100:00100000:0.0:1762166796.304011:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166796.304052:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166796.304064:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444267392 00000100:00100000:2.0:1762166796.304072:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444267392 00000100:00100000:2.0:1762166796.304118:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 742 00000100:00100000:2.0:1762166796.304127:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3719f8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:39825:x1847765444267392:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166796.304287:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3719f8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:39825:x1847765444267392:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 161us (279us total) trans 4294968940 rc 0/0 00000100:00100000:2.0:1762166796.304296:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 742 00000100:00100000:3.0:1762166796.304552:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444267520 00000100:00100000:3.0:1762166796.304558:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444267520 00000100:00100000:3.0:1762166796.304598:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 267 00000100:00100000:3.0:1762166796.304607:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765444267520:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166796.304618:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166796.304636:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bc9b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ab8 expref: 25 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166796.304651:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3:0x0].0x0 (ffff9ee36062b600) 00010000:00010000:3.0:1762166796.304655:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166796.304686:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444267520:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 81us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166796.304705:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 267 00000100:00100000:0.0:1762166796.308457:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166796.308526:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444267648 00000100:00100000:1.0:1762166796.308536:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444267648 00000100:00100000:1.0:1762166796.308594:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2491 00000100:00100000:1.0:1762166796.308603:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:39825:x1847765444267648:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166796.308625:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166796.308642:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bca9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90abf expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.308722:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bcb0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.308735:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.308746:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.308782:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bcb7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.308790:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.308796:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.308879:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.308886:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bcb0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.308892:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.308912:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166796.308916:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.308923:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bcb0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.308934:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166796.308937:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166796.308941:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bcb0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.308947:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bcb0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.308959:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.308964:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bcb7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.308969:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.308973:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166796.308975:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.308980:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bcb7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.308986:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xd6c8d217 (ffff9ee34c9fae00) 00010000:00010000:1.0:1762166796.308988:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166796.308996:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bcb7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.309001:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bcb7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.309031:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bca9 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90abf expref: 25 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.309040:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166796.309042:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166796.309046:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bca9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90abf expref: 25 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.309053:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453000, rc 0) 00000100:00100000:1.0:1762166796.309106:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:39825:x1847765444267648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 503us (656us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166796.309113:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2491 00000100:00100000:0.0:1762166796.311162:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166796.311327:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444267904 00000100:00100000:1.0:1762166796.311335:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444267904 00000100:00100000:1.0:1762166796.311415:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2492 00000100:00100000:1.0:1762166796.311425:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:39825:x1847765444267904:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166796.311442:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166796.311446:0:5757:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166796.311467:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bc71 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90aaa expref: 24 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.311482:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166796.311487:0:5757:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166796.311511:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bcbe lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ac6 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.311623:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bcc5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.311636:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bcc5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.311645:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bcc5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.311659:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bccc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.311666:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bccc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.311672:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bccc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.312270:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bcd3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.312280:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.312287:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:1.0:1762166796.312296:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x6:0x0]: returning size 0 00010000:00010000:1.0:1762166796.312319:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bcc5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.312325:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bcc5 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.312336:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bcc5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.312341:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166796.312344:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bcc5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.312351:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bcc5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.312358:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166796.312361:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166796.312364:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bcc5 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.312369:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bcc5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00000004:00010000:1.0:1762166796.312379:0:5757:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000baab3b2b reply state 00000000b677f969 transno 4294968941 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bccc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000100:00100000:1.0:1762166796.312386:0:5757:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762166796.312406:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bcbe lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ac6 expref: 26 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.312416:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bcd3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ac6 expref: 25 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.312423:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x6:0x0].0x0 (ffff9ee34c9fa900) 00010000:00010000:1.0:1762166796.312425:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166796.312427:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452200, rc 0) 00000100:00100000:1.0:1762166796.312484:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:39825:x1847765444267904:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1061us (1329us total) trans 4294968941 rc 0/0 00000100:00100000:1.0:1762166796.312491:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2492 00010000:00010000:2.0:1762166796.314632:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bccc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:2.0:1762166796.314646:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bccc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:2.0:1762166796.314653:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bccc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:2.0:1762166796.314659:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166796.314664:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bccc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:2.0:1762166796.314687:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bccc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:2.0:1762166796.314702:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xd6c8d217 (ffff9ee34c9fa200) 00010000:00010000:2.0:1762166796.314705:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166796.314709:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bccc lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:2.0:1762166796.314715:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bccc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00000100:00100000:0.0:1762166796.315022:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166796.315189:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444268160 00000100:00100000:1.0:1762166796.315198:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444268160 00000100:00100000:1.0:1762166796.315244:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2493 00000100:00100000:1.0:1762166796.315253:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:39825:x1847765444268160:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166796.315271:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166796.315284:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bce1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90acd expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.315358:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bce8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.315370:0:5757:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bcd3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ac6 expref: 26 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.315378:0:5757:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bce8 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.315411:0:5757:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bcd3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ac6 expref: 26 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.315424:0:5757:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bcd3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ac6 expref: 26 pid: 5757 timeout: 517 lvb_type: 0 00000100:00100000:1.0:1762166796.315436:0:5757:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1847765451917568:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166796.315509:0:5757:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee248001d80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166796.318360:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166796.318458:0:5757:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1847765451917568:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166796.318496:0:5757:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bce8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000100:00100000:3.0:1762166796.318551:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444268288 00000100:00100000:3.0:1762166796.318559:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444268288 00010000:00010000:3.0:1762166796.318589:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bcd3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ac6 expref: 27 pid: 5757 timeout: 517 lvb_type: 0 00000100:00100000:3.0:1762166796.318625:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 552 00000100:00100000:3.0:1762166796.318634:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444268288:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166796.318647:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166796.318653:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bcd3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ac6 expref: 27 pid: 5757 timeout: 517 lvb_type: 0 00010000:00010000:3.0:1762166796.318665:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bcd3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ac6 expref: 27 pid: 5757 timeout: 517 lvb_type: 0 00010000:00010000:3.0:1762166796.318690:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bcd3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ac6 expref: 27 pid: 5757 timeout: 517 lvb_type: 0 00010000:00010000:3.0:1762166796.318707:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x6:0x0].0x0 (ffff9ee34c9fa900) 00010000:00010000:3.0:1762166796.318756:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bce8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166796.318800:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bce8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 00010000:00010000:3.0:1762166796.318808:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bce8 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 00010000:00010000:2.0:1762166796.318923:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166796.318937:0:5757:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bce8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.318945:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bce8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:1.0:1762166796.318961:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x6:0x0]: returning size 0 00000100:00100000:2.0:1762166796.318990:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444268288:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 355us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166796.319003:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 552 00000004:00080000:1.0:1762166796.319144:0:5757:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5b:0x0], index 0: 0 00000004:00080000:1.0:1762166796.319153:0:5757:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x56:0x0], index 1: 0 00000004:00080000:1.0:1762166796.319158:0:5757:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5c:0x0], index 0: 0 00000004:00080000:1.0:1762166796.319164:0:5757:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5d:0x0], index 0: 0 00000004:00080000:1.0:1762166796.319168:0:5757:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x57:0x0], index 1: 0 00000004:00080000:1.0:1762166796.319174:0:5757:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5e:0x0], index 0: 0 00000004:00080000:1.0:1762166796.319179:0:5757:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x58:0x0], index 1: 0 00010000:00010000:1.0:1762166796.319350:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bce8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.319358:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bce8 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.319364:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bce8 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.319370:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166796.319373:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bce8 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.319380:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bce8 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.319401:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x6:0x0].0x0 (ffff9ee34c9fa900) 00010000:00010000:1.0:1762166796.319404:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166796.319408:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bce8 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.319413:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bce8 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.319461:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bce1 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90acd expref: 26 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.319469:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166796.319472:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166796.319475:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bce1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90acd expref: 26 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.319484:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453e00, rc 0) 00000100:00100000:1.0:1762166796.319530:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:39825:x1847765444268160:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 4277us (4510us total) trans 4294968942 rc 301/301 00000100:00100000:1.0:1762166796.319537:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2493 00000100:00100000:0.0:1762166796.322938:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166796.323021:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444268544 00000100:00100000:2.0:1762166796.323031:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444268544 00000100:00100000:2.0:1762166796.323082:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 743 00000100:00100000:2.0:1762166796.323092:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:39825:x1847765444268544:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166796.323405:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:39825:x1847765444268544:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 313us (474us total) trans 4294968943 rc 0/0 00000100:00100000:2.0:1762166796.323413:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 743 00000100:00100000:2.0:1762166796.327058:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166796.327139:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444268800 00000100:00100000:0.0:1762166796.327149:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444268800 00000100:00100000:0.0:1762166796.327207:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 744 00000100:00100000:0.0:1762166796.327218:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:39825:x1847765444268800:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166796.327437:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:39825:x1847765444268800:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 221us (390us total) trans 4294968944 rc 0/0 00000100:00100000:0.0:1762166796.327456:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 744 00000100:00100000:3.0:1762166796.341406:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166796.341499:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444269056 00000100:00100000:1.0:1762166796.341511:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444269056 00000100:00100000:1.0:1762166796.341573:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2494 00000100:00100000:1.0:1762166796.341585:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:39828:x1847765444269056:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166796.341610:0:5757:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166796.341630:0:5757:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bcf6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ad4 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.341734:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bcfd lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.341748:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bcfd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.341759:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bcfd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.341804:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bd04 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.341809:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bd04 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.341814:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bd04 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.341928:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bcfd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.341936:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bcfd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.341942:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bcfd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.341948:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166796.341952:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bcfd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.341959:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bcfd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.341980:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166796.341982:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166796.341986:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bcfd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.341990:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bcfd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.342000:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bd04 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.342003:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bd04 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.342007:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bd04 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.342009:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166796.342011:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bd04 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.342014:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bd04 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.342017:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xcaa2b802 (ffff9ee34c9fa900) 00010000:00010000:1.0:1762166796.342018:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166796.342020:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bd04 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.342023:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bd04 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:1.0:1762166796.342049:0:5757:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bcf6 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ad4 expref: 28 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.342060:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166796.342061:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166796.342064:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9bcf6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ad4 expref: 28 pid: 5757 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166796.342070:0:5757:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453e00, rc 0) 00000100:00100000:1.0:1762166796.342218:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:39828:x1847765444269056:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 634us (821us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166796.342225:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2494 00000100:00100000:1.0:1762166796.344248:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166796.344297:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444269184 00000100:00100000:0.0:1762166796.344305:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444269184 00000100:00100000:0.0:1762166796.344358:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2495 00000100:00100000:0.0:1762166796.344710:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:39828:x1847765444269184:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166796.344790:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bd0b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.344805:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bd0b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.344814:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bd0b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.344827:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9bd12 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.344833:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9bd12 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.344839:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9bd12 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.344935:0:5757:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9bd19 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.344942:0:5757:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9bd19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.344949:0:5757:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9bd19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00000004:00200000:0.0:1762166796.345411:0:5757:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5:0x0]: returning size 0 00000004:00200000:0.0:1762166796.345416:0:5757:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166796.345427:0:5757:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9bd19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345437:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bd0b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345451:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bd0b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345457:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bd0b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345462:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166796.345465:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bd0b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345472:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bd0b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345482:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:0.0:1762166796.345485:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166796.345489:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bd0b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345494:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bd0b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345505:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9bd12 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345510:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9bd12 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345515:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9bd12 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345520:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166796.345522:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9bd12 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345534:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9bd12 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345540:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xcaa2b802 (ffff9ee36062b700) 00010000:00010000:0.0:1762166796.345542:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166796.345545:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9bd12 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345550:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9bd12 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345564:0:5757:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9bd19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345569:0:5757:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9bd19 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345575:0:5757:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9bd19 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345579:0:5757:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166796.345582:0:5757:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9bd19 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345588:0:5757:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9bd19 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345593:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5:0x0].0x0 (ffff9ee36062b400) 00010000:00010000:0.0:1762166796.345595:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166796.345598:0:5757:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9bd19 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00010000:00010000:0.0:1762166796.345603:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9bd19 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 00000100:00100000:0.0:1762166796.345683:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:39828:x1847765444269184:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 1316us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166796.345690:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2495 00000100:00100000:2.0:1762166796.388099:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166796.388218:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444269312 00000100:00100000:0.0:1762166796.388228:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444269312 00000100:00100000:0.0:1762166796.388287:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 495 00000100:00100000:0.0:1762166796.388298:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2361:x1847765444269312:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:0.0:1762166796.388392:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2361:x1847765444269312:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 96us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166796.388399:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 495 00000100:00100000:3.0:1762166796.456071:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1847765451917824:0@lo:400:kworker.0 00000100:00100000:2.0:1762166796.456088:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451918080:0@lo:400:kworker.0 00000100:00100000:1.0:1762166796.456100:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451917952:0@lo:400:kworker.0 00000100:00100000:0.0:1762166796.456179:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f1807908-b95d-4027-b65a-753b7d69e554:3293:1847765451917696:0@lo:400:kworker.0 00000100:00100000:3.0:1762166796.456582:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166796.456586:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166796.456592:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166796.456625:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166796.456638:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1847765451918336:0@lo:400:kworker.0 00000100:00100000:0.0:1762166796.456642:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765451918208:0@lo:400:kworker.0 00000100:00100000:3.0:1762166796.456678:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166796.456678:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451917696 00000100:00100000:1.0:1762166796.456679:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451918080 00000100:00100000:1.0:1762166796.456688:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451918080 00000100:00100000:0.0:1762166796.456694:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451917952 00000100:00100000:2.0:1762166796.456696:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451917696 00000100:00100000:0.0:1762166796.456698:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451917952 00000100:00100000:3.0:1762166796.456729:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451917824 00000100:00100000:3.0:1762166796.456735:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451917824 00000100:00100000:2.0:1762166796.456744:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:0.0:1762166796.456746:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1762166796.456756:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3293:x1847765451917696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166796.456756:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3295:x1847765451917952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166796.456789:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1762166796.456803:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765451918080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166796.456809:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451918336 00000100:00100000:3.0:1762166796.456815:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451918336 00000100:00100000:2.0:1762166796.456832:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3293:x1847765451917696:12345-0@lo:400:kworker.0 Request processed in 78us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166796.456832:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3295:x1847765451917952:12345-0@lo:400:kworker.0 Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166796.456851:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:0.0:1762166796.456852:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1762166796.456863:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1762166796.456878:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1847765451917824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166796.456878:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765451918080:12345-0@lo:400:kworker.0 Request processed in 76us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166796.456891:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1762166796.456893:0:3295:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836710 gen 2 00000100:00100000:1.0:1762166796.456896:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000004:00080000:0.0:1762166796.456900:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fa98000, transno 21474836710 00000100:00100000:2.0:1762166796.456902:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1847765451918336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166796.456915:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451917952:0@lo:400:kworker.0 00000100:00100000:3.0:1762166796.456935:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1847765451917824:12345-0@lo:400:kworker.0 Request processed in 63us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166796.456949:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1762166796.456949:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166796.456955:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1847765451918336:12345-0@lo:400:kworker.0 Request processed in 54us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166796.456961:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1762166796.456974:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451918208 00000100:00100000:3.0:1762166796.456979:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451918208 00000100:00100000:0.0:1762166796.456990:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f1807908-b95d-4027-b65a-753b7d69e554:3293:1847765451917696:0@lo:400:kworker.0 00000100:00100000:3.0:1762166796.457018:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1762166796.457023:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1847765451918336:0@lo:400:kworker.0 00000100:00080000:0.0:1762166796.457023:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1762166796.457028:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166796.457029:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1847765451918208:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1762166796.457032:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166796.457037:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1847765451917824:0@lo:400:kworker.0 00000100:00100000:0.0:1762166796.457054:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869385 gen 2 00000004:00080000:0.0:1762166796.457058:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354c700, transno 17179869385 00000100:00100000:0.0:1762166796.457068:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451918080:0@lo:400:kworker.0 00000100:00100000:3.0:1762166796.457082:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1847765451918208:12345-0@lo:400:kworker.0 Request processed in 54us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166796.457090:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1762166796.457096:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765451918208:0@lo:400:kworker.0 00010000:00010000:3.0:1762166796.647998:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166797.672125:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1762166798.503965:0:7838:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 419296199432ns, next at 420296196823ns, rc = 0 00000100:00100000:1.0:1762166798.503970:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762166798.503993:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451918464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762166798.504056:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166798.504147:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451918464 00000100:00100000:3.0:1762166798.504157:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451918464 00000100:00100000:3.0:1762166798.504231:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1762166798.504241:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765451918464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1762166798.504277:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3857711104 avail 3855613952 00000100:00080000:0.0:1762166798.504331:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166798.504359:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765451918464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166798.504368:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1762166798.504431:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451918464:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1762166798.696007:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1762166799.016092:0:6730:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 419808325815ns, next at 420808322500ns, rc = 0 00000100:00100000:0.0:1762166799.016104:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1762166799.016136:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451918592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762166799.016221:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166799.016289:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451918592 00000100:00100000:3.0:1762166799.016303:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451918592 00000100:00080000:0.0:1762166799.016349:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166799.016385:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1762166799.016398:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1847765451918592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1762166799.016436:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1762166799.016524:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1847765451918592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166799.016531:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1762166799.016640:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451918592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762166799.432727:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166799.432806:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444269568 00000100:00100000:1.0:1762166799.432815:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444269568 00000100:00100000:1.0:1762166799.432937:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2496 00000100:00080000:0.0:1762166799.432941:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166799.432952:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:40532:x1847765444269568:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166799.432973:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166799.432993:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bd20 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90adb expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166799.433064:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd27 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433080:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd27 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433094:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd27 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433120:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd2e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433127:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433134:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433231:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd27 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433250:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd27 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433256:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd27 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433262:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166799.433272:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd27 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433279:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd27 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433291:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166799.433294:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166799.433299:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd27 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433306:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd27 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433324:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433330:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd2e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433335:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd2e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433340:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166799.433343:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd2e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433348:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd2e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433355:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xd6c8d217 (ffff9ee34c9fa900) 00010000:00010000:1.0:1762166799.433358:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166799.433361:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd2e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433377:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd2e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:1.0:1762166799.433413:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bd20 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90adb expref: 28 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166799.433424:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:1.0:1762166799.433426:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166799.433430:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9bd20 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90adb expref: 28 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166799.433438:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453800, rc 0) 00000100:00100000:1.0:1762166799.433497:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:40532:x1847765444269568:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 550us (778us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166799.433505:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2496 00000100:00100000:1.0:1762166799.435026:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166799.435109:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444269696 00000100:00100000:3.0:1762166799.435118:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444269696 00000100:00100000:3.0:1762166799.435166:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2497 00000100:00100000:3.0:1762166799.435176:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:40532:x1847765444269696:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:3.0:1762166799.435238:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bd35 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435253:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bd35 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435263:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bd35 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435278:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bd3c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435285:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bd3c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435291:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bd3c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435386:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd43 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435393:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435400:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000004:00200000:3.0:1762166799.435431:0:5755:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x6:0x0]: returning size 0 00000004:00200000:3.0:1762166799.435435:0:5755:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166799.435445:0:5755:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435456:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bd35 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435462:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bd35 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435468:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bd35 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435474:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc67600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166799.435477:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bd35 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435485:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bd35 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435495:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee343a13100) 00010000:00010000:3.0:1762166799.435498:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166799.435502:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bd35 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435514:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bd35 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435526:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bd3c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435531:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bd3c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435536:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bd3c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435541:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc67c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166799.435544:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bd3c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435550:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bd3c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435557:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0xd6c8d217 (ffff9ee343a13200) 00010000:00010000:3.0:1762166799.435560:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166799.435562:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bd3c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435568:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bd3c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435581:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435586:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd43 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435592:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435602:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166799.435605:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435611:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd43 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435619:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x6:0x0].0x0 (ffff9ee343a13a00) 00010000:00010000:3.0:1762166799.435621:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166799.435624:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd43 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166799.435629:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd43 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00000100:00100000:3.0:1762166799.435701:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:40532:x1847765444269696:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 527us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166799.435709:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2497 00010000:00010000:3.0:1762166799.719941:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166800.484860:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166800.485036:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444269824 00000100:00100000:0.0:1762166800.485052:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444269824 00000100:00100000:2.0:1762166800.485161:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00080000:1.0:1762166800.485164:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:0.0:1762166800.485177:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x4f:0x0] (0->3380) req@ffff9ee37f278000 x1847765444269824/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:586/0 lens 3872/0 e 0 to 0 dl 1762166811 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166800.485193:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f278000 with x1847765444269824 ext(0->3380) 00002000:00010000:0.0:1762166800.485203:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37f278000 00000100:00100000:0.0:1762166800.485252:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 931 00000100:00100000:0.0:1762166800.485268:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2359:x1847765444269824:12345-192.168.203.35@tcp:4:lfs.0 00000100:00100000:3.0:1762166800.485483:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444269952 00000100:00100000:3.0:1762166800.485495:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444269952 00000100:00100000:3.0:1762166800.485566:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 879 00000100:00100000:3.0:1762166800.485580:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2359:x1847765444269952:12345-192.168.203.35@tcp:16:kworker.0 00000100:00100000:0.0:1762166800.486063:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2359:x1847765444269824:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 795us (1214us total) trans 17179869388 rc 0/0 00000100:00100000:0.0:1762166800.486082:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 931 00002000:00100000:0.0:1762166800.486097:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x4f:0x0] (0->3380) req@ffff9ee37f278000 x1847765444269824/t17179869388(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:586/0 lens 3872/448 e 0 to 0 dl 1762166811 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166800.486107:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f278000 with x1847765444269824 ext(0->3380) 00002000:00010000:0.0:1762166800.486113:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37f278000 00000001:00080000:2.0:1762166800.501056:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869388 is committed 00000100:00100000:1.0:1762166800.501284:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2359:x1847765444269952:12345-192.168.203.35@tcp:16:kworker.0 Request processed in 15702us (16130us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166800.501299:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 879 00010000:00010000:3.0:1762166800.743959:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1762166801.088612:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968944 is committed 00000004:00080000:3.0:1762166801.088631:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 102 committed 00000004:00080000:3.0:1762166801.088662:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 100 committed 00000004:00080000:3.0:1762166801.088682:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 99 committed 00000004:00080000:3.0:1762166801.088683:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 101 committed 00000100:00100000:1.0:1762166801.088951:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f27aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451918848:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166801.089019:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166801.089075:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451919360:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166801.089103:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166801.089124:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1762166801.089130:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f27ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451918720:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166801.089169:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166801.089197:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451919232:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166801.089216:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166801.089236:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451919872:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166801.089259:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166801.089287:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451919744:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166801.089293:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451920384:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166801.089310:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166801.089333:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451918848 00000100:00100000:2.0:1762166801.089340:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451918848 00000100:00100000:1.0:1762166801.089342:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451918976:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166801.089364:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166801.089380:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f27a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451919488:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166801.089398:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166801.089407:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451920000:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166801.089422:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166801.089431:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1762166801.089436:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f27b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451919104:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762166801.089437:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451919360 00000100:00100000:2.0:1762166801.089440:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451919360 00000100:00100000:2.0:1762166801.089452:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451918720 00000100:00100000:2.0:1762166801.089454:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451918720 00000100:00100000:1.0:1762166801.089454:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166801.089462:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451919232 00000100:00100000:1.0:1762166801.089463:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f27b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451919616:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762166801.089471:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451919232 00000100:00100000:1.0:1762166801.089479:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166801.089483:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451919872 00000100:00100000:2.0:1762166801.089485:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451919872 00000100:00100000:1.0:1762166801.089487:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451920128:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762166801.089498:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451920384 00000100:00100000:2.0:1762166801.089501:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451920384 00000100:00100000:1.0:1762166801.089502:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166801.089509:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451918976 00000100:00100000:2.0:1762166801.089512:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451918976 00000100:00100000:2.0:1762166801.089520:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451919488 00000100:00100000:2.0:1762166801.089522:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451919488 00000100:00100000:1.0:1762166801.089522:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451920000 00000100:00100000:1.0:1762166801.089525:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451920000 00000100:00100000:2.0:1762166801.089530:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451919104 00000100:00100000:2.0:1762166801.089532:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451919104 00000100:00100000:1.0:1762166801.089538:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451919616 00000100:00100000:2.0:1762166801.089539:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451920128 00000100:00100000:2.0:1762166801.089540:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451920128 00000100:00100000:1.0:1762166801.089540:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451919616 00000100:00100000:2.0:1762166801.089552:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1762166801.089559:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765451918848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1762166801.089590:0:26444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:80 count 1 00002000:00010000:2.0:1762166801.089919:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166801.089928:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bd4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.089942:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166801.089944:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166801.089949:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bd4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.089962:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bd4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.089971:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bd4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.089989:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bd4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.090005:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1762166801.090256:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765451918848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 695us (1235us total) trans 21474836711 rc 0/0 00000100:00100000:1.0:1762166801.090493:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:3.0:1762166801.090526:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:3.0:1762166801.090537:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f279880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765451918720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1762166801.090552:0:12400:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:79 count 1 00010000:00010000:3.0:1762166801.090563:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166801.090576:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765451919360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1762166801.090586:0:7858:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:84 count 1 00000100:00100000:0.0:1762166801.090827:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:0.0:1762166801.090838:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765451919232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1762166801.090852:0:6535:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:83 count 1 00010000:00010000:0.0:1762166801.090863:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9bd58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.090879:0:6535:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb83 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a6b expref: 6 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166801.090886:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166801.090889:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166801.090892:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9bd58 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.090923:0:6535:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a6b expref: 6 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166801.090937:0:6535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a6b expref: 6 pid: 12402 timeout: 521 lvb_type: 1 00000100:00100000:0.0:1762166801.090951:0:6535:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765451920512:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166801.091023:0:6535:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485b40 going to sleep for 11 seconds 00010000:00010000:3.0:1762166801.091098:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a5d expref: 6 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166801.091105:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166801.091106:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166801.091109:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd51 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166801.091130:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a5d expref: 6 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166801.091139:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a5d expref: 6 pid: 12402 timeout: 521 lvb_type: 1 00000100:00100000:3.0:1762166801.091150:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee3819bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765451920640:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166801.091175:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242737d80 going to sleep for 11 seconds 00002000:00010000:1.0:1762166801.091393:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166801.091399:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.091407:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166801.091409:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166801.091412:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.091422:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.091431:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.091438:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.091465:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1762166801.091604:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1762166801.091611:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bd4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166801.091620:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166801.091624:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bd4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166801.091646:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bd4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166801.091662:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bd4a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166801.091669:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bd4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166801.091687:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166801.091690:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166801.091696:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166801.091699:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166801.091706:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166801.091714:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd5f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166801.091721:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9bd5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166801.091747:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166801.091749:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166801.091750:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166801.091797:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1762166801.091843:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f27aa00/2, rc 0, transno 21474836711 00000100:00100000:3.0:1762166801.091850:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f27aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451918848:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166801.092052:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765451919360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1545us (2947us total) trans 21474836712 rc 0/0 00000100:00100000:1.0:1762166801.092059:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:1.0:1762166801.092082:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:1.0:1762166801.092089:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3294:x1847765451919872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1762166801.092104:0:7858:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:77 count 1 00002000:00010000:1.0:1762166801.092122:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166801.092132:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.092140:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166801.092142:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166801.092145:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.092155:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.092162:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.092169:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.092181:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1762166801.092440:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765451919872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 351us (3180us total) trans 17179869389 rc 0/0 00000100:00100000:1.0:1762166801.092448:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:1.0:1762166801.092463:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:1.0:1762166801.092471:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3294:x1847765451920384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1762166801.092482:0:7858:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:82 count 1 00002000:00010000:1.0:1762166801.092496:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166801.092501:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bd6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.092509:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166801.092516:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166801.092520:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bd6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.092529:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bd6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.092536:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bd6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.092543:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bd6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.092558:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1762166801.092755:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1762166801.092786:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:2.0:1762166801.092794:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765451918976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1762166801.092819:0:26444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:81 count 1 00000100:00100000:1.0:1762166801.092874:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765451920384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 403us (3561us total) trans 17179869390 rc 0/0 00000100:00100000:1.0:1762166801.092880:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:1.0:1762166801.092892:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1762166801.092898:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765451919488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1762166801.092910:0:7858:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:85 count 1 00002000:00010000:2.0:1762166801.093041:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166801.093046:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bd74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.093054:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166801.093056:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166801.093059:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bd74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.093069:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bd74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.093076:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bd74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.093084:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bd74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166801.093093:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166801.093098:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bd7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.093103:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1762166801.093105:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166801.093106:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166801.093109:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bd7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.093129:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bd7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.093137:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bd7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.093144:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bd7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.093151:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1762166801.093237:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765451918976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 443us (3870us total) trans 21474836713 rc 0/0 00000100:00100000:2.0:1762166801.093243:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:2.0:1762166801.093256:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:2.0:1762166801.093262:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765451920000:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166801.093264:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765451919488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 367us (3865us total) trans 21474836714 rc 0/0 00000100:00100000:1.0:1762166801.093270:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00002000:00080000:2.0:1762166801.093273:0:26444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:78 count 1 00000100:00100000:1.0:1762166801.093281:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00002000:00010000:2.0:1762166801.093287:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00100000:1.0:1762166801.093288:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765451919104:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762166801.093292:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bd82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1762166801.093297:0:7858:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:82 count 1 00010000:00010000:2.0:1762166801.093299:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166801.093301:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166801.093304:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bd82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.093312:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bd82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.093320:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bd82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.093327:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bd82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.093334:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1762166801.093419:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166801.093424:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bd89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.093432:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166801.093434:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166801.093437:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bd89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.093446:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bd89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.093458:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bd89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.093465:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bd89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.093473:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1762166801.093531:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765451920000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 269us (4107us total) trans 17179869391 rc 0/0 00000100:00100000:2.0:1762166801.093538:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:2.0:1762166801.093551:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:2.0:1762166801.093558:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765451920128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1762166801.093570:0:26444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:80 count 1 00002000:00010000:2.0:1762166801.093583:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166801.093588:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bd90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.093595:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166801.093596:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1762166801.093598:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765451919104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 310us (4142us total) trans 21474836715 rc 0/0 00010000:00010000:2.0:1762166801.093599:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bd90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166801.093605:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00010000:00010000:2.0:1762166801.093608:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bd90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.093615:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bd90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166801.093616:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00010000:00010000:2.0:1762166801.093622:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bd90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166801.093622:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765451919616:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762166801.093630:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00080000:1.0:1762166801.093633:0:7858:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:86 count 1 00000100:00080000:1.0:1762166801.093818:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1762166801.093823:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166801.093837:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166801.093856:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765451920128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 299us (4352us total) trans 17179869392 rc 0/0 00000100:00100000:2.0:1762166801.093861:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:1.0:1762166801.093864:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451920256:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762166801.093878:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451919744 00000100:00100000:2.0:1762166801.093884:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451919744 00000100:00100000:1.0:1762166801.093888:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166801.093907:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451920256 00000100:00100000:2.0:1762166801.093910:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451920256 00000100:00100000:1.0:1762166801.093915:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:2.0:1762166801.093922:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:1.0:1762166801.093922:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765451919744:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762166801.093927:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765451920256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1762166801.093934:0:26444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:81 count 1 00002000:00080000:1.0:1762166801.093934:0:6532:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:76 count 1 00002000:00010000:2.0:1762166801.093947:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:1.0:1762166801.093947:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166801.093953:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bd97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.093953:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bd9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.093961:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166801.093962:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166801.093965:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bd97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.093970:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166801.093972:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166801.093975:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bd97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.093975:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bd9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.093983:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bd97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.093984:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bd9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.093991:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bd97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.093992:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bd9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.093998:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:1.0:1762166801.093999:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bd9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.094005:0:6532:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:2.0:1762166801.094203:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765451920256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 273us (311us total) trans 17179869393 rc 0/0 00010000:00010000:0.0:1762166801.094206:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00000100:00100000:2.0:1762166801.094209:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00010000:00010000:0.0:1762166801.094211:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094219:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166801.094223:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094231:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094244:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd66 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094250:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bd66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094266:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1762166801.094270:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bd6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094276:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166801.094278:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bd6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094284:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bd6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094303:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bd6d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094309:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee350453200/0xf915a5bdf3c9bd6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094320:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1762166801.094324:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bd74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094330:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166801.094333:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bd74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094339:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bd74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094342:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1762166801.094346:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bd7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094349:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bd74 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094354:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166801.094356:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bd74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094357:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bd7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094364:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bd7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094368:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1762166801.094371:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bd82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094373:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bd7b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094379:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9bd7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094387:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166801.094390:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bd82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094392:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1762166801.094395:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bd89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094398:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bd82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094401:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166801.094404:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bd89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094408:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bd82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094410:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bd89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094415:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bd82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094418:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bd89 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094425:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1762166801.094427:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bd90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094430:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9bd89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094432:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166801.094435:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bd90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094441:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1762166801.094442:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bd90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094443:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bd97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094449:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166801.094451:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bd90 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094452:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bd97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094460:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bd97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094466:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bd90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094468:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bd97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094475:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bd97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094477:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166801.094480:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bd9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.094484:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166801.094485:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166801.094486:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166801.094488:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166801.094488:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bd9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094495:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bd9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094503:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bd9e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094509:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9bd9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166801.094512:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317ea00/2, rc 0, transno 17179869393 00000100:00100000:2.0:1762166801.094518:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451920256:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1762166801.094518:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166801.094520:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166801.094521:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1762166801.094537:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f27b800/2, rc 0, transno 21474836715 00000100:00100000:2.0:1762166801.094546:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f27b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451919104:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1762166801.094551:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1762166801.094558:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317e300/2, rc 0, transno 17179869392 00000100:00100000:2.0:1762166801.094561:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451920128:0@lo:6:osp-syn-1-0.0 00002000:00010000:0.0:1762166801.094563:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166801.094567:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bda5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166801.094570:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f279500/2, rc 0, transno 21474836713 00000100:00100000:2.0:1762166801.094573:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451918976:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1762166801.094579:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000004:00080000:2.0:1762166801.094580:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f27a680/2, rc 0, transno 21474836714 00010000:00010000:0.0:1762166801.094581:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1762166801.094584:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f27a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451919488:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1762166801.094584:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bda5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166801.094591:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317ed80/2, rc 0, transno 17179869391 00010000:00010000:0.0:1762166801.094593:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bda5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166801.094594:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451920000:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1762166801.094601:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bda5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094607:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bda5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.094637:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1762166801.094823:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765451919616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1187us (5328us total) trans 21474836716 rc 0/0 00000100:00100000:0.0:1762166801.094831:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000004:00080000:3.0:1762166801.095010:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317f480/2, rc 0, transno 17179869389 00000100:00100000:3.0:1762166801.095016:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451919872:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1762166801.095026:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317d180/2, rc 0, transno 17179869390 00000100:00100000:3.0:1762166801.095029:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451920384:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1762166801.095039:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f279f80/2, rc 0, transno 21474836712 00000100:00100000:3.0:1762166801.095042:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451919360:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762166801.095111:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166801.095116:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bda5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.095123:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166801.095127:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bda5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.095134:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bda5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.095146:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bda5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.095153:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bda5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.095177:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166801.095179:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166801.095180:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1762166801.095198:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f27b100/2, rc 0, transno 21474836716 00000100:00100000:2.0:1762166801.095202:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f27b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451919616:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166801.095545:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765451919744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1621us (1705us total) trans 17179869394 rc 0/0 00000100:00100000:1.0:1762166801.095552:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000004:00080000:2.0:1762166801.095599:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317c700/2, rc 0, transno 17179869394 00000100:00100000:2.0:1762166801.095604:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451919744:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166801.097392:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee3819bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765451920640:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166801.097419:0:12400:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166801.097552:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166801.097571:0:6535:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765451920512:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166801.097592:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444270080 00010000:00010000:0.0:1762166801.097593:0:6535:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9bd58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166801.097600:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444270080 00000100:00100000:3.0:1762166801.097607:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166801.097643:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a5d expref: 7 pid: 12402 timeout: 521 lvb_type: 1 00000100:00100000:2.0:1762166801.097679:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444270208 00000100:00100000:2.0:1762166801.097683:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444270208 00010000:00010000:2.0:1762166801.097694:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a6b expref: 8 pid: 12402 timeout: 521 lvb_type: 1 00000100:00100000:1.0:1762166801.097703:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 553 00000100:00100000:1.0:1762166801.097713:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2361:x1847765444270080:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166801.097727:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166801.097730:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 554 00000100:00100000:2.0:1762166801.097736:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2361:x1847765444270208:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166801.097742:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166801.097742:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a5d expref: 8 pid: 12402 timeout: 521 lvb_type: 1 00010000:00010000:2.0:1762166801.097746:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a6b expref: 8 pid: 12402 timeout: 521 lvb_type: 1 00010000:00010000:1.0:1762166801.097754:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a5d expref: 8 pid: 12402 timeout: 521 lvb_type: 1 00010000:00010000:2.0:1762166801.097755:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a6b expref: 8 pid: 12402 timeout: 521 lvb_type: 1 00010000:00010000:1.0:1762166801.097796:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9bb44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a5d expref: 8 pid: 12402 timeout: 521 lvb_type: 1 00010000:00010000:2.0:1762166801.097799:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9bb83 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a6b expref: 8 pid: 12402 timeout: 521 lvb_type: 1 00010000:00010000:2.0:1762166801.097819:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166801.097819:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166801.097822:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166801.097822:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166801.097827:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9bd58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.097827:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.097838:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9bd58 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.097838:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd51 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.097973:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166801.098030:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2361:x1847765444270208:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 292us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166801.098037:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 554 00000100:00080000:2.0:1762166801.098057:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1762166801.098088:0:6535:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9bd58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.098097:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9bd58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.098113:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9bd58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.098121:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9bd58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.098146:0:6535:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1762166801.098400:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765451919232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7564us (9181us total) trans 21474836717 rc 0/0 00000100:00100000:0.0:1762166801.098408:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00010000:00010000:2.0:1762166801.098707:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166801.098712:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166801.098714:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9bd58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.098724:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166801.098728:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9bd58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.098737:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9bd58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166801.098741:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+5:2361:x1847765444270080:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1027us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166801.098754:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 553 00010000:00010000:2.0:1762166801.098857:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9bd58 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.098865:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9bd58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.098869:0:12400:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.098880:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166801.098881:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166801.098885:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166801.098888:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166801.098893:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.098907:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166801.098920:0:12400:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1762166801.099090:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f278380/2, rc 0, transno 21474836717 00000100:00100000:3.0:1762166801.099098:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451919232:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166801.099107:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f279880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765451918720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8568us (9935us total) trans 21474836718 rc 0/0 00000100:00100000:1.0:1762166801.099116:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000004:00080000:3.0:1762166801.099117:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f27ad80/2, rc 0, transno 21474836718 00000100:00100000:3.0:1762166801.099123:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f27ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451918720:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1762166801.099407:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166801.099413:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.099421:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166801.099425:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.099432:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.099445:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd51 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.099452:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bd51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166801.099479:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166801.099481:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166801.099483:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166801.509073:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166801.509122:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166801.509132:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444270464 00000100:00100000:3.0:1762166801.509142:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444270464 00000100:00100000:3.0:1762166801.509218:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 216 00000100:00080000:1.0:1762166801.509221:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166801.509229:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2358:x1847765444270464:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762166801.509302:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2358:x1847765444270464:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 76us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166801.509321:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 216 00000100:00100000:0.0:1762166801.509607:0:5749:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444270336 00000100:00100000:0.0:1762166801.509611:0:5749:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444270336 00000100:00100000:2.0:1762166801.509627:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166801.509646:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 497 00000100:00100000:0.0:1762166801.509654:0:5749:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2359:x1847765444270336:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:0.0:1762166801.509709:0:5749:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2359:x1847765444270336:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 56us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166801.509717:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 497 00000100:00100000:1.0:1762166801.509988:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444270592 00000100:00100000:1.0:1762166801.509993:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444270592 00000100:00100000:1.0:1762166801.510029:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 172 00000100:00100000:1.0:1762166801.510037:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2359:x1847765444270592:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:1.0:1762166801.510074:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2359:x1847765444270592:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 38us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166801.510081:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 172 00000100:00100000:1.0:1762166801.576036:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1847765451920896:0@lo:400:kworker.0 00000100:00100000:3.0:1762166801.576104:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451921024:0@lo:400:kworker.0 00000100:00100000:1.0:1762166801.576104:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166801.576140:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166801.576205:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1762166801.576210:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451920768:0@lo:400:kworker.0 00000100:00100000:3.0:1762166801.576214:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451921152:0@lo:400:kworker.0 00000100:00100000:3.0:1762166801.576247:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166801.576261:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166801.576305:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765451921280:0@lo:400:kworker.0 00000100:00100000:3.0:1762166801.576330:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451921024 00000100:00100000:3.0:1762166801.576338:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451921024 00000100:00100000:0.0:1762166801.576341:0:5749:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451920768 00000100:00100000:0.0:1762166801.576347:0:5749:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451920768 00000100:00100000:3.0:1762166801.576381:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451921152 00000100:00100000:3.0:1762166801.576385:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451921152 00000100:00100000:0.0:1762166801.576389:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1762166801.576401:0:5749:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765451920768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166801.576415:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1762166801.576425:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765451921024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166801.576455:0:5749:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765451920768:12345-0@lo:400:kworker.0 Request processed in 57us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166801.576464:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:3.0:1762166801.576471:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765451921024:12345-0@lo:400:kworker.0 Request processed in 47us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166801.576479:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1762166801.576495:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1762166801.576502:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765451921152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166801.576532:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765451921152:12345-0@lo:400:kworker.0 Request processed in 30us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166801.576539:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1762166801.576574:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451921152:0@lo:400:kworker.0 00000100:00100000:3.0:1762166801.576583:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451921024:0@lo:400:kworker.0 00000100:00100000:2.0:1762166801.577187:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451920896 00000100:00100000:2.0:1762166801.577193:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451920896 00000100:00100000:2.0:1762166801.577221:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1762166801.577225:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1847765451921408:0@lo:400:kworker.0 00000100:00100000:2.0:1762166801.577229:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1847765451920896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166801.577274:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166801.577279:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1847765451920896:12345-0@lo:400:kworker.0 Request processed in 48us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166801.577288:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1762166801.577305:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451921408 00000100:00100000:2.0:1762166801.577309:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451921408 00000100:00100000:1.0:1762166801.577312:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1847765451920896:0@lo:400:kworker.0 00000100:00100000:2.0:1762166801.577345:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1762166801.577352:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1847765451921408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166801.577383:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1847765451921408:12345-0@lo:400:kworker.0 Request processed in 31us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166801.577389:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:0.0:1762166801.577477:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762166801.577504:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1847765451921408:0@lo:400:kworker.0 00000100:00100000:3.0:1762166801.577949:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166801.579119:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451920768:0@lo:400:kworker.0 00000100:00100000:1.0:1762166801.579183:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451921280 00000100:00100000:1.0:1762166801.579188:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451921280 00000100:00080000:0.0:1762166801.579230:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166801.579239:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1762166801.579254:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765451921280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166801.579315:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765451921280:12345-0@lo:400:kworker.0 Request processed in 66us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166801.579323:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1762166801.579351:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765451921280:0@lo:400:kworker.0 00010000:00010000:2.0:1762166801.768436:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166802.791908:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166803.623939:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1762166803.623964:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451921536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166803.624036:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166803.624114:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451921536 00000100:00100000:2.0:1762166803.624123:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451921536 00000100:00100000:2.0:1762166803.624193:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1762166803.624203:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765451921536:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1762166803.624230:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1762166803.624239:0:8383:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1762166803.624289:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765451921536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166803.624298:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1762166803.624326:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451921536:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1762166803.815988:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166804.135942:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451921664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762166804.136037:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166804.136131:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451921664 00000100:00100000:1.0:1762166804.136139:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451921664 00000100:00080000:0.0:1762166804.136203:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166804.136205:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1762166804.136217:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765451921664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1762166804.136249:0:8383:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1762166804.136301:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765451921664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166804.136310:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1762166804.136338:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451921664:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1762166804.840929:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1762166804.857474:0:29753:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 46: Verify setstripe --copy option ==== 05:46:44 (1762166804) 00000100:00100000:2.0:1762166804.897304:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166804.897526:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444270848 00000100:00100000:3.0:1762166804.897538:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444270848 00000100:00080000:0.0:1762166804.897586:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166804.897617:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2498 00000100:00100000:3.0:1762166804.897628:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:41799:x1847765444270848:12345-192.168.203.35@tcp:36:mkdir.0 00010000:00010000:3.0:1762166804.897684:0:5756:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166804.897710:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9b937 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909c3 expref: 11 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166804.897727:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34c9fa000) 00010000:00010000:3.0:1762166804.897740:0:5756:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166804.898041:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bdac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.898055:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bdac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.898064:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bdac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.898124:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bdb3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x237edbbc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.898137:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bdb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.898144:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bdb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:3.0:1762166804.898849:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x7:0x0]: returning size 512 00010000:00010000:3.0:1762166804.898859:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bdac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.898877:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bdac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.898883:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bdac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.898890:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc67600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166804.898894:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bdac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.898902:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bdac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.898914:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13700) 00010000:00010000:3.0:1762166804.898917:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166804.898921:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bdac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.898927:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bdac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000004:00010000:3.0:1762166804.898943:0:5756:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d17ceda4 reply state 0000000040cbc184 transno 4294968945 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bdb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:3.0:1762166804.898951:0:5756:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166804.899045:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:41799:x1847765444270848:12345-192.168.203.35@tcp:36:mkdir.0 Request processed in 1418us (1748us total) trans 4294968945 rc 0/0 00000100:00100000:3.0:1762166804.899055:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2498 00010000:00010000:1.0:1762166804.900745:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bdb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.900758:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bdb3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.900807:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bdb3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.900813:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc67c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166804.900817:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bdb3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.900824:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bdb3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.900836:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x237edbbc (ffff9ee343a13200) 00010000:00010000:1.0:1762166804.900846:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166804.900850:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bdb3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.900855:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bdb3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000100:00100000:2.0:1762166804.905226:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166804.905298:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444270976 00000100:00100000:3.0:1762166804.905324:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444270976 00000100:00100000:3.0:1762166804.905432:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2499 00000100:00100000:3.0:1762166804.905453:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:41803:x1847765444270976:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:3.0:1762166804.905494:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166804.905519:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bdba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ae2 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166804.905593:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bdc1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.905608:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bdc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.905619:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bdc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:3.0:1762166804.905685:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:3.0:1762166804.905690:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166804.905714:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bdc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.905732:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bdba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ae2 expref: 13 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166804.905745:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bdc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ae2 expref: 12 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166804.905751:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13700) 00010000:00010000:3.0:1762166804.905753:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166804.905755:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fc66c00, rc 0) 00000100:00100000:3.0:1762166804.905868:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:41803:x1847765444270976:12345-192.168.203.35@tcp:101:rm.0 Request processed in 428us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166804.905874:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2499 00000100:00100000:1.0:1762166804.908188:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166804.908269:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444271104 00000100:00100000:3.0:1762166804.908284:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444271104 00000100:00100000:3.0:1762166804.908331:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2500 00000100:00100000:3.0:1762166804.908342:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:41803:x1847765444271104:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:3.0:1762166804.908359:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166804.908375:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9bdc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ae9 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166804.908439:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bdcf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908451:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bdcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908461:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bdcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908492:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bdd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908499:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bdd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908505:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bdd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908611:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bddd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908618:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bddd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908625:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bddd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:3.0:1762166804.908665:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x7:0x0]: returning size 512 00000004:00200000:3.0:1762166804.908669:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166804.908688:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bddd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908699:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bdcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908705:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bdcf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908712:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bdcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908717:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166804.908722:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bdcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908729:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bdcf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908740:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13700) 00010000:00010000:3.0:1762166804.908744:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166804.908748:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bdcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908754:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9bdcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908808:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bdd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908815:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bdd6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908827:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bdd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908832:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166804.908836:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bdd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908843:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bdd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908852:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x237edbbc (ffff9ee343a13a00) 00010000:00010000:3.0:1762166804.908854:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166804.908857:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bdd6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908863:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9bdd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.908891:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9bdc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ae9 expref: 14 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166804.908903:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bddd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ae9 expref: 13 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166804.908909:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166804.908911:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1762166804.908914:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fc67c00, rc 0) 00000100:00100000:3.0:1762166804.908970:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:41803:x1847765444271104:12345-192.168.203.35@tcp:101:rm.0 Request processed in 631us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166804.908977:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2500 00000100:00100000:1.0:1762166804.910582:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166804.910655:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444271232 00000100:00100000:3.0:1762166804.910662:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444271232 00000100:00100000:3.0:1762166804.910756:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2501 00000100:00100000:3.0:1762166804.910804:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:41803:x1847765444271232:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:3.0:1762166804.910821:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166804.910836:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bde4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90af0 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166804.910909:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bdeb lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.910921:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bdeb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.910932:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bdeb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.911133:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bdf2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.911143:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bdf2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.911150:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bdf2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.911213:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bdeb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.911221:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bdeb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.911227:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bdeb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.911239:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166804.911243:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bdeb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.911249:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bdeb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.911260:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166804.911262:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166804.911265:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bdeb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.911272:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9bdeb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.911283:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bdf2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.911289:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bdf2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.911294:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bdf2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.911300:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc67000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166804.911302:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bdf2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.911308:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bdf2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.911314:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xeb4e88c0 (ffff9ee343a13300) 00010000:00010000:3.0:1762166804.911317:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166804.911325:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bdf2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.911330:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9bdf2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.911359:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bde4 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90af0 expref: 14 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166804.911370:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166804.911373:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166804.911376:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9bde4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90af0 expref: 14 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166804.911385:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fc67600, rc 0) 00000100:00100000:3.0:1762166804.911609:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:41803:x1847765444271232:12345-192.168.203.35@tcp:101:rm.0 Request processed in 809us (1030us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166804.911616:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2501 00000100:00100000:0.0:1762166804.913398:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166804.913444:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444271360 00000100:00100000:3.0:1762166804.913452:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444271360 00000100:00100000:3.0:1762166804.913757:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2502 00000100:00100000:3.0:1762166804.913795:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:41803:x1847765444271360:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:3.0:1762166804.913812:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166804.913829:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9bdf9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90af7 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166804.913886:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9be00 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.913899:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9be00 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.913917:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9be00 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.913932:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9be07 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.913938:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9be07 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.913944:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9be07 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.914000:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9be00 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.914007:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9be00 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.914012:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9be00 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.914017:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166804.914021:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9be00 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.914027:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9be00 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.914038:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166804.914041:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166804.914045:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9be00 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.914050:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9be00 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.914064:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9be07 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.914070:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9be07 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.914075:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9be07 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.914081:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166804.914084:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9be07 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.914089:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9be07 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.914097:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xeb4e88c0 (ffff9ee343a13200) 00010000:00010000:3.0:1762166804.914099:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166804.914102:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9be07 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.914108:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9be07 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:3.0:1762166804.914141:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9bdf9 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90af7 expref: 14 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166804.914151:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166804.914154:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166804.914157:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9bdf9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90af7 expref: 14 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166804.914178:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243444000, rc 0) 00000100:00100000:3.0:1762166804.914236:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:41803:x1847765444271360:12345-192.168.203.35@tcp:101:rm.0 Request processed in 453us (842us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166804.914244:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2502 00000100:00100000:0.0:1762166804.926615:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166804.926653:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444271488 00000100:00100000:0.0:1762166804.926662:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444271488 00000100:00100000:0.0:1762166804.926711:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2503 00000100:00100000:0.0:1762166804.926720:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:41806:x1847765444271488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166804.926742:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166804.926776:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9be0e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90afe expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166804.926853:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9be15 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.926867:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9be15 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.926878:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9be15 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.926900:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9be1c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.926906:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9be1c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.926912:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9be1c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.926973:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9be15 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.926980:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9be15 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.926986:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9be15 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.926992:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166804.926996:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9be15 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.927002:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9be15 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.927014:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166804.927017:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166804.927021:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9be15 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.927027:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9be15 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.927037:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9be1c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.927048:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9be1c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.927053:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9be1c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.927057:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166804.927060:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9be1c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.927066:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9be1c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.927073:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xeb4e88c0 (ffff9ee36062b200) 00010000:00010000:0.0:1762166804.927076:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166804.927078:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9be1c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.927084:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9be1c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.927121:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9be0e lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90afe expref: 14 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166804.927130:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166804.927133:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166804.927136:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9be0e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90afe expref: 14 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166804.927144:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159c00, rc 0) 00000100:00100000:0.0:1762166804.927196:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:41806:x1847765444271488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 477us (590us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166804.927209:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2503 00000100:00100000:0.0:1762166804.929544:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166804.929673:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444271744 00000100:00100000:1.0:1762166804.929682:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444271744 00000100:00100000:1.0:1762166804.929737:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2504 00000100:00100000:1.0:1762166804.929748:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:41806:x1847765444271744:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166804.929796:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166804.929815:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9be23 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b05 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166804.929934:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9be2a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.929947:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9be2a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.929957:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9be2a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.929970:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9be31 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.929975:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9be31 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.929981:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9be31 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.930402:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9be38 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.930411:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9be38 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.930417:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9be38 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:1.0:1762166804.930426:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x8:0x0]: returning size 0 00010000:00010000:1.0:1762166804.930448:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9be2a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.930455:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9be2a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.930460:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9be2a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.930475:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166804.930479:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9be2a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.930490:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9be2a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.930502:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:1.0:1762166804.930505:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166804.930509:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9be2a lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.930515:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9be2a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000004:00010000:1.0:1762166804.930538:0:20128:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005efbbc8c reply state 000000008814b8a9 transno 4294968946 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9be31 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:1.0:1762166804.930546:0:20128:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762166804.930571:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9be23 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b05 expref: 16 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166804.930583:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9be38 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b05 expref: 15 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166804.930590:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x8:0x0].0x0 (ffff9ee34c83d900) 00010000:00010000:1.0:1762166804.930592:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166804.930594:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453e00, rc 0) 00000100:00100000:1.0:1762166804.930708:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:41806:x1847765444271744:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 961us (1170us total) trans 4294968946 rc 0/0 00000100:00100000:1.0:1762166804.930715:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2504 00010000:00010000:2.0:1762166804.932817:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9be31 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.932831:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9be31 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.932839:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9be31 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.932845:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166804.932849:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9be31 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.932856:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9be31 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.932870:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xeb4e88c0 (ffff9ee34c83db00) 00010000:00010000:2.0:1762166804.932873:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166804.932877:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9be31 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.932894:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9be31 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:1.0:1762166804.934213:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166804.934260:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444272000 00000100:00100000:2.0:1762166804.934268:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444272000 00000100:00100000:2.0:1762166804.934330:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2505 00000100:00100000:2.0:1762166804.934342:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:41806:x1847765444272000:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166804.934366:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166804.934384:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be46 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b0c expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166804.934492:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9be4d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.934506:0:20128:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9be38 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b05 expref: 16 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166804.934515:0:20128:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9be4d lrc: 4/0,1 mode: --/EX res: [0x200000404:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.934553:0:20128:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9be38 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b05 expref: 16 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166804.934579:0:20128:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9be38 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b05 expref: 16 pid: 20128 timeout: 525 lvb_type: 0 00000100:00100000:2.0:1762166804.934597:0:20128:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20128:1847765451921792:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166804.934751:0:20128:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166804.936616:0:20128:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20128:1847765451921792:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166804.936639:0:20128:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9be4d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:1.0:1762166804.937011:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166804.937091:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444272128 00000100:00100000:2.0:1762166804.937108:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444272128 00010000:00010000:2.0:1762166804.937138:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9be38 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b05 expref: 17 pid: 20128 timeout: 525 lvb_type: 0 00000100:00100000:2.0:1762166804.937175:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 555 00000100:00100000:2.0:1762166804.937184:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444272128:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166804.937197:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166804.937204:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9be38 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b05 expref: 17 pid: 20128 timeout: 525 lvb_type: 0 00010000:00010000:2.0:1762166804.937214:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9be38 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b05 expref: 17 pid: 20128 timeout: 525 lvb_type: 0 00010000:00010000:2.0:1762166804.937232:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9be38 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b05 expref: 17 pid: 20128 timeout: 525 lvb_type: 0 00010000:00010000:2.0:1762166804.937244:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x8:0x0].0x0 (ffff9ee34c83d900) 00010000:00010000:2.0:1762166804.937249:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9be4d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.937256:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9be4d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.937262:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9be4d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.937289:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166804.937342:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444272128:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 158us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166804.937349:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 555 00010000:00010000:1.0:1762166804.937407:0:20128:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9be4d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.937414:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9be4d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:1.0:1762166804.937430:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x8:0x0]: returning size 0 00000004:00080000:1.0:1762166804.937842:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f:0x0], index 0: 0 00010000:00010000:1.0:1762166804.937982:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9be4d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.937990:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9be4d lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.937996:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9be4d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.938002:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166804.938006:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9be4d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.938014:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9be4d lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.938024:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x8:0x0].0x0 (ffff9ee34c83d900) 00010000:00010000:1.0:1762166804.938026:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166804.938035:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9be4d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.938041:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9be4d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166804.938091:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be46 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b0c expref: 16 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166804.938101:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:1.0:1762166804.938104:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166804.938107:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be46 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b0c expref: 16 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166804.938128:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14000, rc 0) 00000100:00100000:1.0:1762166804.938176:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:41806:x1847765444272000:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3837us (3969us total) trans 4294968947 rc 301/301 00000100:00100000:1.0:1762166804.938184:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2505 00000100:00100000:3.0:1762166804.941012:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166804.941061:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444272384 00000100:00100000:2.0:1762166804.941074:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444272384 00000100:00100000:2.0:1762166804.941206:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 745 00000100:00100000:2.0:1762166804.941216:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:41806:x1847765444272384:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166804.941551:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:41806:x1847765444272384:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 336us (551us total) trans 4294968948 rc 0/0 00000100:00100000:2.0:1762166804.941560:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 745 00000100:00100000:0.0:1762166804.943040:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166804.943082:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444272640 00000100:00100000:2.0:1762166804.943089:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444272640 00000100:00100000:2.0:1762166804.943146:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 746 00000100:00100000:2.0:1762166804.943155:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:41806:x1847765444272640:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166804.943307:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:41806:x1847765444272640:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 153us (269us total) trans 4294968949 rc 0/0 00000100:00100000:2.0:1762166804.943314:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 746 00000100:00100000:3.0:1762166804.949840:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166804.949947:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444272768 00000100:00100000:2.0:1762166804.949963:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444272768 00000100:00100000:2.0:1762166804.950048:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2506 00000100:00100000:2.0:1762166804.950059:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:41807:x1847765444272768:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:2.0:1762166804.950082:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166804.950106:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9be5b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b13 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166804.950174:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9be62 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950188:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9be62 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950217:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9be62 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950265:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9be69 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950273:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9be69 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950280:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9be69 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950358:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9be62 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950366:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9be62 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950373:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9be62 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950379:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166804.950383:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9be62 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950390:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9be62 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950401:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166804.950404:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166804.950408:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9be62 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950414:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9be62 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950432:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9be69 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950438:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9be69 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950443:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9be69 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950448:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166804.950451:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9be69 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950457:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9be69 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950464:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xba281655 (ffff9ee360714f00) 00010000:00010000:2.0:1762166804.950467:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166804.950469:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9be69 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950475:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9be69 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.950510:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9be5b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b13 expref: 18 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166804.950520:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166804.950522:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166804.950526:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9be5b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b13 expref: 18 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166804.950546:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14600, rc 0) 00000100:00100000:2.0:1762166804.950610:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:41807:x1847765444272768:12345-192.168.203.35@tcp:101:rm.0 Request processed in 552us (849us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166804.950617:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2506 00000100:00100000:3.0:1762166804.952170:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166804.952217:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444272896 00000100:00100000:2.0:1762166804.952224:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444272896 00000100:00100000:2.0:1762166804.952267:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2507 00000100:00100000:2.0:1762166804.952279:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:41807:x1847765444272896:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:2.0:1762166804.952293:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166804.952307:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9be70 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b1a expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166804.952374:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be77 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952385:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be77 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952394:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be77 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952408:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be7e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952415:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be7e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952421:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be7e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952477:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be77 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952484:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be77 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952491:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be77 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952496:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166804.952499:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be77 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952506:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be77 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952517:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166804.952520:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166804.952524:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be77 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952530:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be77 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952541:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be7e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952547:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be7e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952553:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be7e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952558:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166804.952567:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be7e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952573:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be7e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952581:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xba281655 (ffff9ee360714000) 00010000:00010000:2.0:1762166804.952583:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166804.952586:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be7e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952591:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be7e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.952618:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9be70 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b1a expref: 18 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166804.952628:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166804.952630:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166804.952633:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9be70 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b1a expref: 18 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166804.952643:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15600, rc 0) 00000100:00100000:2.0:1762166804.952694:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:41807:x1847765444272896:12345-192.168.203.35@tcp:101:rm.0 Request processed in 418us (528us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166804.952700:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2507 00000100:00100000:0.0:1762166804.962622:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166804.964882:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444273152 00000100:00100000:2.0:1762166804.964895:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444273152 00000100:00100000:2.0:1762166804.964964:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2508 00000100:00100000:2.0:1762166804.964974:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:41808:x1847765444273152:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166804.965008:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166804.965027:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9be85 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b21 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166804.965098:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be8c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965111:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be8c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965122:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be8c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965137:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be93 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965143:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be93 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965150:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be93 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965270:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9be9a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965278:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9be9a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965285:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9be9a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:2.0:1762166804.965294:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x8:0x0]: returning size 0 00010000:00010000:2.0:1762166804.965383:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be8c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965400:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be8c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965406:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be8c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965411:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166804.965414:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be8c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965421:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be8c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965432:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166804.965435:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166804.965439:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be8c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965445:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9be8c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965456:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be93 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965462:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be93 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965468:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be93 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965472:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166804.965475:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be93 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965490:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be93 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965497:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xeb4e88c0 (ffff9ee360714000) 00010000:00010000:2.0:1762166804.965500:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166804.965503:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be93 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965508:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9be93 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166804.965544:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9be85 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b21 expref: 20 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166804.965558:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9be9a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b21 expref: 19 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166804.965565:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x8:0x0].0x0 (ffff9ee360714f00) 00010000:00010000:2.0:1762166804.965567:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166804.965569:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14600, rc 0) 00000100:00100000:2.0:1762166804.965638:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:41808:x1847765444273152:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 666us (3025us total) trans 4294968950 rc 0/0 00000100:00100000:2.0:1762166804.965646:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2508 00000100:00100000:3.0:1762166804.969041:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166804.969146:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444273280 00000100:00100000:0.0:1762166804.969156:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444273280 00000100:00100000:0.0:1762166804.969238:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 894 00000100:00100000:0.0:1762166804.969250:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+5:2361:x1847765444273280:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166804.969266:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166804.969286:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bea8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b28 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166804.969591:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166804.969610:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166804.969612:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166804.969622:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bea8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b28 expref: 6 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166804.969640:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bea8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b28 expref: 6 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166804.969657:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159200, rc 0) 00000100:00080000:3.0:1762166804.969680:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166804.969806:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2361:x1847765444273280:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 557us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166804.969814:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 894 00000100:00100000:3.0:1762166804.971619:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166804.971669:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444273536 00000100:00100000:2.0:1762166804.971678:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444273536 00000100:00100000:2.0:1762166804.971732:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 747 00000100:00100000:2.0:1762166804.971742:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:41808:x1847765444273536:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166804.972071:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:41808:x1847765444273536:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 328us (454us total) trans 4294968951 rc 0/0 00000100:00100000:2.0:1762166804.972091:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 747 00000100:00100000:1.0:1762166804.973383:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166804.973469:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444273664 00000100:00100000:0.0:1762166804.973476:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444273664 00000100:00100000:0.0:1762166804.973535:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2509 00000100:00100000:0.0:1762166804.973544:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:41808:x1847765444273664:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166804.973562:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166804.973578:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9beaf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b2f expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166804.973631:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9beb6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973642:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9beb6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973649:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9beb6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973658:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9bebd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973662:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9bebd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973666:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9bebd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973717:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9beb6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973723:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9beb6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973728:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9beb6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973734:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166804.973744:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9beb6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973751:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9beb6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973806:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166804.973811:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166804.973817:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9beb6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973824:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9beb6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973837:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9bebd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973843:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9bebd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973849:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9bebd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973854:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166804.973857:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9bebd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973862:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9bebd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973870:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xba281655 (ffff9ee36062b100) 00010000:00010000:0.0:1762166804.973872:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166804.973875:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9bebd lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973891:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9bebd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.973930:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9beaf lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b2f expref: 21 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166804.973940:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166804.973942:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166804.973945:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9beaf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b2f expref: 21 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166804.973953:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159a00, rc 0) 00000100:00100000:0.0:1762166804.974014:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:41808:x1847765444273664:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 471us (635us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166804.974021:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2509 00000100:00100000:3.0:1762166804.975506:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166804.975573:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444273920 00000100:00100000:0.0:1762166804.975579:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444273920 00000100:00100000:0.0:1762166804.975611:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2510 00000100:00100000:0.0:1762166804.975617:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:41808:x1847765444273920:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166804.975630:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166804.975642:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9bec4 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b36 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166804.975725:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9becb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.975735:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9becb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.975753:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9becb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.975812:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9bed2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.975820:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9bed2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.975827:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9bed2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.976279:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bed9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.976288:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bed9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.976295:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bed9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:0.0:1762166804.976306:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x9:0x0]: returning size 0 00010000:00010000:0.0:1762166804.976328:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9becb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.976335:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9becb lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.976341:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9becb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.976347:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166804.976351:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9becb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.976368:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9becb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.976379:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166804.976381:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166804.976385:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9becb lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.976391:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9becb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000004:00010000:0.0:1762166804.976402:0:5756:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006f39f622 reply state 000000003fe7a81d transno 4294968952 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9bed2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:0.0:1762166804.976410:0:5756:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762166804.976433:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9bec4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b36 expref: 23 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166804.976445:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bed9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b36 expref: 22 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166804.976453:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x9:0x0].0x0 (ffff9ee36062bf00) 00010000:00010000:0.0:1762166804.976455:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166804.976458:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158000, rc 0) 00000100:00100000:0.0:1762166804.976515:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:41808:x1847765444273920:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 896us (1012us total) trans 4294968952 rc 0/0 00000100:00100000:0.0:1762166804.976523:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2510 00010000:00010000:1.0:1762166804.977427:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9bed2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.977436:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9bed2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.977442:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9bed2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.977447:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166804.977450:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9bed2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.977456:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9bed2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.977484:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xba281655 (ffff9ee36062b300) 00010000:00010000:1.0:1762166804.977488:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166804.977492:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9bed2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.977500:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9bed2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000100:00100000:3.0:1762166804.978280:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166804.978369:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444274176 00000100:00100000:0.0:1762166804.978377:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444274176 00000100:00100000:0.0:1762166804.978424:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2511 00000100:00100000:0.0:1762166804.978446:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:41808:x1847765444274176:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166804.978465:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166804.978477:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9bee7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b3d expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166804.978553:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9beee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.978564:0:5756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bed9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b36 expref: 23 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166804.978572:0:5756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9beee lrc: 4/0,1 mode: --/EX res: [0x200000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166804.978608:0:5756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bed9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b36 expref: 23 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166804.978622:0:5756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bed9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b36 expref: 23 pid: 5756 timeout: 525 lvb_type: 0 00000100:00100000:0.0:1762166804.978636:0:5756:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1847765451921920:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166804.978796:0:5756:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2430f7540 going to sleep for 11 seconds 00000100:00100000:3.0:1762166804.980550:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166804.980599:0:5756:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1847765451921920:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166804.980613:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444274304 00000100:00100000:2.0:1762166804.980621:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444274304 00010000:00010000:0.0:1762166804.980623:0:5756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9beee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166804.980652:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bed9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b36 expref: 24 pid: 5756 timeout: 525 lvb_type: 0 00000100:00100000:2.0:1762166804.980691:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 556 00000100:00100000:2.0:1762166804.980700:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444274304:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166804.980715:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166804.980721:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bed9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b36 expref: 24 pid: 5756 timeout: 525 lvb_type: 0 00010000:00010000:2.0:1762166804.980732:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bed9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b36 expref: 24 pid: 5756 timeout: 525 lvb_type: 0 00010000:00010000:2.0:1762166804.980752:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9bed9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b36 expref: 24 pid: 5756 timeout: 525 lvb_type: 0 00010000:00010000:2.0:1762166804.980812:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x9:0x0].0x0 (ffff9ee36062bf00) 00010000:00010000:2.0:1762166804.980817:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9beee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166804.980826:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9beee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166804.980833:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9beee lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166804.980857:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166804.980908:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444274304:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 208us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166804.980917:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 556 00010000:00010000:1.0:1762166804.980998:0:5756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9beee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.981012:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9beee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:1.0:1762166804.981029:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x9:0x0]: returning size 0 00000004:00080000:1.0:1762166804.981217:0:5756:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x59:0x0], index 1: 0 00010000:00010000:1.0:1762166804.981401:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9beee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.981409:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9beee lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.981415:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9beee lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.981420:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166804.981424:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9beee lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.981431:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9beee lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.981441:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x9:0x0].0x0 (ffff9ee36062bf00) 00010000:00010000:1.0:1762166804.981444:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166804.981447:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9beee lrc: 2/0,0 mode: --/EX res: [0x200000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.981453:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9beee lrc: 0/0,0 mode: --/EX res: [0x200000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166804.981524:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9bee7 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b3d expref: 23 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166804.981534:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:1.0:1762166804.981542:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166804.981547:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9bee7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b3d expref: 23 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166804.981557:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159c00, rc 0) 00000100:00100000:1.0:1762166804.981602:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:41808:x1847765444274176:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3159us (3325us total) trans 4294968953 rc 301/301 00000100:00100000:1.0:1762166804.981610:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2511 00000100:00100000:3.0:1762166804.983314:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166804.983360:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444274560 00000100:00100000:2.0:1762166804.983369:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444274560 00000100:00100000:2.0:1762166804.983422:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 748 00000100:00100000:2.0:1762166804.983436:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3719f8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:41808:x1847765444274560:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166804.983738:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3719f8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:41808:x1847765444274560:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 302us (427us total) trans 4294968954 rc 0/0 00000100:00100000:2.0:1762166804.983745:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 748 00000100:00100000:0.0:1762166804.985188:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166804.985230:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444274816 00000100:00100000:2.0:1762166804.985250:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444274816 00000100:00100000:2.0:1762166804.985291:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 749 00000100:00100000:2.0:1762166804.985302:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:41808:x1847765444274816:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166804.985445:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:41808:x1847765444274816:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 146us (263us total) trans 4294968955 rc 0/0 00000100:00100000:2.0:1762166804.985453:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 749 00000100:00100000:3.0:1762166804.998325:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166804.998393:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444275072 00000100:00100000:1.0:1762166804.998403:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444275072 00000100:00100000:1.0:1762166804.998465:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2512 00000100:00100000:1.0:1762166804.998474:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:41811:x1847765444275072:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166804.998499:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166804.998518:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9befc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b44 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1762166804.998635:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x7:0x0]: returning size 512 00010000:00010000:1.0:1762166804.998799:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9befc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b44 expref: 26 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166804.998814:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13700) 00010000:00010000:1.0:1762166804.998817:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166804.998823:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9befc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b44 expref: 26 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166804.998846:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452400, rc 0) 00000100:00100000:1.0:1762166804.998913:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:41811:x1847765444275072:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 439us (595us total) trans 4294968956 rc 301/301 00000100:00100000:1.0:1762166804.998934:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2512 00000100:00100000:3.0:1762166805.002864:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166805.002952:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444275200 00000100:00100000:1.0:1762166805.002962:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444275200 00000100:00100000:1.0:1762166805.003019:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2513 00000100:00100000:1.0:1762166805.003029:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:41811:x1847765444275200:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:1.0:1762166805.003117:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf0a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003131:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf0a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003141:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf0a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003154:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf11 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003160:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf11 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003166:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf11 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003258:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bf18 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003266:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bf18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003272:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bf18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:1.0:1762166805.003298:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x8:0x0]: returning size 0 00000004:00200000:1.0:1762166805.003313:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166805.003322:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bf18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003332:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf0a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003336:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf0a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003340:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf0a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003344:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166805.003346:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf0a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003351:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf0a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003358:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:1.0:1762166805.003360:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166805.003363:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf0a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003366:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf0a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003375:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf11 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003378:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf11 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003382:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf11 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003389:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166805.003391:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf11 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003394:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf11 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003399:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xeb4e88c0 (ffff9ee34c83d900) 00010000:00010000:1.0:1762166805.003400:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166805.003401:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf11 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003404:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf11 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003415:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bf18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003420:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bf18 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003426:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bf18 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003430:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166805.003433:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bf18 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003438:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bf18 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003444:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x8:0x0].0x0 (ffff9ee360714f00) 00010000:00010000:1.0:1762166805.003447:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166805.003456:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bf18 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166805.003461:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bf18 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000100:00100000:1.0:1762166805.003623:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:41811:x1847765444275200:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 594us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166805.003632:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2513 00000100:00100000:0.0:1762166805.006366:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166805.006624:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444275456 00000100:00100000:2.0:1762166805.006634:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444275456 00000100:00100000:2.0:1762166805.006693:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 750 00000100:00100000:2.0:1762166805.006702:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:41811:x1847765444275456:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166805.006989:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:41811:x1847765444275456:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 286us (638us total) trans 4294968957 rc 0/0 00000100:00100000:2.0:1762166805.006997:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 750 00000001:00080000:3.0:1762166805.687726:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869394 is committed 00010000:00010000:2.0:1762166805.864024:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1762166806.207989:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836717 is committed 00000001:00080000:1.0:1762166806.208008:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836718 is committed 00000001:00080000:3.0:1762166806.209138:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968952 is committed 00000001:00080000:3.0:1762166806.209149:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968956 is committed 00000001:00080000:3.0:1762166806.209160:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968957 is committed 00000100:00100000:3.0:1762166806.488372:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166806.488505:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444275712 00000100:00100000:1.0:1762166806.488522:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444275712 00000100:00100000:1.0:1762166806.488630:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2514 00000100:00100000:1.0:1762166806.488643:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:42172:x1847765444275712:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166806.488684:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166806.488706:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bf1f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b4b expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1762166806.488717:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1762166806.488868:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf26 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.488882:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf26 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.488894:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf26 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.488908:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf2d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.488915:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.488931:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.489048:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf26 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.489055:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf26 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.489061:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf26 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.489067:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166806.489072:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf26 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.489078:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf26 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.489095:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:1.0:1762166806.489099:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166806.489103:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf26 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.489109:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9bf26 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.489123:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.489129:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf2d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.489134:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf2d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.489146:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166806.489149:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf2d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.489155:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf2d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.489163:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xba281655 (ffff9ee34c83d900) 00010000:00010000:1.0:1762166806.489166:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166806.489168:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf2d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.489174:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9bf2d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:1.0:1762166806.489209:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bf1f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b4b expref: 14 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166806.489219:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:1.0:1762166806.489222:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166806.489226:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9bf1f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b4b expref: 14 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166806.489235:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452e00, rc 0) 00000100:00100000:1.0:1762166806.489314:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:42172:x1847765444275712:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 674us (957us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166806.489322:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2514 00000100:00100000:3.0:1762166806.491513:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166806.491706:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444275968 00000100:00100000:1.0:1762166806.491715:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444275968 00000100:00100000:1.0:1762166806.491809:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2515 00000100:00100000:1.0:1762166806.491819:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:42172:x1847765444275968:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166806.491836:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166806.491851:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bf34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b52 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1762166806.491955:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x7:0x0]: returning size 11776 00010000:00010000:1.0:1762166806.492119:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bf34 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b52 expref: 15 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166806.492132:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13700) 00010000:00010000:1.0:1762166806.492135:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166806.492140:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9bf34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b52 expref: 15 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166806.492152:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452400, rc 0) 00000100:00100000:1.0:1762166806.492203:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:42172:x1847765444275968:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 385us (694us total) trans 4294968958 rc 301/301 00000100:00100000:1.0:1762166806.492210:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2515 00000100:00100000:0.0:1762166806.494176:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166806.494350:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444276096 00000100:00100000:2.0:1762166806.494363:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444276096 00000100:00100000:2.0:1762166806.494407:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2516 00000100:00100000:2.0:1762166806.494417:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:42172:x1847765444276096:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166806.494471:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf42 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494485:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf42 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494497:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf42 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494511:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf49 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494518:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494524:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494615:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf50 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494623:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf50 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494629:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf50 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:2.0:1762166806.494663:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x9:0x0]: returning size 0 00000004:00200000:2.0:1762166806.494667:0:20128:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166806.494676:0:20128:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf50 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494696:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf42 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494702:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf42 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494709:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf42 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494715:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166806.494718:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf42 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494726:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf42 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494735:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166806.494738:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166806.494742:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf42 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494748:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf42 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494758:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494819:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf49 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494825:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf49 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494831:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166806.494839:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf49 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494846:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf49 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494854:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xba281655 (ffff9ee360714600) 00010000:00010000:2.0:1762166806.494857:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166806.494860:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf49 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494865:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf49 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494880:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf50 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494886:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf50 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494892:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf50 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494897:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166806.494899:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf50 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494905:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf50 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494911:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x9:0x0].0x0 (ffff9ee360714000) 00010000:00010000:2.0:1762166806.494913:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166806.494916:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf50 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166806.494930:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf50 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:2.0:1762166806.494993:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:42172:x1847765444276096:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 577us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166806.495001:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2516 00000100:00100000:3.0:1762166806.496793:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166806.496987:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444276352 00000100:00100000:0.0:1762166806.497002:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444276352 00000100:00100000:0.0:1762166806.497080:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 751 00000100:00100000:0.0:1762166806.497091:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:42172:x1847765444276352:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166806.497493:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:42172:x1847765444276352:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 402us (735us total) trans 4294968959 rc 0/0 00000100:00100000:0.0:1762166806.497502:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 751 00000100:00100000:3.0:1762166806.628317:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166806.628376:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166806.628434:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166806.628435:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444276480 00000100:00100000:0.0:1762166806.628450:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444276480 00000100:00100000:3.0:1762166806.628523:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166806.628531:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 499 00000100:00100000:0.0:1762166806.628549:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34bd44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2358:x1847765444276480:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762166806.628569:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444276736 00000100:00100000:3.0:1762166806.628578:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444276736 00000100:00100000:0.0:1762166806.628644:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34bd44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2358:x1847765444276480:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 97us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166806.628647:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444276864 00000100:00100000:3.0:1762166806.628652:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444276864 00000100:00100000:0.0:1762166806.628659:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 499 00000100:00100000:3.0:1762166806.628688:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 175 00000100:00100000:3.0:1762166806.628701:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2358:x1847765444276736:12345-192.168.203.35@tcp:400:kworker.0 00000100:00080000:0.0:1762166806.628735:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1762166806.628743:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166806.628816:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2358:x1847765444276736:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 65us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166806.628825:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 175 00000100:00100000:3.0:1762166806.628843:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 176 00000100:00100000:3.0:1762166806.628851:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2358:x1847765444276864:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762166806.628881:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2358:x1847765444276864:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 31us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166806.628888:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 176 00000100:00100000:2.0:1762166806.629115:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444276608 00000100:00100000:2.0:1762166806.629120:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444276608 00000100:00100000:2.0:1762166806.629178:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 220 00000100:00100000:2.0:1762166806.629187:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2358:x1847765444276608:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:2.0:1762166806.629248:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2358:x1847765444276608:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 62us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166806.629255:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 220 00000100:00100000:1.0:1762166806.696117:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1847765451922176:0@lo:400:kworker.0 00000100:00100000:0.0:1762166806.696122:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451922048:0@lo:400:kworker.0 00000100:00100000:3.0:1762166806.696135:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451922304:0@lo:400:kworker.0 00000100:00100000:2.0:1762166806.696136:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451922432:0@lo:400:kworker.0 00000100:00100000:0.0:1762166806.696225:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166806.696238:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166806.696239:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166806.696310:0:5749:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451922048 00000100:00100000:2.0:1762166806.696321:0:5749:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451922048 00000100:00100000:0.0:1762166806.696321:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765451922560:0@lo:400:kworker.0 00000100:00100000:1.0:1762166806.696328:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1847765451922688:0@lo:400:kworker.0 00000100:00100000:3.0:1762166806.696351:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451922304 00000100:00100000:3.0:1762166806.696358:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451922304 00000100:00100000:0.0:1762166806.696376:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166806.696396:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1762166806.696414:0:5749:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34bd47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765451922048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166806.696439:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451922176 00000100:00100000:3.0:1762166806.696446:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1762166806.696451:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451922176 00000100:00100000:3.0:1762166806.696459:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451922304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166806.696507:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451922560 00000100:00100000:1.0:1762166806.696514:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451922560 00000100:00100000:3.0:1762166806.696523:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451922304:12345-0@lo:400:kworker.0 Request processed in 66us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166806.696538:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1762166806.696546:0:5749:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34bd47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765451922048:12345-0@lo:400:kworker.0 Request processed in 138us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166806.696560:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166806.696565:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1762166806.696574:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1762166806.696605:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1847765451922176:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1762166806.696611:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1762166806.696621:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166806.696649:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451922688 00000100:00100000:0.0:1762166806.696656:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451922688 00000100:00100000:2.0:1762166806.696662:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1762166806.696679:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765451922560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166806.696680:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166806.696712:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1847765451922176:12345-0@lo:400:kworker.0 Request processed in 120us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166806.696716:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1762166806.696731:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1762166806.696739:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1847765451922688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166806.696757:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765451922560:12345-0@lo:400:kworker.0 Request processed in 80us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166806.696816:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451922432 00000100:00100000:3.0:1762166806.696823:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451922432 00000100:00100000:2.0:1762166806.696833:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1762166806.696877:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1847765451922176:0@lo:400:kworker.0 00000100:00100000:0.0:1762166806.696879:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1847765451922688:12345-0@lo:400:kworker.0 Request processed in 146us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166806.696908:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1762166806.696909:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1762166806.696926:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451922048:0@lo:400:kworker.0 00000100:00100000:1.0:1762166806.696927:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1847765451922688:0@lo:400:kworker.0 00000100:00100000:3.0:1762166806.696928:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3294:x1847765451922432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166806.696983:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765451922560:0@lo:400:kworker.0 00000100:00100000:3.0:1762166806.697020:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3294:x1847765451922432:12345-0@lo:400:kworker.0 Request processed in 97us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166806.697020:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836718 gen 2 00000004:00080000:0.0:1762166806.697035:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f27aa00, transno 21474836711 00000100:00100000:3.0:1762166806.697044:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1762166806.697059:0:3294:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869394 gen 2 00000100:00080000:2.0:1762166806.697065:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1762166806.697066:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f279f80, transno 21474836712 00000004:00080000:1.0:1762166806.697067:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317f480, transno 17179869389 00000100:00080000:2.0:1762166806.697073:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1762166806.697084:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f279500, transno 21474836713 00000004:00080000:0.0:1762166806.697092:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f27a680, transno 21474836714 00000004:00080000:1.0:1762166806.697093:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317d180, transno 17179869390 00000004:00080000:0.0:1762166806.697101:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f27b800, transno 21474836715 00000004:00080000:1.0:1762166806.697108:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317ed80, transno 17179869391 00000004:00080000:0.0:1762166806.697111:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f27b100, transno 21474836716 00000004:00080000:1.0:1762166806.697116:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317e300, transno 17179869392 00000004:00080000:0.0:1762166806.697117:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f278380, transno 21474836717 00000004:00080000:1.0:1762166806.697123:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317ea00, transno 17179869393 00000004:00080000:0.0:1762166806.697124:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f27ad80, transno 21474836718 00000004:00080000:1.0:1762166806.697130:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317c700, transno 17179869394 00000100:00100000:0.0:1762166806.697135:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451922304:0@lo:400:kworker.0 00000100:00100000:1.0:1762166806.697139:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451922432:0@lo:400:kworker.0 00000004:00080000:1.0:1762166806.697565:0:6728:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 8 done 00000004:00080000:2.0:1762166806.697679:0:7836:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 4 done 00010000:00010000:0.0:1762166806.888031:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166807.912020:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166807.979526:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166807.979592:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444277120 00000100:00100000:2.0:1762166807.979603:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444277120 00000100:00100000:2.0:1762166807.979660:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2517 00000100:00100000:2.0:1762166807.979670:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:42531:x1847765444277120:12345-192.168.203.35@tcp:36:rm.0 00010000:00010000:2.0:1762166807.979727:0:20128:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166807.979749:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9be9a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b21 expref: 15 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166807.979801:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x8:0x0].0x0 (ffff9ee360714f00) 00010000:00010000:2.0:1762166807.979810:0:20128:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166807.979830:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf57 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.979844:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf57 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.979864:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf57 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.979878:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf5e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.979884:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf5e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.979908:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf5e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980014:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf65 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980020:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf65 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980024:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf65 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000040:00080000:2.0:1762166807.980367:0:20128:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].117, 64 off17592 00000004:00080000:2.0:1762166807.980377:0:20128:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 428772613338ns, next at 429772610838ns, rc = 0 00010000:00010000:2.0:1762166807.980424:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9bf6c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980430:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9bf6c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980435:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9bf6c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980440:0:20128:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9bf6c lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980444:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9bf6c lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980447:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9bf6c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980464:0:20128:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166807.980477:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf65 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166807.980485:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166807.980487:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf65 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166807.980493:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9bf6c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980494:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf65 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980508:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166807.980512:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166807.980513:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf65 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166807.980519:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9bf6c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980520:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf65 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980536:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x8:0x0].0x0 (ffff9ee360714600) 00010000:00010000:0.0:1762166807.980537:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9bf6c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980540:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1762166807.980544:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf65 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980550:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf65 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166807.980554:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x8:0x0].0x0 (ffff9ee360714600) 00010000:00010000:0.0:1762166807.980558:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166807.980562:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9bf6c lrc: 1/0,0 mode: --/PW res: [0x200000404:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166807.980568:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9bf6c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980585:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf57 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980590:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf57 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980594:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf57 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166807.980595:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166807.980599:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166807.980600:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166807.980605:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf57 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166807.980605:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166807.980618:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf57 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980624:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166807.980625:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166807.980627:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf57 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.980630:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf57 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000004:00010000:2.0:1762166807.980636:0:20128:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d6e4d35f reply state 000000002d9c75be transno 4294968960 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf5e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:2.0:1762166807.980642:0:20128:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166807.980711:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:42531:x1847765444277120:12345-192.168.203.35@tcp:36:rm.0 Request processed in 1040us (1190us total) trans 4294968960 rc 0/0 00000100:00100000:2.0:1762166807.980718:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2517 00010000:00010000:2.0:1762166807.981603:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf5e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.981612:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf5e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.981618:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf5e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.981623:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166807.981626:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf5e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.981632:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf5e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.981651:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xeb4e88c0 (ffff9ee360714000) 00010000:00010000:2.0:1762166807.981653:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166807.981657:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf5e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.981663:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf5e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:3.0:1762166807.988081:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166807.988132:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444277376 00000100:00100000:2.0:1762166807.988142:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444277376 00000100:00100000:2.0:1762166807.988202:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2518 00000100:00100000:2.0:1762166807.988213:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:42532:x1847765444277376:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166807.988250:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166807.988276:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf73 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b59 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166807.988405:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf7a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.988419:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf7a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.988430:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf7a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.988453:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bf81 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.988462:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bf81 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.988468:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bf81 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.988939:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bf88 lrc: 3/1,0 mode: --/PR res: [0x200000404:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.988948:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bf88 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.988955:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bf88 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:2.0:1762166807.988963:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xa:0x0]: returning size 0 00010000:00010000:2.0:1762166807.988985:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf7a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.988992:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf7a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.988997:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf7a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.989003:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166807.989006:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf7a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.989013:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf7a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.989023:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166807.989027:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166807.989031:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf7a lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.989036:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bf7a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000004:00010000:2.0:1762166807.989058:0:20128:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009a9d3810 reply state 00000000422e678a transno 4294968961 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bf81 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:2.0:1762166807.989065:0:20128:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166807.989089:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bf73 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b59 expref: 18 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166807.989102:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bf88 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b59 expref: 17 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166807.989109:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xa:0x0].0x0 (ffff9ee360714100) 00010000:00010000:2.0:1762166807.989111:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166807.989113:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14a00, rc 0) 00000100:00100000:2.0:1762166807.989175:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:42532:x1847765444277376:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 965us (1104us total) trans 4294968961 rc 0/0 00000100:00100000:2.0:1762166807.989184:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2518 00010000:00010000:1.0:1762166807.989927:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bf81 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166807.989937:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bf81 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166807.989946:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bf81 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166807.989951:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166807.989954:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bf81 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166807.989971:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bf81 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166807.989980:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xeb4e88c0 (ffff9ee360714f00) 00010000:00010000:1.0:1762166807.989982:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166807.989985:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bf81 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166807.989991:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9bf81 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:3.0:1762166807.990550:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166807.990668:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444277632 00000100:00100000:2.0:1762166807.990676:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444277632 00000100:00100000:2.0:1762166807.990724:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2519 00000100:00100000:2.0:1762166807.990733:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:42532:x1847765444277632:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166807.990751:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166807.990798:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf96 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b60 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166807.990896:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bf9d lrc: 3/0,1 mode: --/EX res: [0x200000404:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.990910:0:20128:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bf88 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b59 expref: 18 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166807.990926:0:20128:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bf9d lrc: 4/0,1 mode: --/EX res: [0x200000404:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.990959:0:20128:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bf88 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b59 expref: 18 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166807.990974:0:20128:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bf88 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b59 expref: 18 pid: 20128 timeout: 528 lvb_type: 0 00000100:00100000:2.0:1762166807.990990:0:20128:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20128:1847765451922816:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166807.991075:0:20128:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166807.992469:0:20128:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20128:1847765451922816:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166807.992497:0:20128:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bf9d lrc: 3/0,1 mode: --/EX res: [0x200000404:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:3.0:1762166807.992606:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166807.992710:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444277760 00000100:00100000:0.0:1762166807.992720:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444277760 00010000:00010000:0.0:1762166807.992758:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bf88 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b59 expref: 19 pid: 20128 timeout: 528 lvb_type: 0 00000100:00100000:0.0:1762166807.992835:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 557 00000100:00100000:0.0:1762166807.992843:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765444277760:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166807.992857:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166807.992864:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bf88 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b59 expref: 19 pid: 20128 timeout: 528 lvb_type: 0 00010000:00010000:0.0:1762166807.992878:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bf88 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b59 expref: 19 pid: 20128 timeout: 528 lvb_type: 0 00010000:00010000:0.0:1762166807.992904:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9bf88 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b59 expref: 19 pid: 20128 timeout: 528 lvb_type: 0 00010000:00010000:0.0:1762166807.992925:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xa:0x0].0x0 (ffff9ee360714100) 00010000:00010000:0.0:1762166807.992930:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bf9d lrc: 3/0,1 mode: --/EX res: [0x200000404:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166807.992939:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bf9d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166807.992945:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bf9d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166807.992987:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166807.993012:0:20128:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bf9d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.993023:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bf9d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:2.0:1762166807.993039:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xa:0x0]: returning size 0 00000100:00100000:0.0:1762166807.993057:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765444277760:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 213us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166807.993067:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 557 00000004:00080000:2.0:1762166807.993340:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5a:0x0], index 1: 0 00000004:00080000:2.0:1762166807.993352:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x60:0x0], index 0: 0 00010000:00010000:2.0:1762166807.993479:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bf9d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.993488:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bf9d lrc: 2/0,0 mode: EX/EX res: [0x200000404:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.993508:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bf9d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.993513:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166807.993516:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bf9d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.993523:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bf9d lrc: 4/0,0 mode: EX/EX res: [0x200000404:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.993536:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xa:0x0].0x0 (ffff9ee360714100) 00010000:00010000:2.0:1762166807.993539:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166807.993543:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bf9d lrc: 2/0,0 mode: --/EX res: [0x200000404:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.993548:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bf9d lrc: 0/0,0 mode: --/EX res: [0x200000404:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166807.993599:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf96 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b60 expref: 18 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166807.993608:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166807.993610:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166807.993614:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bf96 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b60 expref: 18 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166807.993622:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14200, rc 0) 00000100:00100000:2.0:1762166807.993680:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:42532:x1847765444277632:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2948us (3132us total) trans 4294968962 rc 301/301 00000100:00100000:2.0:1762166807.993689:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2519 00000100:00100000:3.0:1762166807.995409:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166807.995489:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444278016 00000100:00100000:2.0:1762166807.995497:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444278016 00000100:00100000:2.0:1762166807.995545:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 752 00000100:00100000:2.0:1762166807.995553:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:42532:x1847765444278016:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166807.995854:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:42532:x1847765444278016:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 300us (450us total) trans 4294968963 rc 0/0 00000100:00100000:2.0:1762166807.995862:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 752 00000100:00100000:0.0:1762166807.997077:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166807.997130:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444278144 00000100:00100000:2.0:1762166807.997137:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444278144 00000100:00100000:2.0:1762166807.997183:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2520 00000100:00100000:2.0:1762166807.997194:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:42532:x1847765444278144:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166807.997210:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166807.997231:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bfab lrc: 2/0,0 mode: --/CR res: [0x200000404:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b67 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166807.997297:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bfab lrc: 3/0,0 mode: CR/CR res: [0x200000404:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b67 expref: 19 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166807.997312:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bfab lrc: 3/0,0 mode: CR/CR res: [0x200000404:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b67 expref: 19 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166807.997331:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xa:0x0].0x0 (ffff9ee360714000) 00010000:00010000:2.0:1762166807.997335:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166807.997338:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14000, rc 0) 00000100:00100000:2.0:1762166807.997385:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:42532:x1847765444278144:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 194us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166807.997392:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2520 00000100:00100000:3.0:1762166807.998898:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166807.999001:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444278400 00000100:00100000:2.0:1762166807.999012:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444278400 00000100:00100000:2.0:1762166807.999079:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 753 00000100:00100000:2.0:1762166807.999090:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:42532:x1847765444278400:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166807.999353:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:42532:x1847765444278400:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 264us (466us total) trans 4294968964 rc 0/0 00000100:00100000:2.0:1762166807.999363:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 753 00000100:00100000:3.0:1762166808.004493:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.004622:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444278528 00000100:00100000:2.0:1762166808.004639:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444278528 00000100:00080000:3.0:1762166808.004723:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166808.004753:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2521 00000100:00100000:2.0:1762166808.004827:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:42533:x1847765444278528:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:2.0:1762166808.004861:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166808.004889:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bfb2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b6e expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.004982:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bfb9 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005001:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bfb9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005028:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bfb9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005048:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bfc0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005056:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bfc0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005063:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bfc0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005223:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9bfc7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005232:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9bfc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005240:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9bfc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:2.0:1762166808.005284:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x9:0x0]: returning size 0 00000004:00200000:2.0:1762166808.005290:0:20128:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166808.005310:0:20128:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9bfc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005324:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9bfc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005333:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bfb9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005341:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bfb9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005347:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bfb9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005354:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.005359:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bfb9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005367:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bfb9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005380:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.005392:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.005398:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bfb9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005405:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9bfb9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005420:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bfc0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005426:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bfc0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005431:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bfc0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005437:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.005440:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bfc0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005447:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bfc0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005454:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xba281655 (ffff9ee360714100) 00010000:00010000:2.0:1762166808.005456:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.005459:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bfc0 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005465:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9bfc0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.005500:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bfb2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b6e expref: 22 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.005526:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9bfc7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b6e expref: 21 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.005534:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x9:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:2.0:1762166808.005537:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166808.005540:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15a00, rc 0) 00000100:00100000:2.0:1762166808.005624:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:42533:x1847765444278528:12345-192.168.203.35@tcp:101:rm.0 Request processed in 805us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166808.005633:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2521 00000100:00100000:0.0:1762166808.007607:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166808.007743:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444278656 00000100:00100000:3.0:1762166808.007757:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444278656 00000100:00080000:2.0:1762166808.007875:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166808.007879:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 895 00000100:00100000:3.0:1762166808.007893:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2358:x1847765444278656:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:3.0:1762166808.007912:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166808.007934:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee243444000/0xf915a5bdf3c9bfce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b75 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166808.007963:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166808.007984:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166808.007986:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166808.007996:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee243444000/0xf915a5bdf3c9bfce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b75 expref: 7 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166808.008029:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee243444000/0xf915a5bdf3c9bfce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b75 expref: 7 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166808.008038:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243444000, rc 0) 00000100:00100000:3.0:1762166808.008087:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2358:x1847765444278656:12345-192.168.203.35@tcp:101:rm.0 Request processed in 198us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166808.008094:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 895 00000100:00100000:3.0:1762166808.009647:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.009750:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444278912 00000100:00100000:2.0:1762166808.009758:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444278912 00000100:00100000:2.0:1762166808.009845:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2522 00000100:00100000:2.0:1762166808.009855:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:42533:x1847765444278912:12345-192.168.203.35@tcp:36:rm.0 00010000:00010000:2.0:1762166808.009905:0:20128:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166808.009929:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9bfc7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b6e expref: 21 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.009947:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x9:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:2.0:1762166808.009958:0:20128:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166808.009981:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bfd5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.009993:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bfd5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010000:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bfd5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010021:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bfdc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010026:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bfdc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010032:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bfdc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010138:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bfe3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010146:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bfe3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010152:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bfe3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000040:00080000:2.0:1762166808.010462:0:20128:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].114, 64 off17312 00000004:00080000:2.0:1762166808.010472:0:20128:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 428802708426ns, next at 429802705970ns, rc = 0 00010000:00010000:2.0:1762166808.010528:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9bfea lrc: 3/0,1 mode: --/PW res: [0x200000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010538:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9bfea lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010545:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9bfea lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010552:0:20128:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9bfea lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010557:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9bfea lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010570:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9bfea lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010595:0:20128:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166808.010613:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bfe3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010618:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bfe3 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010624:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bfe3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010630:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.010634:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bfe3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010640:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bfe3 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010649:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x9:0x0].0x0 (ffff9ee360714500) 00010000:00010000:2.0:1762166808.010652:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1762166808.010655:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bfe3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166808.010657:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166808.010661:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bfe3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166808.010663:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9bfea lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166808.010668:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166808.010671:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9bfea lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166808.010676:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9bfea lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166808.010684:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x9:0x0].0x0 (ffff9ee360714500) 00010000:00010000:0.0:1762166808.010686:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166808.010688:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9bfea lrc: 1/0,0 mode: --/PW res: [0x200000404:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166808.010693:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9bfea lrc: 0/0,0 mode: --/PW res: [0x200000404:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010703:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bfd5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166808.010704:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166808.010706:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166808.010708:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166808.010710:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bfd5 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010724:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bfd5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010729:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.010732:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bfd5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010738:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bfd5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010746:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.010748:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.010751:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bfd5 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.010756:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9bfd5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000004:00010000:2.0:1762166808.010942:0:20128:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a47485cf reply state 00000000b465349f transno 4294968965 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bfdc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:2.0:1762166808.010951:0:20128:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166808.011026:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:42533:x1847765444278912:12345-192.168.203.35@tcp:36:rm.0 Request processed in 1172us (1383us total) trans 4294968965 rc 0/0 00000100:00100000:2.0:1762166808.011033:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2522 00010000:00010000:2.0:1762166808.012017:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bfdc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.012026:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bfdc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.012030:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bfdc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.012040:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.012042:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bfdc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.012046:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bfdc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.012054:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xba281655 (ffff9ee360714800) 00010000:00010000:2.0:1762166808.012056:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.012058:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bfdc lrc: 2/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.012062:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9bfdc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:3.0:1762166808.018595:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.018654:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444279168 00000100:00100000:2.0:1762166808.018664:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444279168 00000100:00100000:2.0:1762166808.018717:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2523 00000100:00100000:2.0:1762166808.018728:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:42534:x1847765444279168:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166808.018752:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166808.018803:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bff1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b7c expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.018902:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9bff8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.018915:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9bff8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.018927:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9bff8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.018959:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bfff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.018967:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bfff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.018974:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bfff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.019097:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c006 lrc: 3/1,0 mode: --/PR res: [0x200000404:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.019106:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c006 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.019113:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c006 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:2.0:1762166808.019122:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xa:0x0]: returning size 0 00010000:00010000:2.0:1762166808.019215:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9bff8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.019223:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9bff8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.019230:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9bff8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.019236:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.019241:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9bff8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.019248:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9bff8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.019268:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.019271:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.019276:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9bff8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.019283:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9bff8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.019296:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bfff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.019302:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bfff lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.019308:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bfff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.019314:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.019316:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bfff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.019329:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bfff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.019336:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xeb4e88c0 (ffff9ee360714b00) 00010000:00010000:2.0:1762166808.019338:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.019341:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bfff lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.019347:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9bfff lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.019386:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9bff1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b7c expref: 24 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.019407:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c006 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b7c expref: 23 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.019415:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xa:0x0].0x0 (ffff9ee360714000) 00010000:00010000:2.0:1762166808.019417:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166808.019420:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15600, rc 0) 00000100:00100000:2.0:1762166808.019483:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:42534:x1847765444279168:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 756us (897us total) trans 4294968966 rc 0/0 00000100:00100000:2.0:1762166808.019491:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2523 00000100:00100000:0.0:1762166808.021315:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166808.021352:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166808.021415:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444279296 00000100:00100000:3.0:1762166808.021423:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444279296 00000100:00100000:1.0:1762166808.021476:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444279424 00000100:00100000:3.0:1762166808.021483:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 896 00000100:00100000:1.0:1762166808.021484:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444279424 00000100:00100000:3.0:1762166808.021497:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2361:x1847765444279296:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166808.021512:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166808.021529:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c014 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b83 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166808.021539:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 897 00002000:00010000:3.0:1762166808.021551:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00100000:1.0:1762166808.021552:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2361:x1847765444279424:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166808.021566:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166808.021571:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166808.021575:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166808.021580:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c01b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b8a expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166808.021585:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c014 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b83 expref: 8 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166808.021605:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c014 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b83 expref: 8 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166808.021634:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243444400, rc 0) 00000100:00080000:2.0:1762166808.021685:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166808.021691:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2361:x1847765444279296:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 198us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166808.021699:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 896 00002000:00010000:1.0:1762166808.021889:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166808.021901:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166808.021903:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166808.021909:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c01b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b8a expref: 7 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166808.021921:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c01b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b8a expref: 7 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166808.021929:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452200, rc 0) 00000100:00100000:1.0:1762166808.021969:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2361:x1847765444279424:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 422us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166808.021976:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 897 00000100:00100000:0.0:1762166808.023195:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.023254:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444279680 00000100:00100000:2.0:1762166808.023260:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444279680 00000100:00100000:2.0:1762166808.023307:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 754 00000100:00100000:2.0:1762166808.023317:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3719fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:42534:x1847765444279680:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166808.023612:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3719fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:42534:x1847765444279680:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 295us (419us total) trans 4294968967 rc 0/0 00000100:00100000:2.0:1762166808.023619:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 754 00000100:00100000:0.0:1762166808.025187:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.025234:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444279808 00000100:00100000:2.0:1762166808.025240:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444279808 00000100:00100000:2.0:1762166808.025283:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2524 00000100:00100000:2.0:1762166808.025292:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:42534:x1847765444279808:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166808.025308:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166808.025325:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c022 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b91 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.025379:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c029 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025400:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c029 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025410:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c029 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025426:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c030 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025432:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c030 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025439:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c030 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025496:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c029 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025504:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c029 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025510:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c029 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025516:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.025519:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c029 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025526:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c029 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025538:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.025541:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.025553:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c029 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025559:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c029 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025573:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c030 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025578:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c030 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025584:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c030 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025589:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.025591:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c030 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025596:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c030 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025603:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xba281655 (ffff9ee360714800) 00010000:00010000:2.0:1762166808.025605:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.025608:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c030 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025614:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c030 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.025643:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c022 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b91 expref: 25 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.025653:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.025661:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.025665:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c022 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b91 expref: 25 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.025674:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15200, rc 0) 00000100:00100000:2.0:1762166808.025716:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:42534:x1847765444279808:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 425us (532us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166808.025723:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2524 00000100:00100000:0.0:1762166808.027300:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.027346:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444280064 00000100:00100000:2.0:1762166808.027353:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444280064 00000100:00100000:2.0:1762166808.027399:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2525 00000100:00100000:2.0:1762166808.027409:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:42534:x1847765444280064:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166808.027424:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166808.027437:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c037 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b98 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.027535:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c03e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.027545:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c03e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.027551:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c03e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.027559:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c045 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.027563:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c045 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.027566:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c045 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.028066:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c04c lrc: 3/1,0 mode: --/PR res: [0x200000404:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.028075:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c04c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.028083:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c04c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:2.0:1762166808.028093:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xb:0x0]: returning size 0 00010000:00010000:2.0:1762166808.028116:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c03e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.028123:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c03e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.028129:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c03e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.028135:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.028138:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c03e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.028145:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c03e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.028154:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.028157:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.028161:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c03e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.028166:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c03e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000004:00010000:2.0:1762166808.028187:0:20128:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000004bc3636 reply state 00000000cf1c4b90 transno 4294968968 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c045 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:2.0:1762166808.028195:0:20128:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166808.028220:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c037 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b98 expref: 27 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.028233:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c04c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b98 expref: 26 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.028240:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xb:0x0].0x0 (ffff9ee360714100) 00010000:00010000:2.0:1762166808.028242:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166808.028244:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15e00, rc 0) 00000100:00100000:2.0:1762166808.028302:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:42534:x1847765444280064:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 895us (1004us total) trans 4294968968 rc 0/0 00000100:00100000:2.0:1762166808.028310:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2525 00010000:00010000:1.0:1762166808.029326:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c045 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166808.029337:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c045 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166808.029342:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c045 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166808.029347:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166808.029351:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c045 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166808.029357:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c045 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166808.029367:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xba281655 (ffff9ee360714b00) 00010000:00010000:1.0:1762166808.029370:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166808.029373:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c045 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166808.029378:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c045 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:0.0:1762166808.030262:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.030313:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444280320 00000100:00100000:2.0:1762166808.030321:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444280320 00000100:00100000:2.0:1762166808.030365:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2526 00000100:00100000:2.0:1762166808.030375:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:42534:x1847765444280320:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166808.030394:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166808.030406:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9c05a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90b9f expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.030474:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c061 lrc: 3/0,1 mode: --/EX res: [0x200000404:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.030486:0:20128:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c04c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b98 expref: 27 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.030507:0:20128:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c061 lrc: 4/0,1 mode: --/EX res: [0x200000404:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.030537:0:20128:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c04c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b98 expref: 27 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.030549:0:20128:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c04c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b98 expref: 27 pid: 20128 timeout: 528 lvb_type: 0 00000100:00100000:2.0:1762166808.030562:0:20128:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20128:1847765451922944:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166808.030636:0:20128:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242543540 going to sleep for 11 seconds 00000100:00100000:2.0:1762166808.031591:0:20128:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20128:1847765451922944:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166808.031612:0:20128:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c061 lrc: 3/0,1 mode: --/EX res: [0x200000404:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:0.0:1762166808.031847:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.031926:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444280448 00000100:00100000:2.0:1762166808.031932:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444280448 00010000:00010000:2.0:1762166808.031955:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c04c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b98 expref: 28 pid: 20128 timeout: 528 lvb_type: 0 00000100:00100000:2.0:1762166808.031991:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 558 00000100:00100000:2.0:1762166808.031999:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444280448:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166808.032010:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166808.032015:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c04c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b98 expref: 28 pid: 20128 timeout: 528 lvb_type: 0 00010000:00010000:2.0:1762166808.032025:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c04c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b98 expref: 28 pid: 20128 timeout: 528 lvb_type: 0 00010000:00010000:2.0:1762166808.032050:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c04c lrc: 0/0,0 mode: --/PR res: [0x200000404:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b98 expref: 28 pid: 20128 timeout: 528 lvb_type: 0 00010000:00010000:2.0:1762166808.032062:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xb:0x0].0x0 (ffff9ee360714100) 00010000:00010000:2.0:1762166808.032066:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c061 lrc: 3/0,1 mode: --/EX res: [0x200000404:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.032073:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c061 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.032080:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c061 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.032101:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166808.032140:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444280448:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 138us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166808.032148:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 558 00010000:00010000:3.0:1762166808.032303:0:20128:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c061 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166808.032312:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c061 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166808.032326:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xb:0x0]: returning size 0 00000004:00080000:3.0:1762166808.032472:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5b:0x0], index 1: 0 00000004:00080000:3.0:1762166808.032479:0:20128:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x61:0x0], index 0: 0 00010000:00010000:3.0:1762166808.032602:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c061 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166808.032611:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c061 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166808.032617:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c061 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166808.032621:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166808.032624:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c061 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166808.032631:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c061 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166808.032639:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xb:0x0].0x0 (ffff9ee360714100) 00010000:00010000:3.0:1762166808.032649:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166808.032653:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c061 lrc: 2/0,0 mode: --/EX res: [0x200000404:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166808.032659:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c061 lrc: 0/0,0 mode: --/EX res: [0x200000404:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166808.032703:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9c05a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b9f expref: 27 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166808.032712:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166808.032715:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166808.032719:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9c05a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b9f expref: 27 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166808.032728:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14e00, rc 0) 00000100:00100000:3.0:1762166808.032795:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:42534:x1847765444280320:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2390us (2503us total) trans 4294968969 rc 301/301 00000100:00100000:3.0:1762166808.032804:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2526 00000100:00100000:0.0:1762166808.033940:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.034018:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444280704 00000100:00100000:2.0:1762166808.034024:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444280704 00000100:00100000:2.0:1762166808.034063:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 755 00000100:00100000:2.0:1762166808.034072:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:42534:x1847765444280704:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166808.034300:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:42534:x1847765444280704:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 228us (362us total) trans 4294968970 rc 0/0 00000100:00100000:2.0:1762166808.034308:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 755 00000100:00100000:0.0:1762166808.035644:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.035725:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444280960 00000100:00100000:2.0:1762166808.035730:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444280960 00000100:00100000:0.0:1762166808.035800:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 756 00000100:00100000:0.0:1762166808.035810:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:42534:x1847765444280960:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166808.035956:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:42534:x1847765444280960:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 149us (314us total) trans 4294968971 rc 0/0 00000100:00100000:0.0:1762166808.035961:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 756 00000100:00100000:0.0:1762166808.049258:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166808.049545:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444281216 00000100:00100000:3.0:1762166808.049555:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444281216 00000100:00100000:3.0:1762166808.049614:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2527 00000100:00100000:3.0:1762166808.049626:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:42537:x1847765444281216:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166808.049650:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166808.049670:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c06f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ba6 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1762166808.049815:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x7:0x0]: returning size 11776 00010000:00010000:3.0:1762166808.049965:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c06f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ba6 expref: 30 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166808.050002:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13700) 00010000:00010000:3.0:1762166808.050006:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166808.050013:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c06f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ba6 expref: 30 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166808.050025:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445800, rc 0) 00000100:00100000:3.0:1762166808.050090:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:42537:x1847765444281216:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 466us (842us total) trans 4294968972 rc 301/301 00000100:00100000:3.0:1762166808.050098:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2527 00000100:00100000:3.0:1762166808.051921:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.052064:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444281344 00000100:00100000:2.0:1762166808.052069:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444281344 00000100:00100000:2.0:1762166808.052114:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2528 00000100:00100000:2.0:1762166808.052121:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:42537:x1847765444281344:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166808.052167:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c07d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052178:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c07d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052187:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c07d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052196:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c084 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052201:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c084 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052205:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c084 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052277:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c08b lrc: 3/1,0 mode: --/PR res: [0x200000404:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052282:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c08b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052285:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c08b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:2.0:1762166808.052307:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xa:0x0]: returning size 0 00000004:00200000:2.0:1762166808.052310:0:20128:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166808.052319:0:20128:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c08b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052329:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c07d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052341:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c07d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052347:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c07d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052352:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.052356:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c07d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052363:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c07d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052373:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.052376:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.052380:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c07d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052386:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c07d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052397:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c084 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052404:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c084 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052409:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c084 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052414:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.052417:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c084 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052432:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c084 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052440:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xeb4e88c0 (ffff9ee360714800) 00010000:00010000:2.0:1762166808.052442:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.052444:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c084 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052448:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c084 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052459:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c08b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052462:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c08b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052466:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c08b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052469:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.052470:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c08b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052473:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c08b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052476:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xa:0x0].0x0 (ffff9ee360714000) 00010000:00010000:2.0:1762166808.052478:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.052479:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c08b lrc: 2/0,0 mode: --/PR res: [0x200000404:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.052482:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c08b lrc: 0/0,0 mode: --/PR res: [0x200000404:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:2.0:1762166808.052532:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:42537:x1847765444281344:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 411us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166808.052540:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2528 00000100:00100000:0.0:1762166808.053610:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166808.053676:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444281600 00000100:00100000:3.0:1762166808.053683:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444281600 00000100:00100000:3.0:1762166808.053728:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 757 00000100:00100000:3.0:1762166808.053738:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:42537:x1847765444281600:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166808.053971:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:42537:x1847765444281600:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 234us (363us total) trans 4294968973 rc 0/0 00000100:00100000:3.0:1762166808.053978:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 757 00000100:00100000:0.0:1762166808.196632:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.196706:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444281856 00000100:00100000:2.0:1762166808.196716:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444281856 00000100:00100000:2.0:1762166808.196816:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2529 00000100:00100000:2.0:1762166808.196828:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:42571:x1847765444281856:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166808.196849:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166808.196868:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c092 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90bad expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.196935:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c099 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.196947:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c099 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.196958:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c099 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.196970:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c0a0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.196977:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.196983:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.197069:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c099 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.197087:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c099 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.197093:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c099 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.197099:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.197103:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c099 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.197109:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c099 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.197119:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.197121:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.197125:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c099 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.197130:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c099 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.197143:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.197147:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c0a0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.197152:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.197157:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.197159:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.197175:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c0a0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.197183:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xba281655 (ffff9ee360714800) 00010000:00010000:2.0:1762166808.197185:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.197188:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c0a0 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.197194:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c0a0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.197226:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c092 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bad expref: 31 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.197234:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.197236:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166808.197240:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c092 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bad expref: 31 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.197248:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14200, rc 0) 00000100:00100000:2.0:1762166808.197307:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:42571:x1847765444281856:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 482us (684us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166808.197316:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2529 00000100:00100000:0.0:1762166808.199215:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.199288:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444282112 00000100:00100000:2.0:1762166808.199295:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444282112 00000100:00100000:2.0:1762166808.199340:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2530 00000100:00100000:2.0:1762166808.199349:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:42571:x1847765444282112:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166808.199366:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166808.199391:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c0a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90bb4 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1762166808.199486:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x7:0x0]: returning size 11776 00010000:00010000:2.0:1762166808.199597:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c0a7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bb4 expref: 32 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.199615:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13700) 00010000:00010000:2.0:1762166808.199618:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166808.199622:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c0a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bb4 expref: 32 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.199635:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15200, rc 0) 00000100:00100000:2.0:1762166808.199687:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:42571:x1847765444282112:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 339us (474us total) trans 4294968974 rc 301/301 00000100:00100000:2.0:1762166808.199695:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2530 00000100:00100000:0.0:1762166808.201209:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.201261:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444282240 00000100:00100000:2.0:1762166808.201272:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444282240 00000100:00100000:2.0:1762166808.201315:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2531 00000100:00100000:2.0:1762166808.201323:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:42571:x1847765444282240:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166808.201366:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0b5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201376:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201384:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201394:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0bc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201407:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201412:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201496:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0c3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201504:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201510:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:2.0:1762166808.201541:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xb:0x0]: returning size 0 00000004:00200000:2.0:1762166808.201545:0:20128:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166808.201554:0:20128:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201563:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201569:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0b5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201575:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201581:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.201584:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201591:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0b5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201608:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.201611:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.201615:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0b5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201621:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0b5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201632:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201638:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0bc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201643:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0bc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201648:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.201650:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0bc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201655:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0bc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201662:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xba281655 (ffff9ee360714d00) 00010000:00010000:2.0:1762166808.201664:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.201667:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0bc lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201672:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0bc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201686:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201697:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0c3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201701:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0c3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201705:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.201708:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0c3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201712:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0c3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201720:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xb:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:2.0:1762166808.201722:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.201724:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0c3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.201729:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0c3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:2.0:1762166808.201809:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:42571:x1847765444282240:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 487us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166808.201815:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2531 00000100:00100000:0.0:1762166808.206127:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166808.206207:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444282496 00000100:00100000:3.0:1762166808.206215:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444282496 00000100:00100000:3.0:1762166808.206267:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 758 00000100:00100000:3.0:1762166808.206276:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:42571:x1847765444282496:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166808.206500:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:42571:x1847765444282496:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 224us (380us total) trans 4294968975 rc 0/0 00000100:00100000:3.0:1762166808.206508:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 758 00000100:00100000:0.0:1762166808.347419:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.347525:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444282752 00000100:00100000:2.0:1762166808.347535:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444282752 00000100:00100000:2.0:1762166808.347821:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2532 00000100:00100000:2.0:1762166808.347832:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:42603:x1847765444282752:12345-192.168.203.35@tcp:36:rm.0 00010000:00010000:2.0:1762166808.347885:0:20128:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1762166808.347911:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c006 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b7c expref: 32 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.347954:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9bfab lrc: 0/0,0 mode: --/CR res: [0x200000404:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b67 expref: 31 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.347965:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xa:0x0].0x0 (ffff9ee360714000) 00010000:00010000:2.0:1762166808.347975:0:20128:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166808.347995:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0ca lrc: 3/0,1 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348008:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0ca lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348018:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0ca lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348031:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0d1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348037:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0d1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348043:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0d1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348141:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0d8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348149:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0d8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348156:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0d8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000040:00080000:2.0:1762166808.348464:0:20128:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].115, 64 off17376 00000040:00080000:2.0:1762166808.348497:0:20128:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].118, 64 off17656 00010000:00010000:2.0:1762166808.348561:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c0df lrc: 3/0,1 mode: --/PW res: [0x200000404:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348569:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c0df lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348577:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c0df lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348583:0:20128:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c0df lrc: 4/0,1 mode: PW/PW res: [0x200000404:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348588:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c0df lrc: 4/0,1 mode: PW/PW res: [0x200000404:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348593:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c0df lrc: 3/0,0 mode: PW/PW res: [0x200000404:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348619:0:20128:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166808.348635:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0d8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348642:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0d8 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348657:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0d8 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348664:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.348667:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0d8 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348674:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0d8 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348693:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xa:0x0].0x0 (ffff9ee360714d00) 00010000:00010000:2.0:1762166808.348697:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1762166808.348701:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0d8 lrc: 2/0,0 mode: --/EX res: [0x200000404:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348706:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0d8 lrc: 0/0,0 mode: --/EX res: [0x200000404:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348748:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0ca lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348754:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0ca lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348809:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0ca lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348814:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.348817:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0ca lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348823:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0ca lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348831:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.348833:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.348836:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0ca lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.348841:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c0ca lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000004:00010000:2.0:1762166808.348851:0:20128:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002bf415dc reply state 00000000c9c1507f transno 4294968976 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0d1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:2.0:1762166808.348866:0:20128:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166808.348944:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:42603:x1847765444282752:12345-192.168.203.35@tcp:36:rm.0 Request processed in 1113us (1534us total) trans 4294968976 rc 0/0 00000100:00100000:2.0:1762166808.348951:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2532 00010000:00010000:1.0:1762166808.349022:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166808.349029:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c0df lrc: 2/0,0 mode: PW/PW res: [0x200000404:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166808.349035:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166808.349038:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c0df lrc: 2/0,0 mode: PW/PW res: [0x200000404:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166808.349051:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c0df lrc: 3/0,0 mode: PW/PW res: [0x200000404:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166808.349060:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xa:0x0].0x0 (ffff9ee360714d00) 00010000:00010000:1.0:1762166808.349063:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166808.349067:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c0df lrc: 1/0,0 mode: --/PW res: [0x200000404:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166808.349072:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c0df lrc: 0/0,0 mode: --/PW res: [0x200000404:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166808.349086:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166808.349088:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166808.349090:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166808.351345:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0d1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.351360:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0d1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.351366:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0d1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.351371:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.351374:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0d1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.351381:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0d1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.351392:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xeb4e88c0 (ffff9ee360714c00) 00010000:00010000:2.0:1762166808.351395:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.351398:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0d1 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.351403:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0d1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:0.0:1762166808.356243:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.356348:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444282880 00000100:00100000:2.0:1762166808.356357:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444282880 00000100:00100000:2.0:1762166808.356416:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2533 00000100:00100000:2.0:1762166808.356441:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:42604:x1847765444282880:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166808.356464:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166808.356483:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0e6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90bbb expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.356561:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c0ed lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356575:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c0ed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356585:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c0ed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356598:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c0f4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356605:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356612:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356670:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c0ed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356677:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c0ed lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356684:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c0ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356689:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.356693:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c0ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356707:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c0ed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356718:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.356721:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.356725:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c0ed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356730:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c0ed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356744:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356749:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c0f4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356754:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356791:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.356795:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356801:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c0f4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356809:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xeb4e88c0 (ffff9ee360714000) 00010000:00010000:2.0:1762166808.356811:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.356813:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c0f4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356819:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c0f4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.356860:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0e6 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bbb expref: 32 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.356869:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.356872:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.356875:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c0e6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bbb expref: 32 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.356885:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14800, rc 0) 00000100:00100000:2.0:1762166808.356950:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:42604:x1847765444282880:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 511us (714us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166808.356958:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2533 00000100:00100000:0.0:1762166808.358832:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.358902:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444283008 00000100:00100000:2.0:1762166808.358909:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444283008 00000100:00100000:2.0:1762166808.358955:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2534 00000100:00100000:2.0:1762166808.358964:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:42604:x1847765444283008:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166808.358977:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166808.358989:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0fb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90bc2 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.359036:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c102 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359047:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c102 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359056:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c102 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359083:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c109 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359090:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c109 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359097:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c109 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359147:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c102 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359154:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c102 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359159:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c102 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359169:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.359173:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c102 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359179:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c102 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359189:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.359192:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.359195:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c102 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359201:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c102 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359211:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c109 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359222:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c109 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359227:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c109 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359231:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.359234:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c109 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359241:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c109 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359248:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xeb4e88c0 (ffff9ee360714c00) 00010000:00010000:2.0:1762166808.359251:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.359253:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c109 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359259:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c109 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166808.359285:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0fb lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bc2 expref: 32 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.359295:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.359297:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.359301:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c0fb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bc2 expref: 32 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.359310:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15c00, rc 0) 00000100:00100000:2.0:1762166808.359365:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:42604:x1847765444283008:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 402us (535us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166808.359379:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2534 00000100:00100000:0.0:1762166808.360841:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.360887:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444283136 00000100:00100000:2.0:1762166808.360894:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444283136 00000100:00100000:2.0:1762166808.360934:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2535 00000100:00100000:2.0:1762166808.360944:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:42604:x1847765444283136:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166808.360956:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166808.360970:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c110 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90bc9 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.361017:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c117 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.361033:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c117 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.361041:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c117 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:2.0:1762166808.361085:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x7:0x0]: returning size 11776 00000004:00200000:2.0:1762166808.361089:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166808.361108:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c117 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.361127:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c110 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bc9 expref: 33 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.361142:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c117 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bc9 expref: 32 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.361150:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.361162:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762166808.361165:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14400, rc 0) 00000100:00100000:2.0:1762166808.361209:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:42604:x1847765444283136:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 266us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166808.361216:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2535 00000100:00100000:3.0:1762166808.363687:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.363812:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444283264 00000100:00100000:2.0:1762166808.363820:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444283264 00000100:00100000:2.0:1762166808.363869:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2536 00000100:00100000:2.0:1762166808.363879:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:42604:x1847765444283264:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166808.363894:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166808.363908:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c11e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90bd0 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.363961:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c125 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.363973:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c125 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.363982:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c125 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.363995:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c12c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.364001:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c12c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.364007:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c12c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.364054:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c125 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.364072:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c125 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.364092:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c125 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.364098:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.364102:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c125 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.364114:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c125 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.364128:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.364131:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.364135:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c125 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.364141:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c125 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.364152:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c12c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.364158:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c12c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.364168:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c12c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.364173:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.364176:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c12c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.364192:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c12c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.364201:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xeb4e88c0 (ffff9ee360714000) 00010000:00010000:2.0:1762166808.364203:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.364206:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c12c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.364211:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c12c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.364238:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c11e lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bd0 expref: 33 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.364248:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.364250:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.364253:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9c11e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bd0 expref: 33 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.364261:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14800, rc 0) 00000100:00100000:2.0:1762166808.364314:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:42604:x1847765444283264:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 436us (633us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166808.364321:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2536 00000100:00100000:0.0:1762166808.366279:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.366358:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444283520 00000100:00100000:2.0:1762166808.366366:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444283520 00000100:00100000:2.0:1762166808.366410:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2537 00000100:00100000:2.0:1762166808.366419:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:42604:x1847765444283520:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166808.366435:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166808.366453:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1762166808.366477:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c117 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bc9 expref: 32 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.366492:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.366496:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166808.366508:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c133 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90bd7 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.366620:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9c13a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.366632:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9c13a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.366640:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9c13a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.366653:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c141 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.366659:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c141 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.366665:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c141 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.367134:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c148 lrc: 3/1,0 mode: --/PR res: [0x200000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.367143:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c148 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.367150:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c148 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:2.0:1762166808.367168:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xc:0x0]: returning size 0 00010000:00010000:2.0:1762166808.367191:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9c13a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.367196:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9c13a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.367202:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9c13a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.367207:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.367210:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9c13a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.367216:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9c13a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.367224:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166808.367227:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.367230:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9c13a lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.367235:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9c13a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000004:00010000:2.0:1762166808.367244:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000585bd939 reply state 000000003cf78471 transno 4294968977 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c141 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:2.0:1762166808.367249:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166808.367268:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c133 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bd7 expref: 34 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.367277:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c148 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bd7 expref: 33 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.367286:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xc:0x0].0x0 (ffff9ee360714900) 00010000:00010000:2.0:1762166808.367288:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166808.367289:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15a00, rc 0) 00000100:00100000:2.0:1762166808.367347:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:42604:x1847765444283520:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 929us (1074us total) trans 4294968977 rc 0/0 00000100:00100000:2.0:1762166808.367354:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2537 00010000:00010000:1.0:1762166808.368571:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c141 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166808.368584:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c141 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166808.368591:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c141 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166808.368596:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166808.368600:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c141 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166808.368606:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c141 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166808.368616:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xeb4e88c0 (ffff9ee360714800) 00010000:00010000:1.0:1762166808.368618:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166808.368628:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c141 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166808.368634:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c141 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166808.369498:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.369576:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444283776 00000100:00100000:2.0:1762166808.369584:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444283776 00000100:00100000:2.0:1762166808.369625:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2538 00000100:00100000:2.0:1762166808.369630:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:42604:x1847765444283776:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166808.369647:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166808.369658:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c156 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90bde expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.369731:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c15d lrc: 3/0,1 mode: --/EX res: [0x200000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.369739:0:6558:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c148 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bd7 expref: 34 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.369744:0:6558:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c15d lrc: 4/0,1 mode: --/EX res: [0x200000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.369799:0:6558:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c148 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bd7 expref: 34 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166808.369812:0:6558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c148 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bd7 expref: 34 pid: 6558 timeout: 529 lvb_type: 0 00000100:00100000:2.0:1762166808.369841:0:6558:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451923072:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166808.369928:0:6558:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242543f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166808.371169:0:6558:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451923072:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166808.371195:0:6558:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c15d lrc: 3/0,1 mode: --/EX res: [0x200000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166808.371292:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166808.371329:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444283904 00000100:00100000:1.0:1762166808.371334:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444283904 00010000:00010000:1.0:1762166808.371361:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c148 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bd7 expref: 35 pid: 6558 timeout: 529 lvb_type: 0 00000100:00100000:1.0:1762166808.371398:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 559 00000100:00100000:1.0:1762166808.371407:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444283904:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166808.371428:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166808.371435:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c148 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bd7 expref: 35 pid: 6558 timeout: 529 lvb_type: 0 00010000:00010000:1.0:1762166808.371445:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c148 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bd7 expref: 35 pid: 6558 timeout: 529 lvb_type: 0 00010000:00010000:1.0:1762166808.371464:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c148 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bd7 expref: 35 pid: 6558 timeout: 529 lvb_type: 0 00010000:00010000:1.0:1762166808.371480:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xc:0x0].0x0 (ffff9ee360714900) 00010000:00010000:1.0:1762166808.371484:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c15d lrc: 3/0,1 mode: --/EX res: [0x200000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166808.371492:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c15d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166808.371498:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c15d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166808.371537:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166808.371579:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765444283904:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 173us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166808.371587:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 559 00010000:00010000:0.0:1762166808.371753:0:6558:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c15d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.371793:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c15d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:0.0:1762166808.371814:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xc:0x0]: returning size 0 00000004:00080000:0.0:1762166808.372000:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x62:0x0], index 0: 0 00000004:00080000:0.0:1762166808.372009:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5c:0x0], index 1: 0 00010000:00010000:0.0:1762166808.372172:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c15d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.372179:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c15d lrc: 2/0,0 mode: EX/EX res: [0x200000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.372185:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c15d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.372190:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166808.372194:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c15d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.372200:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c15d lrc: 4/0,0 mode: EX/EX res: [0x200000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.372209:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xc:0x0].0x0 (ffff9ee360714900) 00010000:00010000:0.0:1762166808.372212:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166808.372215:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c15d lrc: 2/0,0 mode: --/EX res: [0x200000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.372219:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c15d lrc: 0/0,0 mode: --/EX res: [0x200000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.372267:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c156 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bde expref: 34 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.372277:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166808.372286:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166808.372290:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c156 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bde expref: 34 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.372299:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15c00, rc 0) 00000100:00100000:0.0:1762166808.372345:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:42604:x1847765444283776:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2713us (2852us total) trans 4294968978 rc 301/301 00000100:00100000:0.0:1762166808.372352:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2538 00000100:00100000:0.0:1762166808.373984:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.374041:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444284160 00000100:00100000:2.0:1762166808.374047:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444284160 00000100:00100000:2.0:1762166808.374091:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 759 00000100:00100000:2.0:1762166808.374098:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:42604:x1847765444284160:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166808.374366:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:42604:x1847765444284160:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 267us (385us total) trans 4294968979 rc 0/0 00000100:00100000:2.0:1762166808.374373:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 759 00000100:00100000:1.0:1762166808.376152:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.376201:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444284416 00000100:00100000:2.0:1762166808.376210:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444284416 00000100:00100000:2.0:1762166808.376258:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 760 00000100:00100000:2.0:1762166808.376268:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3719fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:42604:x1847765444284416:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166808.376446:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3719fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:42604:x1847765444284416:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 178us (306us total) trans 4294968980 rc 0/0 00000100:00100000:2.0:1762166808.376454:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 760 00000100:00100000:3.0:1762166808.382481:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166808.382599:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444284544 00000100:00100000:0.0:1762166808.382609:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444284544 00000100:00100000:0.0:1762166808.382973:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2539 00000100:00100000:0.0:1762166808.382982:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:42605:x1847765444284544:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:0.0:1762166808.383005:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166808.383024:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9c16b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90be5 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.383107:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c172 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383120:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c172 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383130:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c172 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383141:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c179 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383147:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c179 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383162:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c179 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383257:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9c180 lrc: 3/1,0 mode: --/PR res: [0x200000404:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383265:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9c180 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383272:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9c180 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:0.0:1762166808.383297:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xb:0x0]: returning size 0 00000004:00200000:0.0:1762166808.383300:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166808.383313:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9c180 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383323:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9c180 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383331:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c172 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383337:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c172 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383343:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c172 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383349:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166808.383352:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c172 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383359:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c172 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383376:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166808.383380:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166808.383384:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c172 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383390:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c172 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383403:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c179 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383408:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c179 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383414:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c179 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383419:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166808.383422:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c179 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383427:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c179 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383434:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xba281655 (ffff9ee36062ba00) 00010000:00010000:0.0:1762166808.383436:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166808.383439:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c179 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383444:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c179 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.383479:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9c16b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90be5 expref: 37 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.383497:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9c180 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90be5 expref: 36 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.383504:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xb:0x0].0x0 (ffff9ee36062b100) 00010000:00010000:0.0:1762166808.383506:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166808.383508:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159600, rc 0) 00000100:00100000:0.0:1762166808.383576:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:42605:x1847765444284544:12345-192.168.203.35@tcp:101:rm.0 Request processed in 595us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166808.383582:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2539 00000100:00100000:0.0:1762166808.387205:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166808.387273:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444284672 00000100:00100000:0.0:1762166808.387274:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166808.387284:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444284672 00000100:00100000:1.0:1762166808.387341:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444284800 00000100:00100000:1.0:1762166808.387345:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444284800 00000100:00100000:0.0:1762166808.387368:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 898 00000100:00100000:1.0:1762166808.387390:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 899 00000100:00100000:0.0:1762166808.387391:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444284672:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:0.0:1762166808.387409:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762166808.387410:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2361:x1847765444284800:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:1.0:1762166808.387422:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166808.387429:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c187 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90bec expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166808.387437:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c18e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90bf3 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166808.387455:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166808.387474:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166808.387477:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166808.387485:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c187 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bec expref: 9 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166808.387504:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c187 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bec expref: 9 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166808.387535:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158000, rc 0) 00000100:00100000:0.0:1762166808.387593:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444284672:12345-192.168.203.35@tcp:101:rm.0 Request processed in 210us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166808.387600:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 898 00002000:00010000:1.0:1762166808.387678:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166808.387696:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166808.387699:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166808.387704:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c18e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bf3 expref: 8 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166808.387718:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c18e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bf3 expref: 8 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166808.387727:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453800, rc 0) 00000100:00100000:1.0:1762166808.387798:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2361:x1847765444284800:12345-192.168.203.35@tcp:101:rm.0 Request processed in 398us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166808.387815:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 899 00000100:00100000:1.0:1762166808.389523:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166808.389571:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444285056 00000100:00100000:0.0:1762166808.389578:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444285056 00000100:00100000:0.0:1762166808.389635:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2540 00000100:00100000:0.0:1762166808.389645:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:42605:x1847765444285056:12345-192.168.203.35@tcp:36:rm.0 00010000:00010000:0.0:1762166808.389696:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166808.389719:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9c180 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90be5 expref: 36 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.389736:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xb:0x0].0x0 (ffff9ee36062b100) 00010000:00010000:0.0:1762166808.389750:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166808.389821:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9c195 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.389833:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9c195 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.389843:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9c195 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.389855:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c19c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.389862:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c19c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.389884:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c19c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.389979:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1a3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.389987:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1a3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.389994:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1a3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000040:00080000:0.0:1762166808.390406:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].116, 64 off17440 00000040:00080000:0.0:1762166808.390434:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].119, 64 off17720 00010000:00010000:0.0:1762166808.390497:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1aa lrc: 3/0,1 mode: --/PW res: [0x200000404:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.390512:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1aa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.390520:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1aa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.390531:0:6558:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1aa lrc: 4/0,1 mode: PW/PW res: [0x200000404:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.390542:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1aa lrc: 4/0,1 mode: PW/PW res: [0x200000404:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.390548:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1aa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.390575:0:6558:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166808.390591:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1a3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.390604:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1a3 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.390610:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1a3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.390615:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166808.390619:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1a3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.390626:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1a3 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.390634:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xb:0x0].0x0 (ffff9ee36062bd00) 00010000:00010000:0.0:1762166808.390637:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1762166808.390641:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1a3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.390646:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1a3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.390689:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9c195 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.390695:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9c195 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.390701:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9c195 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.390708:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166808.390712:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9c195 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.390717:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166808.390727:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1aa lrc: 2/0,0 mode: PW/PW res: [0x200000404:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.390746:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166808.390749:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9c195 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.390793:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1aa lrc: 2/0,0 mode: PW/PW res: [0x200000404:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.390793:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166808.390801:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166808.390806:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9c195 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.390808:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1aa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.390818:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9c195 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.390826:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xb:0x0].0x0 (ffff9ee36062bd00) 00010000:00010000:2.0:1762166808.390830:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000004:00010000:0.0:1762166808.390831:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000005e648b8 reply state 0000000090a7faaa transno 4294968981 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c19c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.390834:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1aa lrc: 1/0,0 mode: --/PW res: [0x200000404:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166808.390848:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166808.390850:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1aa lrc: 0/0,0 mode: --/PW res: [0x200000404:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.390867:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166808.390870:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166808.390872:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166808.390940:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:42605:x1847765444285056:12345-192.168.203.35@tcp:36:rm.0 Request processed in 1295us (1420us total) trans 4294968981 rc 0/0 00000100:00100000:0.0:1762166808.390947:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2540 00010000:00010000:2.0:1762166808.392312:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c19c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.392323:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c19c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.392330:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c19c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.392335:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166808.392339:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c19c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.392344:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c19c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.392355:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xba281655 (ffff9ee36062ba00) 00010000:00010000:2.0:1762166808.392366:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166808.392370:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c19c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.392387:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c19c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:1.0:1762166808.398883:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166808.398939:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444285312 00000100:00100000:0.0:1762166808.398950:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444285312 00000100:00100000:0.0:1762166808.399002:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2541 00000100:00100000:0.0:1762166808.399011:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:42606:x1847765444285312:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166808.399034:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166808.399051:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9c1b1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90bfa expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.399118:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1b8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399131:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1b8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399152:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1b8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399165:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9c1bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399172:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9c1bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399177:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9c1bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399286:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9c1c6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399293:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9c1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399300:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9c1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:0.0:1762166808.399309:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xc:0x0]: returning size 0 00010000:00010000:0.0:1762166808.399403:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1b8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399410:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1b8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399416:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1b8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399422:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166808.399426:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1b8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399441:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1b8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399451:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166808.399454:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166808.399458:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1b8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399463:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9c1b8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399473:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9c1bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399478:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9c1bf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399484:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9c1bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399488:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166808.399490:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9c1bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399495:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9c1bf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399500:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xeb4e88c0 (ffff9ee36062b100) 00010000:00010000:0.0:1762166808.399502:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166808.399504:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9c1bf lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399509:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9c1bf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.399550:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9c1b1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bfa expref: 39 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.399561:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9c1c6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bfa expref: 38 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.399568:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xc:0x0].0x0 (ffff9ee36062bd00) 00010000:00010000:0.0:1762166808.399570:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166808.399573:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159000, rc 0) 00000100:00100000:0.0:1762166808.399627:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:42606:x1847765444285312:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 616us (753us total) trans 4294968982 rc 0/0 00000100:00100000:0.0:1762166808.399634:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2541 00000100:00100000:3.0:1762166808.401461:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166808.401874:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444285440 00000100:00100000:1.0:1762166808.401884:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444285440 00000100:00100000:1.0:1762166808.401944:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 900 00000100:00100000:1.0:1762166808.401954:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444285440:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166808.401969:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166808.401987:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9c1d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c01 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166808.402011:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166808.402028:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166808.402030:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166808.402039:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9c1d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c01 expref: 9 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166808.402055:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee350453200/0xf915a5bdf3c9c1d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c01 expref: 9 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166808.402066:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453200, rc 0) 00000100:00100000:1.0:1762166808.402119:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444285440:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 166us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166808.402126:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 900 00000100:00100000:3.0:1762166808.403804:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166808.403839:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444285696 00000100:00100000:0.0:1762166808.403846:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444285696 00000100:00100000:0.0:1762166808.403895:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 761 00000100:00100000:0.0:1762166808.403904:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:42606:x1847765444285696:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166808.404212:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:42606:x1847765444285696:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 307us (412us total) trans 4294968983 rc 0/0 00000100:00100000:0.0:1762166808.404220:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 761 00000100:00100000:2.0:1762166808.405533:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166808.405680:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444285824 00000100:00100000:0.0:1762166808.405687:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444285824 00000100:00100000:0.0:1762166808.405731:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2542 00000100:00100000:0.0:1762166808.405740:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:42606:x1847765444285824:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166808.405755:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166808.405803:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c1db lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c08 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.405879:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1e2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406149:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1e2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406164:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1e2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406180:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9c1e9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406187:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9c1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406194:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9c1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406248:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1e2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406255:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1e2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406262:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1e2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406268:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166808.406272:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1e2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406279:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1e2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406301:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166808.406304:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166808.406309:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1e2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406314:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9c1e2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406326:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9c1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406332:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9c1e9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406337:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9c1e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406342:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166808.406344:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9c1e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406350:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9c1e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406357:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xba281655 (ffff9ee36062bf00) 00010000:00010000:0.0:1762166808.406360:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166808.406362:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9c1e9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406368:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9c1e9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.406398:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c1db lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c08 expref: 40 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.406413:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166808.406416:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166808.406420:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9c1db lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c08 expref: 40 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.406429:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159c00, rc 0) 00000100:00100000:0.0:1762166808.406554:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:42606:x1847765444285824:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 814us (1024us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166808.406561:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2542 00000100:00100000:3.0:1762166808.408327:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166808.408378:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444286080 00000100:00100000:0.0:1762166808.408387:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444286080 00000100:00100000:0.0:1762166808.408441:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2543 00000100:00100000:0.0:1762166808.408455:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:42606:x1847765444286080:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166808.408470:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166808.408483:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9c1f0 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c0f expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.408576:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9c1f7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.408594:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9c1f7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.408602:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9c1f7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.408614:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9c1fe lrc: 3/0,1 mode: --/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.408633:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9c1fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.408640:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9c1fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.409056:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c205 lrc: 3/1,0 mode: --/PR res: [0x200000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.409064:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c205 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.409072:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c205 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:0.0:1762166808.409081:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xd:0x0]: returning size 0 00010000:00010000:0.0:1762166808.409103:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9c1f7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.409110:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9c1f7 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.409116:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9c1f7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.409122:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166808.409125:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9c1f7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.409132:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9c1f7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.409141:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166808.409144:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166808.409153:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9c1f7 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.409159:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9c1f7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000004:00010000:0.0:1762166808.409171:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c05268f7 reply state 000000005f7e3113 transno 4294968984 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9c1fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166808.409179:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762166808.409200:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9c1f0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c0f expref: 42 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.409212:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c205 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c0f expref: 41 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.409218:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xd:0x0].0x0 (ffff9ee36062b400) 00010000:00010000:0.0:1762166808.409220:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166808.409223:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686600, rc 0) 00000100:00100000:0.0:1762166808.409279:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:42606:x1847765444286080:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 830us (957us total) trans 4294968984 rc 0/0 00000100:00100000:0.0:1762166808.409286:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2543 00010000:00010000:1.0:1762166808.410255:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9c1fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166808.410276:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9c1fe lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166808.410281:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9c1fe lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166808.410286:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166808.410290:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9c1fe lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166808.410295:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9c1fe lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166808.410304:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xba281655 (ffff9ee36062b300) 00010000:00010000:1.0:1762166808.410307:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166808.410310:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9c1fe lrc: 2/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166808.410316:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9c1fe lrc: 0/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166808.411507:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166808.411604:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444286336 00000100:00100000:0.0:1762166808.411612:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444286336 00000100:00100000:0.0:1762166808.411663:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2544 00000100:00100000:0.0:1762166808.411672:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+41:42606:x1847765444286336:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166808.411700:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166808.411715:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c213 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c16 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.411854:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c21a lrc: 3/0,1 mode: --/EX res: [0x200000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.411873:0:6558:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c205 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c0f expref: 42 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.411881:0:6558:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c21a lrc: 4/0,1 mode: --/EX res: [0x200000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.411919:0:6558:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c205 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c0f expref: 42 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.411932:0:6558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c205 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c0f expref: 42 pid: 6558 timeout: 529 lvb_type: 0 00000100:00100000:0.0:1762166808.411945:0:6558:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451923200:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166808.412013:0:6558:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2430f7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166808.413938:0:6558:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451923200:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166808.413963:0:6558:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c21a lrc: 3/0,1 mode: --/EX res: [0x200000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166808.414219:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.414394:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444286464 00000100:00100000:2.0:1762166808.414400:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444286464 00010000:00010000:2.0:1762166808.414430:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c205 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c0f expref: 43 pid: 6558 timeout: 529 lvb_type: 0 00000100:00100000:2.0:1762166808.414467:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 560 00000100:00100000:2.0:1762166808.414477:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:2360:x1847765444286464:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166808.414491:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166808.414496:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c205 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c0f expref: 43 pid: 6558 timeout: 529 lvb_type: 0 00010000:00010000:2.0:1762166808.414507:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c205 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c0f expref: 43 pid: 6558 timeout: 529 lvb_type: 0 00010000:00010000:2.0:1762166808.414527:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c205 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c0f expref: 43 pid: 6558 timeout: 529 lvb_type: 0 00010000:00010000:2.0:1762166808.414541:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xd:0x0].0x0 (ffff9ee36062b400) 00010000:00010000:2.0:1762166808.414546:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c21a lrc: 3/0,1 mode: --/EX res: [0x200000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.414553:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c21a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.414571:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c21a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166808.414600:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166808.414648:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:2360:x1847765444286464:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 171us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166808.414656:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 560 00010000:00010000:0.0:1762166808.414710:0:6558:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c21a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.414718:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c21a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:0.0:1762166808.414734:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xd:0x0]: returning size 0 00000004:00080000:0.0:1762166808.414956:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x63:0x0], index 0: 0 00000004:00080000:0.0:1762166808.414966:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5d:0x0], index 1: 0 00010000:00010000:0.0:1762166808.415134:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c21a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.415152:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c21a lrc: 2/0,0 mode: EX/EX res: [0x200000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.415159:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c21a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.415165:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166808.415168:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c21a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.415175:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c21a lrc: 4/0,0 mode: EX/EX res: [0x200000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.415184:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xd:0x0].0x0 (ffff9ee36062b400) 00010000:00010000:0.0:1762166808.415187:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166808.415191:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c21a lrc: 2/0,0 mode: --/EX res: [0x200000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.415197:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c21a lrc: 0/0,0 mode: --/EX res: [0x200000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.415252:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c213 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c16 expref: 42 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.415262:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166808.415265:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166808.415268:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c213 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c16 expref: 42 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.415277:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687400, rc 0) 00000100:00100000:0.0:1762166808.415329:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+41:42606:x1847765444286336:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3657us (3825us total) trans 4294968985 rc 301/301 00000100:00100000:0.0:1762166808.415342:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2544 00000100:00100000:3.0:1762166808.417385:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166808.417461:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444286720 00000100:00100000:0.0:1762166808.417469:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444286720 00000100:00100000:0.0:1762166808.417519:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 762 00000100:00100000:0.0:1762166808.417528:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+41:42606:x1847765444286720:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166808.417877:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:42606:x1847765444286720:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 349us (497us total) trans 4294968986 rc 0/0 00000100:00100000:0.0:1762166808.417886:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 762 00000100:00100000:3.0:1762166808.419357:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166808.419891:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444286976 00000100:00100000:2.0:1762166808.419898:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444286976 00000100:00100000:2.0:1762166808.419946:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 763 00000100:00100000:2.0:1762166808.419954:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:42606:x1847765444286976:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166808.420125:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:42606:x1847765444286976:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 171us (772us total) trans 4294968987 rc 0/0 00000100:00100000:2.0:1762166808.420132:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 763 00000100:00100000:3.0:1762166808.433228:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166808.433380:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444287232 00000100:00100000:0.0:1762166808.433389:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444287232 00000100:00100000:0.0:1762166808.433442:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2545 00000100:00100000:0.0:1762166808.433452:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:42609:x1847765444287232:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166808.433474:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166808.433492:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c1d expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.433598:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c22f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.433611:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c22f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.433621:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c22f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:0.0:1762166808.433631:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x7:0x0]: returning size 11776 00010000:00010000:0.0:1762166808.433734:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c1d expref: 46 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.433811:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c22f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c1d expref: 45 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166808.433819:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166808.433822:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166808.433825:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687e00, rc 0) 00000100:00100000:0.0:1762166808.433885:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+45:42609:x1847765444287232:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 434us (666us total) trans 4294968988 rc 0/0 00000100:00100000:0.0:1762166808.433892:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2545 00000100:00100000:3.0:1762166808.435166:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166808.435260:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444287360 00000100:00100000:0.0:1762166808.435266:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444287360 00000100:00100000:0.0:1762166808.435303:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2546 00000100:00100000:0.0:1762166808.435310:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+45:42609:x1847765444287360:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166808.435360:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c23d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435371:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c23d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435379:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c23d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435391:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c244 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435398:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c244 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435404:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c244 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435484:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c24b lrc: 3/1,0 mode: --/PR res: [0x200000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435491:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c24b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435497:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c24b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:0.0:1762166808.435522:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xc:0x0]: returning size 0 00000004:00200000:0.0:1762166808.435526:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166808.435533:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c24b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435544:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c23d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435550:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c23d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435556:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c23d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435561:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166808.435565:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c23d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435571:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c23d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435580:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166808.435583:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166808.435587:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c23d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435598:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c23d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435608:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c244 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435613:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c244 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435618:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c244 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435623:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166808.435626:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c244 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435630:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c244 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435636:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xeb4e88c0 (ffff9ee36062b400) 00010000:00010000:0.0:1762166808.435639:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166808.435641:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c244 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435646:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c244 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435661:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c24b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435666:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c24b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435671:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c24b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435680:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166808.435683:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c24b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435688:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c24b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435695:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xc:0x0].0x0 (ffff9ee36062bd00) 00010000:00010000:0.0:1762166808.435697:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166808.435699:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c24b lrc: 2/0,0 mode: --/PR res: [0x200000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166808.435705:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c24b lrc: 0/0,0 mode: --/PR res: [0x200000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166808.435790:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+45:42609:x1847765444287360:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 480us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166808.435798:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2546 00000100:00100000:0.0:1762166808.744054:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451923328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166808.744122:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166808.744170:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451923328 00000100:00100000:1.0:1762166808.744178:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451923328 00000100:00100000:1.0:1762166808.744253:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1762166808.744262:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451923328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1762166808.744297:0:8383:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3857711104 avail 3855613952 00000100:00080000:2.0:1762166808.744347:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166808.744358:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451923328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166808.744366:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1762166808.744464:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451923328:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1762166808.936033:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166809.255971:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451923456:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1762166809.255991:0:6730:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 430048226639ns, next at 431048225210ns, rc = 0 00000100:00100000:1.0:1762166809.256067:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166809.256215:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451923456 00000100:00100000:2.0:1762166809.256223:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451923456 00000100:00100000:2.0:1762166809.256299:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1762166809.256309:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1847765451923456:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1762166809.256337:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1762166809.256345:0:8383:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3856662528 avail 3854565376 00000100:00100000:2.0:1762166809.256400:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1847765451923456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166809.256407:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1762166809.256488:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451923456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166809.911967:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166809.912040:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444287616 00000100:00100000:2.0:1762166809.912049:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444287616 00000100:00100000:2.0:1762166809.912124:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2547 00000100:00100000:2.0:1762166809.912135:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+45:42988:x1847765444287616:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166809.912158:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166809.912178:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c252 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c24 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166809.912254:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c259 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912267:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c259 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912280:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c259 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912293:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c260 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912300:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c260 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912305:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c260 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912410:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c259 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912416:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c259 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912421:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c259 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912427:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166809.912436:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c259 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912443:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c259 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912454:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166809.912456:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166809.912461:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c259 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912467:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c259 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912481:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c260 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912485:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c260 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912491:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c260 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912496:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166809.912498:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c260 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912503:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c260 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912509:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xba281655 (ffff9ee360714000) 00010000:00010000:2.0:1762166809.912511:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166809.912513:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c260 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912527:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c260 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166809.912557:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c252 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c24 expref: 46 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166809.912566:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166809.912569:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166809.912572:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9c252 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c24 expref: 46 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166809.912581:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14000, rc 0) 00000100:00100000:2.0:1762166809.912636:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+45:42988:x1847765444287616:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 505us (679us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166809.912644:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2547 00000100:00100000:2.0:1762166809.914161:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166809.914212:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444287744 00000100:00100000:3.0:1762166809.914220:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444287744 00000100:00100000:3.0:1762166809.914261:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2548 00000100:00100000:3.0:1762166809.914269:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+45:42988:x1847765444287744:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:3.0:1762166809.914318:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c267 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914331:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c267 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914340:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c267 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914351:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c26e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914358:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c26e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914377:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c26e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914447:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c275 lrc: 3/1,0 mode: --/PR res: [0x200000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914454:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c275 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914461:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c275 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166809.914491:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xd:0x0]: returning size 0 00000004:00200000:3.0:1762166809.914495:0:20128:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166809.914505:0:20128:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c275 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914515:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c267 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914521:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c267 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914527:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c267 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914533:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166809.914536:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c267 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914542:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c267 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914552:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166809.914559:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166809.914564:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c267 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914570:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c267 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914581:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c26e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914586:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c26e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914591:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c26e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914596:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166809.914599:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c26e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914605:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c26e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914611:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0xba281655 (ffff9ee343a13000) 00010000:00010000:3.0:1762166809.914613:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166809.914616:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c26e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914621:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c26e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914633:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c275 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914638:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c275 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914647:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c275 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914652:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166809.914654:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c275 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914673:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c275 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914680:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xd:0x0].0x0 (ffff9ee343a13800) 00010000:00010000:3.0:1762166809.914682:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166809.914685:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c275 lrc: 2/0,0 mode: --/PR res: [0x200000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166809.914690:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c275 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:3.0:1762166809.914788:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+45:42988:x1847765444287744:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 493us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166809.914796:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2548 00010000:00010000:1.0:1762166809.960002:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166810.984099:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1762166811.325474:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968988 is committed 00000004:00080000:3.0:1762166811.325518:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 104 committed 00000004:00080000:3.0:1762166811.325564:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 101 committed 00000004:00080000:3.0:1762166811.325595:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 103 committed 00000100:00100000:0.0:1762166811.325944:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451923840:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762166811.326032:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166811.326118:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1762166811.326127:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451923968:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762166811.326152:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166811.326207:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451923840 00000100:00100000:0.0:1762166811.326228:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451923840 00000100:00100000:0.0:1762166811.326274:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451923968 00000100:00100000:0.0:1762166811.326278:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451923968 00000100:00100000:0.0:1762166811.326298:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:0.0:1762166811.326306:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451923840:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1762166811.326329:0:12402:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:97 count 1 00010000:00010000:0.0:1762166811.326352:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c27c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166811.326372:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c18e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bf3 expref: 8 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166811.326380:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166811.326383:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166811.326386:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c27c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166811.326413:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c18e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bf3 expref: 8 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166811.326426:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c18e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bf3 expref: 8 pid: 12400 timeout: 532 lvb_type: 1 00000100:00100000:0.0:1762166811.326437:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765451924096:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166811.326491:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2430f7900 going to sleep for 11 seconds 00000100:00080000:3.0:1762166811.326623:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1762166811.326627:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166811.326640:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:3.0:1762166811.326648:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451923968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1762166811.326662:0:6535:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:89 count 1 00010000:00010000:3.0:1762166811.326682:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c283 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.326693:0:6535:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee243444000/0xf915a5bdf3c9bfce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b75 expref: 8 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166811.326700:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166811.326701:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166811.326704:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c283 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.326724:0:6535:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee243444000/0xf915a5bdf3c9bfce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b75 expref: 8 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166811.326751:0:6535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee243444000/0xf915a5bdf3c9bfce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b75 expref: 8 pid: 6535 timeout: 532 lvb_type: 1 00000100:00100000:3.0:1762166811.326802:0:6535:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6535:1847765451924224:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166811.326810:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451923584:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166811.326849:0:6535:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2435c16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166811.326896:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166811.326943:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451923584 00000100:00100000:1.0:1762166811.326950:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1762166811.326952:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451923584 00000100:00100000:1.0:1762166811.326961:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451923712:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762166811.327011:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:1.0:1762166811.327014:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166811.327025:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765451923584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1762166811.327052:0:6532:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:95 count 1 00000100:00100000:3.0:1762166811.327062:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451923712 00000100:00100000:3.0:1762166811.327071:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451923712 00010000:00010000:2.0:1762166811.327080:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c28a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.327104:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bea8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b28 expref: 8 pid: 6535 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762166811.327124:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00010000:00010000:2.0:1762166811.327144:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1762166811.327148:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765451923712:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762166811.327150:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166811.327157:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c28a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1762166811.327173:0:7858:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:96 count 1 00010000:00010000:3.0:1762166811.327192:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c291 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.327194:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bea8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b28 expref: 8 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166811.327233:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c01b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b8a expref: 8 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166811.327246:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bea8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b28 expref: 8 pid: 6535 timeout: 532 lvb_type: 1 00010000:00010000:3.0:1762166811.327285:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166811.327290:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1762166811.327292:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451924352:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166811.327296:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c291 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.327332:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c01b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b8a expref: 8 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166811.327346:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c01b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b8a expref: 8 pid: 12400 timeout: 532 lvb_type: 1 00000100:00100000:3.0:1762166811.327360:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451924480:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166811.327361:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242543540 going to sleep for 11 seconds 00000100:00100000:3.0:1762166811.327403:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2435c1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166811.330734:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765451924096:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166811.330736:0:6535:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6535:1847765451924224:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166811.330789:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166811.330841:0:6535:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c283 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.330841:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c27c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166811.330852:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451924352:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166811.330873:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166811.330907:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c28a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166811.330935:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166811.330944:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444287872 00000100:00100000:2.0:1762166811.330954:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444287872 00000100:00100000:3.0:1762166811.330961:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451924480:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166811.330966:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444288000 00000100:00100000:1.0:1762166811.330974:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444288000 00010000:00010000:3.0:1762166811.330985:0:7858:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c291 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166811.331003:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166811.331038:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee243444000/0xf915a5bdf3c9bfce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b75 expref: 9 pid: 6535 timeout: 532 lvb_type: 1 00000100:00100000:3.0:1762166811.331039:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444288128 00000100:00100000:0.0:1762166811.331043:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444288256 00000100:00100000:3.0:1762166811.331050:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444288128 00000100:00100000:0.0:1762166811.331052:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444288256 00010000:00010000:3.0:1762166811.331086:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c01b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b8a expref: 11 pid: 12400 timeout: 532 lvb_type: 1 00010000:00010000:0.0:1762166811.331097:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bea8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b28 expref: 11 pid: 6535 timeout: 532 lvb_type: 1 00000100:00100000:1.0:1762166811.331107:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 561 00000100:00100000:1.0:1762166811.331140:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2359:x1847765444288000:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166811.331160:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 562 00010000:00010000:1.0:1762166811.331163:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166811.331174:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee243444000/0xf915a5bdf3c9bfce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b75 expref: 9 pid: 6535 timeout: 532 lvb_type: 1 00010000:00010000:2.0:1762166811.331178:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c18e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bf3 expref: 9 pid: 12400 timeout: 532 lvb_type: 1 00000100:00100000:0.0:1762166811.331181:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2358:x1847765444288256:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166811.331217:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166811.331220:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee243444000/0xf915a5bdf3c9bfce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b75 expref: 9 pid: 6535 timeout: 532 lvb_type: 1 00010000:00010000:0.0:1762166811.331230:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bea8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b28 expref: 11 pid: 6535 timeout: 532 lvb_type: 1 00010000:00010000:0.0:1762166811.331244:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bea8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b28 expref: 11 pid: 6535 timeout: 532 lvb_type: 1 00010000:00010000:1.0:1762166811.331292:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee243444000/0xf915a5bdf3c9bfce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b75 expref: 9 pid: 6535 timeout: 532 lvb_type: 1 00010000:00010000:1.0:1762166811.331317:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166811.331319:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166811.331325:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c283 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166811.331336:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c283 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166811.331410:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166811.331453:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9bea8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b28 expref: 11 pid: 6535 timeout: 532 lvb_type: 1 00010000:00010000:0.0:1762166811.331471:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1762166811.331473:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2359:x1847765444288000:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 340us (617us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166811.331477:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166811.331494:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c28a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166811.331504:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c28a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166811.331525:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 563 00010000:00010000:0.0:1762166811.331529:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166811.331548:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 561 00000100:00100000:2.0:1762166811.331550:0:7415:0:(service.c:3434:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:3.0:1762166811.331551:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444288128:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166811.331568:0:7415:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'ldlm_cn00_005' 00010000:00010000:3.0:1762166811.331570:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166811.331579:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c01b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b8a expref: 10 pid: 12400 timeout: 532 lvb_type: 1 00000100:00100000:0.0:1762166811.331586:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2358:x1847765444288256:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 409us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166811.331590:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 564 00010000:00010000:3.0:1762166811.331609:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c01b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b8a expref: 10 pid: 12400 timeout: 532 lvb_type: 1 00000100:00100000:1.0:1762166811.331625:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444287872:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166811.331625:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 562 00010000:00010000:3.0:1762166811.331636:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c01b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b8a expref: 10 pid: 12400 timeout: 532 lvb_type: 1 00010000:00010000:1.0:1762166811.331652:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166811.331663:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c18e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bf3 expref: 9 pid: 12400 timeout: 532 lvb_type: 1 00010000:00010000:1.0:1762166811.331677:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c18e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bf3 expref: 9 pid: 12400 timeout: 532 lvb_type: 1 00010000:00010000:1.0:1762166811.331693:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c18e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bf3 expref: 9 pid: 12400 timeout: 532 lvb_type: 1 00010000:00010000:1.0:1762166811.331717:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166811.331719:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166811.331722:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c27c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166811.331730:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c27c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166811.331804:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166811.331820:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c27c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166811.331836:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2361:x1847765444287872:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 228us (1095us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166811.331850:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c27c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166811.331852:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 564 00010000:00010000:2.0:1762166811.331866:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c27c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.331874:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c27c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.331900:0:12402:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166811.331931:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166811.331942:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c27c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166811.332069:0:6535:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c283 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166811.332081:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c283 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166811.332090:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c283 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166811.332091:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166811.332103:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c27c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166811.332104:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c283 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166811.332144:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c27c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166811.332152:0:6535:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166811.332167:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c27c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166811.332178:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c27c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166811.332217:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166811.332222:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c283 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166811.332230:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166811.332234:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c283 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166811.332242:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c283 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166811.332266:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c283 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166811.332273:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c283 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166811.332306:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166811.332310:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166811.332312:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166811.332430:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765451923840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6122us (6396us total) trans 21474836719 rc 0/0 00000100:00100000:2.0:1762166811.332443:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000004:00080000:0.0:1762166811.332475:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e2bc700/2, rc 0, transno 21474836719 00000100:00100000:0.0:1762166811.332485:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451923840:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1762166811.332644:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166811.332647:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166811.332650:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c291 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.332659:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c291 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.332688:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166811.332731:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2361:x1847765444288128:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1196us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166811.332749:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 563 00000100:00080000:3.0:1762166811.332785:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1762166811.332796:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166811.333238:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765451923968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6589us (7082us total) trans 17179869395 rc 0/0 00000100:00100000:1.0:1762166811.333261:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00010000:00010000:2.0:1762166811.333282:0:7858:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c291 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.333295:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c291 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166811.333300:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166811.333306:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c291 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762166811.333312:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f284700/2, rc 0, transno 17179869395 00010000:00010000:2.0:1762166811.333316:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c291 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166811.333317:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c28a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166811.333335:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451923968:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1762166811.333345:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c28a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.333355:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166811.333357:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c28a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166811.333369:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c28a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166811.333397:0:6532:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1762166811.333659:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765451923712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6516us (6649us total) trans 21474836720 rc 0/0 00000100:00100000:2.0:1762166811.333667:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00010000:00010000:2.0:1762166811.333690:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1762166811.333696:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c291 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.333705:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166811.333709:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c291 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.333718:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c291 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.333733:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c291 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.333749:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c291 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.333793:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166811.333797:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c28a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.333804:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166811.333807:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c28a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.333825:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c28a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.333835:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c28a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.333842:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c28a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.333856:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166811.333858:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166811.333860:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166811.333886:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166811.333937:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765451923584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6914us (7041us total) trans 21474836721 rc 0/0 00000100:00100000:1.0:1762166811.333944:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000004:00080000:1.0:1762166811.333988:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e2bea00/2, rc 0, transno 21474836720 00000100:00100000:1.0:1762166811.333995:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451923712:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1762166811.334004:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e2bd500/2, rc 0, transno 21474836721 00000100:00100000:1.0:1762166811.334008:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451923584:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762166811.434958:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166811.435177:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444288512 00000100:00100000:3.0:1762166811.435189:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444288512 00000100:00080000:0.0:1762166811.435251:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166811.435275:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2549 00000100:00100000:3.0:1762166811.435287:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:43372:x1847765444288512:12345-192.168.203.35@tcp:36:mkdir.0 00010000:00010000:3.0:1762166811.435454:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c298 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.435471:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c298 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.435485:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c298 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.435529:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c29f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.435536:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c29f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.435542:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c29f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166811.436161:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00010000:00010000:3.0:1762166811.436170:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c298 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.436177:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c298 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.436193:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c298 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.436198:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166811.436202:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c298 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.436210:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c298 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.436221:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166811.436224:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166811.436228:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c298 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.436234:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c298 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000004:00010000:3.0:1762166811.436245:0:20128:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001c9ebf8c reply state 000000009508d8a7 transno 4294968989 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c29f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:3.0:1762166811.436253:0:20128:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166811.436334:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:43372:x1847765444288512:12345-192.168.203.35@tcp:36:mkdir.0 Request processed in 1049us (1387us total) trans 4294968989 rc 0/0 00000100:00100000:3.0:1762166811.436342:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2549 00010000:00010000:2.0:1762166811.438209:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c29f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166811.438223:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c29f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166811.438229:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c29f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166811.438234:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166811.438238:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c29f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166811.438244:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c29f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166811.438256:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x46a4c46c (ffff9ee343a13800) 00010000:00010000:2.0:1762166811.438259:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166811.438271:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c29f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166811.438277:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c29f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:0.0:1762166811.445320:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166811.445504:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444288640 00000100:00100000:3.0:1762166811.445514:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444288640 00000100:00100000:3.0:1762166811.445574:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2550 00000100:00100000:3.0:1762166811.445584:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:43373:x1847765444288640:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166811.445609:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166811.445637:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c2a6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c2b expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.445689:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c2ad lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445699:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c2ad lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445707:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c2ad lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445716:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2b4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445720:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445723:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445830:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2bb lrc: 3/1,0 mode: --/PR res: [0x200000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445834:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445847:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166811.445878:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00000004:00200000:3.0:1762166811.445881:0:20128:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166811.445894:0:20128:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445902:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c2ad lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445911:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c2ad lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445916:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c2ad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445919:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166811.445921:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c2ad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445926:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c2ad lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445935:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166811.445937:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166811.445940:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c2ad lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445944:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c2ad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445951:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445954:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2b4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445957:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445960:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166811.445962:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445971:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2b4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445976:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x46a4c46c (ffff9ee343a13000) 00010000:00010000:3.0:1762166811.445977:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166811.445979:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2b4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.445981:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2b4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.446001:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c2a6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c2b expref: 17 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.446009:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2bb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c2b expref: 16 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.446013:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166811.446019:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166811.446020:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445600, rc 0) 00000100:00100000:3.0:1762166811.446067:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:43373:x1847765444288640:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 485us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166811.446072:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2550 00000100:00100000:0.0:1762166811.448412:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166811.448485:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444288896 00000100:00100000:3.0:1762166811.448492:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444288896 00000100:00100000:3.0:1762166811.448592:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2551 00000100:00100000:3.0:1762166811.448601:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:43373:x1847765444288896:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166811.448616:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166811.448640:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c2c2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c32 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1762166811.448756:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00010000:00010000:3.0:1762166811.448895:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c2c2 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c32 expref: 18 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.448908:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166811.448911:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166811.448916:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c2c2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c32 expref: 18 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.448927:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445a00, rc 0) 00000100:00100000:3.0:1762166811.448972:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:43373:x1847765444288896:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 372us (565us total) trans 4294968990 rc 301/301 00000100:00100000:3.0:1762166811.448979:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2551 00000100:00100000:1.0:1762166811.450461:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166811.450529:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444289152 00000100:00100000:3.0:1762166811.450539:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444289152 00000100:00100000:3.0:1762166811.450608:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2552 00000100:00100000:3.0:1762166811.450618:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:43373:x1847765444289152:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166811.450683:0:20128:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166811.450710:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2bb lrc: 0/0,0 mode: --/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c2b expref: 17 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.450730:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xe:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166811.450753:0:20128:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166811.450810:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c2d0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.450843:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c2d0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.450855:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c2d0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00010000:3.0:1762166811.451144:0:20128:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001cd497d9 reply state 000000001bf5d90a transno 4294968991 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c2d0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:3.0:1762166811.451154:0:20128:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1762166811.451168:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00000100:00100000:3.0:1762166811.451259:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:43373:x1847765444289152:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 641us (811us total) trans 4294968991 rc 0/0 00000100:00100000:3.0:1762166811.451266:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2552 00010000:00010000:1.0:1762166811.452432:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c2d0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166811.452447:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c2d0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166811.452468:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c2d0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166811.452474:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166811.452479:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c2d0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166811.452487:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c2d0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166811.452502:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xe:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:1.0:1762166811.452505:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1762166811.452510:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c2d0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:1.0:1762166811.452516:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c2d0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:3.0:1762166811.452619:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166811.452933:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444289408 00000100:00100000:0.0:1762166811.452942:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444289408 00000100:00100000:0.0:1762166811.452993:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 764 00000100:00100000:0.0:1762166811.453003:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:43373:x1847765444289408:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166811.453220:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:43373:x1847765444289408:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 218us (607us total) trans 4294968992 rc 0/0 00000100:00100000:0.0:1762166811.453228:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 764 00000100:00100000:0.0:1762166811.477379:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166811.477464:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444289664 00000100:00100000:3.0:1762166811.477474:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444289664 00000100:00100000:3.0:1762166811.477538:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2553 00000100:00100000:3.0:1762166811.477549:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:43378:x1847765444289664:12345-192.168.203.35@tcp:36:mkdir.0 00010000:00010000:3.0:1762166811.477693:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2d7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.477714:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2d7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.477725:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2d7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.477820:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c2de lrc: 3/0,1 mode: --/PW res: [0x200000404:0x7:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.477846:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c2de lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.477853:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c2de lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166811.478393:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00010000:00010000:3.0:1762166811.478402:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2d7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.478409:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2d7 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.478416:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2d7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.478422:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166811.478426:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2d7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.478433:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2d7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.478445:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166811.478448:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166811.478453:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2d7 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.478458:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2d7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000004:00010000:3.0:1762166811.478469:0:20128:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006619c97c reply state 000000008b49f024 transno 4294968993 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c2de lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:3.0:1762166811.478486:0:20128:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166811.478575:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:43378:x1847765444289664:12345-192.168.203.35@tcp:36:mkdir.0 Request processed in 1027us (1206us total) trans 4294968993 rc 0/0 00000100:00100000:3.0:1762166811.478584:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2553 00010000:00010000:2.0:1762166811.479981:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c2de lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166811.479992:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c2de lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166811.479998:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c2de lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166811.480003:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166811.480006:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c2de lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166811.480012:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c2de lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166811.480023:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x892874e3 (ffff9ee343a13f00) 00010000:00010000:2.0:1762166811.480026:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166811.480030:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c2de lrc: 2/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166811.480035:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c2de lrc: 0/0,0 mode: --/PW res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:0.0:1762166811.487082:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166811.487154:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444289920 00000100:00100000:3.0:1762166811.487164:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444289920 00000100:00100000:3.0:1762166811.487225:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2554 00000100:00100000:3.0:1762166811.487237:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:43379:x1847765444289920:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166811.487262:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166811.487283:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2e5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c39 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.487363:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c2ec lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487378:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c2ec lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487390:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c2ec lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487405:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2f3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487413:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487419:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166811.487551:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00010000:00010000:3.0:1762166811.487666:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c2ec lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487674:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c2ec lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487680:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c2ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487686:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166811.487690:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c2ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487698:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c2ec lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487709:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166811.487713:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166811.487718:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c2ec lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487723:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c2ec lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487747:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487754:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2f3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487759:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487809:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166811.487813:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487826:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2f3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487837:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x46a4c46c (ffff9ee343a13000) 00010000:00010000:3.0:1762166811.487840:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166811.487844:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2f3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487851:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c2f3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.487897:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2e5 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c39 expref: 21 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.487912:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166811.487915:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166811.487919:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c2e5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c39 expref: 21 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.487931:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445600, rc 0) 00000100:00100000:3.0:1762166811.487997:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:43379:x1847765444289920:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 761us (934us total) trans 4294968994 rc 301/301 00000100:00100000:3.0:1762166811.488005:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2554 00000100:00100000:1.0:1762166811.491471:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166811.491576:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444290176 00000100:00100000:2.0:1762166811.491585:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444290176 00000100:00100000:2.0:1762166811.491640:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 765 00000100:00100000:2.0:1762166811.491650:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:43379:x1847765444290176:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166811.492987:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:43379:x1847765444290176:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 1335us (1520us total) trans 4294968995 rc 0/0 00000100:00100000:2.0:1762166811.492998:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 765 00000100:00100000:1.0:1762166811.495263:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166811.495337:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444290432 00000100:00100000:3.0:1762166811.495349:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444290432 00000100:00100000:3.0:1762166811.495404:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2555 00000100:00100000:3.0:1762166811.495414:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34567bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:43379:x1847765444290432:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166811.495435:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166811.495464:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c301 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c40 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.495528:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c308 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495542:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c308 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495552:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c308 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495565:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c30f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495571:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c30f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495577:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c30f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166811.495683:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00010000:00010000:3.0:1762166811.495804:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c308 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495811:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c308 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495818:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c308 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495824:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166811.495827:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c308 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495844:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c308 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495856:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166811.495859:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166811.495864:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c308 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495870:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c308 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495883:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c30f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495889:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c30f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495894:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c30f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495899:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166811.495901:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c30f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495907:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c30f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495913:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x46a4c46c (ffff9ee343a13900) 00010000:00010000:3.0:1762166811.495915:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166811.495917:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c30f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495922:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c30f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.495964:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c301 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c40 expref: 23 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.495975:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166811.495978:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166811.495982:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c301 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c40 expref: 23 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.495990:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243444c00, rc 0) 00000100:00100000:3.0:1762166811.496052:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34567bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:43379:x1847765444290432:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 639us (793us total) trans 4294968996 rc 301/301 00000100:00100000:3.0:1762166811.496060:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2555 00000100:00100000:0.0:1762166811.498531:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166811.498614:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444290560 00000100:00100000:2.0:1762166811.498622:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444290560 00000100:00100000:2.0:1762166811.498675:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 766 00000100:00100000:2.0:1762166811.498684:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3719b5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:43379:x1847765444290560:12345-192.168.203.35@tcp:33:lfs.0 00000004:00200000:2.0:1762166811.498868:0:5758:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00000004:00200000:2.0:1762166811.498874:0:5758:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1762166811.499469:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3719b5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:43379:x1847765444290560:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 786us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166811.499480:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 766 00000100:00100000:1.0:1762166811.500713:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166811.500807:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444290688 00000100:00100000:3.0:1762166811.500813:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444290688 00000100:00100000:3.0:1762166811.500866:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2556 00000100:00100000:3.0:1762166811.500875:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:43379:x1847765444290688:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166811.500898:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166811.500922:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c31d lrc: 2/0,0 mode: --/CR res: [0x200000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c47 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.500987:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c324 lrc: 3/1,0 mode: --/PR res: [0x200000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.500999:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c324 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.501009:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c324 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166811.501075:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00000004:00200000:3.0:1762166811.501079:0:20128:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166811.501096:0:20128:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c324 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166811.501120:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c31d lrc: 0/0,0 mode: --/CR res: [0x200000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c47 expref: 24 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.501134:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c324 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c47 expref: 23 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166811.501142:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xe:0x0].0x0 (ffff9ee343a13b00) 00010000:00010000:3.0:1762166811.501145:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166811.501148:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445e00, rc 0) 00000100:00100000:3.0:1762166811.501197:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:43379:x1847765444290688:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 323us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166811.501204:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2556 00000100:00100000:1.0:1762166811.502670:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166811.502730:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444290944 00000100:00100000:2.0:1762166811.502747:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444290944 00000100:00100000:2.0:1762166811.502809:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 767 00000100:00100000:2.0:1762166811.502819:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:43379:x1847765444290944:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166811.503042:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:43379:x1847765444290944:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 223us (374us total) trans 4294968997 rc 0/0 00000100:00100000:2.0:1762166811.503051:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 767 00000100:00100000:0.0:1762166811.506011:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166811.506088:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444291072 00000100:00100000:1.0:1762166811.506096:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444291072 00000100:00100000:1.0:1762166811.506148:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2557 00000100:00100000:1.0:1762166811.506156:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:43379:x1847765444291072:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166811.506175:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166811.506193:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9c32b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c4e expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166811.506287:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9c332 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506301:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9c332 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506311:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9c332 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506324:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9c339 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506330:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9c339 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506336:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9c339 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506422:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c340 lrc: 3/1,0 mode: --/PR res: [0x200000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506429:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c340 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506435:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c340 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:1.0:1762166811.506467:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00000004:00200000:1.0:1762166811.506470:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166811.506485:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c340 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506494:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9c332 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506506:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9c332 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506513:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9c332 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506518:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166811.506522:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9c332 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506529:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9c332 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506539:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:1.0:1762166811.506543:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166811.506547:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9c332 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506553:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453600/0xf915a5bdf3c9c332 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506565:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9c339 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506570:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9c339 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506575:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9c339 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.506580:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166811.507093:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9c339 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.507109:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9c339 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.507118:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x892874e3 (ffff9ee34ada3500) 00010000:00010000:1.0:1762166811.507121:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166811.507123:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9c339 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.507129:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452600/0xf915a5bdf3c9c339 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.507168:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9c32b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c4e expref: 26 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166811.507181:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c340 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c4e expref: 25 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166811.507188:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xf:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:1.0:1762166811.507190:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762166811.507192:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453800, rc 0) 00000100:00100000:1.0:1762166811.507256:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:43379:x1847765444291072:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1099us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166811.507263:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2557 00000100:00100000:1.0:1762166811.509506:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166811.509592:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444291328 00000100:00100000:2.0:1762166811.509599:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444291328 00000100:00100000:2.0:1762166811.509651:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2558 00000100:00100000:2.0:1762166811.509662:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:43379:x1847765444291328:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166811.509678:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166811.509693:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c347 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c55 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1762166811.509846:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00010000:00010000:2.0:1762166811.509962:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c347 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c55 expref: 27 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.509975:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166811.509978:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166811.509983:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c347 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c55 expref: 27 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.509996:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15e00, rc 0) 00000100:00100000:2.0:1762166811.510046:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:43379:x1847765444291328:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 386us (544us total) trans 4294968998 rc 301/301 00000100:00100000:2.0:1762166811.510052:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2558 00000100:00100000:3.0:1762166811.511391:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166811.511430:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444291584 00000100:00100000:2.0:1762166811.511436:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444291584 00000100:00100000:2.0:1762166811.511475:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2559 00000100:00100000:2.0:1762166811.511483:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:43379:x1847765444291584:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762166811.511516:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166811.511532:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c340 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c4e expref: 26 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.511545:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xf:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:2.0:1762166811.511554:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166811.511571:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c355 lrc: 3/0,1 mode: --/PW res: [0x200000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.511581:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c355 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.511602:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c355 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00010000:2.0:1762166811.511898:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a47485cf reply state 00000000340e3e3a transno 4294968999 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c355 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:2.0:1762166811.511908:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1762166811.511921:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00000100:00100000:2.0:1762166811.512626:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:43379:x1847765444291584:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 1141us (1236us total) trans 4294968999 rc 0/0 00000100:00100000:2.0:1762166811.512634:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2559 00010000:00010000:1.0:1762166811.513798:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c355 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.513819:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c355 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.513849:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c355 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.513855:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166811.513859:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c355 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.513867:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c355 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.513880:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xf:0x0].0x0 (ffff9ee360714000) 00010000:00010000:1.0:1762166811.513883:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1762166811.513886:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c355 lrc: 2/0,0 mode: --/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166811.513892:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9c355 lrc: 0/0,0 mode: --/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166811.514046:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166811.514091:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444291840 00000100:00100000:2.0:1762166811.514097:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444291840 00000100:00100000:2.0:1762166811.514150:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 768 00000100:00100000:2.0:1762166811.514159:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:43379:x1847765444291840:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166811.514336:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:43379:x1847765444291840:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 177us (290us total) trans 4294969000 rc 0/0 00000100:00100000:2.0:1762166811.514344:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 768 00000100:00100000:0.0:1762166811.528874:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166811.528999:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444292096 00000100:00100000:2.0:1762166811.529011:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444292096 00000100:00100000:2.0:1762166811.529090:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2560 00000100:00100000:2.0:1762166811.529102:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:43382:x1847765444292096:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166811.529128:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166811.529149:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c35c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c5c expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.529222:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c363 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529248:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c363 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529260:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c363 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529274:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9c36a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529281:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9c36a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529287:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9c36a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:2.0:1762166811.529418:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00010000:00010000:2.0:1762166811.529504:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c363 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529510:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c363 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529516:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c363 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529522:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166811.529525:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c363 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529532:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c363 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529544:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166811.529547:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166811.529556:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c363 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529563:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9c363 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529576:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9c36a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529581:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9c36a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529586:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9c36a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529591:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166811.529593:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9c36a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529608:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9c36a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529619:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x46a4c46c (ffff9ee360714c00) 00010000:00010000:2.0:1762166811.529622:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166811.529625:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9c36a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529630:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9c36a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.529668:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c35c lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c5c expref: 29 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.529679:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166811.529687:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166811.529691:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9c35c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c5c expref: 29 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.529700:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15e00, rc 0) 00000100:00100000:2.0:1762166811.529809:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:43382:x1847765444292096:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 708us (945us total) trans 4294969001 rc 301/301 00000100:00100000:2.0:1762166811.529817:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2560 00000100:00100000:1.0:1762166811.531908:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166811.531979:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444292352 00000100:00100000:2.0:1762166811.531986:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444292352 00000100:00100000:2.0:1762166811.532033:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2561 00000100:00100000:2.0:1762166811.532043:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:43382:x1847765444292352:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166811.532062:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166811.532077:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9c378 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c63 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.532134:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9c37f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532146:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9c37f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532155:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9c37f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532167:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9c386 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532174:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9c386 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532181:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9c386 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:2.0:1762166811.532294:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00010000:00010000:2.0:1762166811.532377:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9c37f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532384:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9c37f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532390:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9c37f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532395:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166811.532399:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9c37f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532406:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9c37f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532417:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166811.532420:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166811.532424:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9c37f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532430:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9c37f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532443:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9c386 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532449:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9c386 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532454:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9c386 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532469:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166811.532473:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9c386 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532479:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9c386 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532487:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x46a4c46c (ffff9ee360714700) 00010000:00010000:2.0:1762166811.532489:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166811.532492:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9c386 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532498:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15000/0xf915a5bdf3c9c386 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166811.532532:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9c378 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c63 expref: 30 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.532541:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:2.0:1762166811.532544:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166811.532547:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9c378 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c63 expref: 30 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166811.532556:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14600, rc 0) 00000100:00100000:2.0:1762166811.532617:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:43382:x1847765444292352:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 576us (714us total) trans 4294969002 rc 301/301 00000100:00100000:2.0:1762166811.532625:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2561 00000100:00100000:3.0:1762166811.534616:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166811.534818:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444292608 00000100:00100000:2.0:1762166811.534827:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444292608 00000100:00100000:2.0:1762166811.534889:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 769 00000100:00100000:2.0:1762166811.534898:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:43382:x1847765444292608:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166811.535103:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:43382:x1847765444292608:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 205us (493us total) trans 4294969003 rc 0/0 00000100:00100000:2.0:1762166811.535111:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 769 00000100:00100000:0.0:1762166811.538201:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166811.538671:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444292736 00000100:00100000:1.0:1762166811.538680:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444292736 00000100:00100000:1.0:1762166811.538730:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 770 00000100:00100000:1.0:1762166811.538749:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:43382:x1847765444292736:12345-192.168.203.35@tcp:33:lfs.0 00000004:00200000:1.0:1762166811.538878:0:5758:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00000004:00200000:1.0:1762166811.538883:0:5758:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1762166811.539007:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:43382:x1847765444292736:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 269us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166811.539015:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 770 00000100:00100000:1.0:1762166811.540724:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166811.540908:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444292992 00000100:00100000:2.0:1762166811.540927:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444292992 00000100:00100000:2.0:1762166811.541018:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 771 00000100:00100000:2.0:1762166811.541029:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:43382:x1847765444292992:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166811.541372:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:43382:x1847765444292992:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 343us (651us total) trans 4294969004 rc 0/0 00000100:00100000:2.0:1762166811.541381:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 771 00000100:00100000:3.0:1762166811.749494:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166811.749543:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166811.749643:0:5749:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444293120 00000100:00100000:2.0:1762166811.749653:0:5749:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444293120 00000100:00100000:2.0:1762166811.749706:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 501 00000100:00100000:2.0:1762166811.749716:0:5749:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34bd46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2359:x1847765444293120:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:2.0:1762166811.749824:0:5749:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34bd46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2359:x1847765444293120:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 109us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166811.749832:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 501 00000100:00100000:0.0:1762166811.750461:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444293248 00000100:00100000:0.0:1762166811.750518:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444293248 00000100:00100000:0.0:1762166811.750559:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 224 00000100:00100000:0.0:1762166811.750568:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765444293248:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:0.0:1762166811.750618:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765444293248:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 51us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166811.750624:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 224 00000100:00100000:3.0:1762166811.751324:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166811.751358:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166811.751421:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444293504 00000100:00100000:2.0:1762166811.751426:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444293504 00000100:00100000:2.0:1762166811.751459:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444293376 00000100:00100000:2.0:1762166811.751462:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444293376 00000100:00100000:2.0:1762166811.751494:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 179 00000100:00100000:2.0:1762166811.751502:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2358:x1847765444293504:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:2.0:1762166811.751545:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2358:x1847765444293504:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 44us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166811.751566:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 179 00000100:00100000:1.0:1762166811.751579:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 180 00000100:00100000:1.0:1762166811.751597:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2358:x1847765444293376:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:1.0:1762166811.751629:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2358:x1847765444293376:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 36us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166811.751636:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 180 00000100:00100000:2.0:1762166811.816090:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1847765451924736:0@lo:400:kworker.0 00000100:00100000:0.0:1762166811.816124:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1847765451924992:0@lo:400:kworker.0 00000100:00100000:2.0:1762166811.816146:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166811.816213:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765451924864:0@lo:400:kworker.0 00000100:00100000:1.0:1762166811.816264:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451924608:0@lo:400:kworker.0 00000100:00100000:0.0:1762166811.816331:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451924736 00000100:00100000:0.0:1762166811.816340:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451924736 00000100:00100000:0.0:1762166811.816396:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1762166811.816405:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1847765451924736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166811.817494:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166811.817569:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451924864 00000100:00100000:3.0:1762166811.817589:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451924864 00000100:00100000:3.0:1762166811.817631:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1762166811.817638:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1847765451924864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166811.817680:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1847765451924864:12345-0@lo:400:kworker.0 Request processed in 41us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166811.817686:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:3.0:1762166811.817710:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166811.817753:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765451924864:0@lo:400:kworker.0 00000100:00100000:3.0:1762166811.817804:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166811.817833:0:5757:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451924992 00000100:00100000:3.0:1762166811.817837:0:5757:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451924992 00000100:00100000:3.0:1762166811.817864:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1762166811.817869:0:5757:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1847765451924992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166811.817905:0:5757:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1847765451924992:12345-0@lo:400:kworker.0 Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166811.817912:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:3.0:1762166811.817929:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166811.817947:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1847765451924992:0@lo:400:kworker.0 00000100:00100000:0.0:1762166811.818457:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1847765451924736:12345-0@lo:400:kworker.0 Request processed in 2051us (2309us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166811.818465:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1762166811.818572:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1847765451924736:0@lo:400:kworker.0 00000100:00100000:1.0:1762166811.818664:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166811.818713:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451924608 00000100:00100000:3.0:1762166811.818718:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451924608 00000100:00100000:3.0:1762166811.818779:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1762166811.818787:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765451924608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166811.818832:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765451924608:12345-0@lo:400:kworker.0 Request processed in 46us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166811.818837:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1762166811.818965:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451924608:0@lo:400:kworker.0 00010000:00010000:1.0:1762166812.008914:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166812.353480:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166812.353694:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444293760 00000100:00100000:0.0:1762166812.353703:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444293760 00000100:00100000:0.0:1762166812.353796:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2562 00000100:00100000:0.0:1762166812.353806:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:43575:x1847765444293760:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166812.353826:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166812.353845:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686200/0xf915a5bdf3c9c394 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c6a expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166812.353915:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c39b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.353941:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c39b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.353954:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c39b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.353969:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c3a2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.353975:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.353981:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:0.0:1762166812.354098:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00010000:00010000:0.0:1762166812.354188:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c39b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.354195:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c39b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.354201:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c39b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.354206:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166812.354209:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c39b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.354216:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c39b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.354226:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166812.354228:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166812.354237:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c39b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.354243:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c39b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.354256:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.354262:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c3a2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.354266:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c3a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.354271:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166812.354273:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c3a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.354278:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c3a2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.354285:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x892874e3 (ffff9ee36062b400) 00010000:00010000:0.0:1762166812.354287:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166812.354290:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c3a2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.354295:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c3a2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.354332:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686200/0xf915a5bdf3c9c394 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c6a expref: 33 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166812.354341:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166812.354348:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166812.354353:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686200/0xf915a5bdf3c9c394 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c6a expref: 33 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166812.354362:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686200, rc 0) 00000100:00100000:0.0:1762166812.355208:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:43575:x1847765444293760:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1399us (1732us total) trans 4294969005 rc 301/301 00000100:00100000:0.0:1762166812.355218:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2562 00000100:00100000:2.0:1762166812.357149:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166812.357503:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444294016 00000100:00100000:0.0:1762166812.357512:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444294016 00000100:00100000:0.0:1762166812.357570:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2563 00000100:00100000:0.0:1762166812.357579:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:43575:x1847765444294016:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166812.357601:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166812.357619:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c3b0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c71 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166812.357685:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c3b7 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.357699:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c3b7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.357710:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c3b7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.357725:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c3be lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.357743:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c3be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.357750:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c3be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:0.0:1762166812.357899:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00010000:00010000:0.0:1762166812.357976:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c3b7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.357984:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c3b7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.357990:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c3b7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.357996:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166812.357999:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c3b7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.358006:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c3b7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.358017:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166812.358020:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166812.358024:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c3b7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.358029:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c3b7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.358041:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c3be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.358047:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c3be lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.358052:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c3be lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.358066:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166812.358069:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c3be lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.358075:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c3be lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.358082:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x892874e3 (ffff9ee36062bf00) 00010000:00010000:0.0:1762166812.358085:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166812.358088:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c3be lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.358093:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c3be lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166812.358130:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c3b0 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c71 expref: 34 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166812.358138:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166812.358140:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166812.358143:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c3b0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c71 expref: 34 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166812.358153:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687800, rc 0) 00000100:00100000:0.0:1762166812.358209:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:43575:x1847765444294016:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 632us (1067us total) trans 4294969006 rc 301/301 00000100:00100000:0.0:1762166812.358216:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2563 00000100:00100000:1.0:1762166812.359530:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166812.359588:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444294272 00000100:00100000:3.0:1762166812.359602:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444294272 00000100:00100000:3.0:1762166812.359654:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 772 00000100:00100000:3.0:1762166812.359664:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3719b5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:43575:x1847765444294272:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166812.359898:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3719b5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:43575:x1847765444294272:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 235us (374us total) trans 4294969007 rc 0/0 00000100:00100000:3.0:1762166812.359906:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 772 00000100:00100000:1.0:1762166812.361173:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166812.361694:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444294400 00000100:00100000:3.0:1762166812.361701:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444294400 00000100:00100000:3.0:1762166812.361755:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 773 00000100:00100000:3.0:1762166812.361785:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:43575:x1847765444294400:12345-192.168.203.35@tcp:33:lfs.0 00000004:00200000:3.0:1762166812.361874:0:5758:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00000004:00200000:3.0:1762166812.361879:0:5758:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:3.0:1762166812.361945:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:43575:x1847765444294400:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 182us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166812.361952:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 773 00000100:00100000:2.0:1762166812.363702:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166812.363804:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444294656 00000100:00100000:3.0:1762166812.363812:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444294656 00000100:00100000:3.0:1762166812.363852:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 774 00000100:00100000:3.0:1762166812.363861:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:43575:x1847765444294656:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166812.364079:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:43575:x1847765444294656:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 217us (382us total) trans 4294969008 rc 0/0 00000100:00100000:3.0:1762166812.364087:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 774 00010000:00010000:2.0:1762166813.032028:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166813.143922:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.144017:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444294912 00000100:00100000:3.0:1762166813.144027:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444294912 00000100:00080000:0.0:1762166813.144101:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166813.144107:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2564 00000100:00100000:3.0:1762166813.144120:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:43766:x1847765444294912:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.144158:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.144175:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c3cc lrc: 2/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c78 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.144322:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c3d3 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144336:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c3d3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144346:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c3d3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144360:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c3da lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144367:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c3da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144373:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c3da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.144445:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00010000:00010000:3.0:1762166813.144461:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c3d3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144468:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c3d3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144474:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c3d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144479:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.144482:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c3d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144497:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c3d3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144508:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.144511:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.144516:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c3d3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144522:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c3d3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144534:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c3da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144539:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c3da lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144545:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c3da lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144550:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.144552:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c3da lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144557:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c3da lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144564:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x46a4c46c (ffff9ee343a13900) 00010000:00010000:3.0:1762166813.144567:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.144570:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c3da lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144576:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c3da lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.144610:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c3cc lrc: 1/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c78 expref: 36 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.144620:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.144622:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.144626:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c3cc lrc: 0/0,0 mode: --/CW res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c78 expref: 36 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.144634:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445800, rc 0) 00000100:00100000:3.0:1762166813.144689:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:43766:x1847765444294912:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 572us (772us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166813.144697:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2564 00000100:00100000:1.0:1762166813.146334:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.146369:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444295168 00000100:00100000:3.0:1762166813.146377:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444295168 00000100:00100000:3.0:1762166813.146421:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2565 00000100:00100000:3.0:1762166813.146427:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:43766:x1847765444295168:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.146441:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.146453:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c3e1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c7f expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.146505:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c3e8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146517:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c3e8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146526:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c3e8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146554:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c3ef lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146561:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c3ef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146567:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c3ef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.146674:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00010000:00010000:3.0:1762166813.146793:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c3e8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146800:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c3e8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146818:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c3e8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146823:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.146826:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c3e8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146833:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c3e8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146844:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.146846:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.146850:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c3e8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146856:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c3e8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146879:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c3ef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146885:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c3ef lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146890:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c3ef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146895:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.146898:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c3ef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146904:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c3ef lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146911:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x46a4c46c (ffff9ee343a13000) 00010000:00010000:3.0:1762166813.146914:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.146916:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c3ef lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146921:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c3ef lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.146953:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c3e1 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c7f expref: 37 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.146962:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.146964:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166813.146968:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c3e1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c7f expref: 37 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.146987:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243444a00, rc 0) 00000100:00100000:3.0:1762166813.147039:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:43766:x1847765444295168:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 610us (711us total) trans 4294969009 rc 301/301 00000100:00100000:3.0:1762166813.147046:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2565 00000100:00100000:2.0:1762166813.148860:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.148961:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444295424 00000100:00100000:3.0:1762166813.148969:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444295424 00000100:00100000:3.0:1762166813.149017:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2566 00000100:00100000:3.0:1762166813.149026:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:43766:x1847765444295424:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166813.149082:0:20128:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166813.149103:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c324 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c47 expref: 36 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.149118:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xe:0x0].0x0 (ffff9ee343a13b00) 00010000:00010000:3.0:1762166813.149127:0:20128:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166813.149150:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c3fd lrc: 3/0,1 mode: --/PW res: [0x200000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.149161:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c3fd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.149169:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c3fd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00010000:3.0:1762166813.149374:0:20128:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009048116e reply state 000000001bf5d90a transno 4294969010 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c3fd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:3.0:1762166813.149383:0:20128:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1762166813.149394:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00000100:00100000:3.0:1762166813.149462:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:43766:x1847765444295424:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 437us (608us total) trans 4294969010 rc 0/0 00000100:00100000:3.0:1762166813.149480:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2566 00010000:00010000:2.0:1762166813.150230:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c3fd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166813.150240:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c3fd lrc: 2/0,0 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166813.150246:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c3fd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166813.150252:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166813.150255:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c3fd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166813.150262:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c3fd lrc: 4/0,0 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166813.150273:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xe:0x0].0x0 (ffff9ee343a13500) 00010000:00010000:2.0:1762166813.150275:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166813.150278:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c3fd lrc: 2/0,0 mode: --/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166813.150283:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c3fd lrc: 0/0,0 mode: --/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:2.0:1762166813.150520:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.150631:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444295680 00000100:00100000:3.0:1762166813.150637:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444295680 00000100:00100000:3.0:1762166813.150670:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 775 00000100:00100000:3.0:1762166813.150678:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:43766:x1847765444295680:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166813.150898:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:43766:x1847765444295680:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 219us (377us total) trans 4294969011 rc 0/0 00000100:00100000:3.0:1762166813.150906:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 775 00000100:00100000:1.0:1762166813.158219:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.158397:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444295936 00000100:00100000:3.0:1762166813.158407:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444295936 00000100:00100000:3.0:1762166813.158479:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2567 00000100:00100000:3.0:1762166813.158488:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:43767:x1847765444295936:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.158513:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.158532:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c404 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c86 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.158614:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c40b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.158629:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c40b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.158639:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c40b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.158653:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c412 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.158659:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c412 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.158680:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c412 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.159052:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00010000:00010000:3.0:1762166813.159137:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c40b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.159144:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c40b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.159151:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c40b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.159156:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.159160:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c40b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.159167:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c40b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.159178:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.159181:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.159186:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c40b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.159192:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c40b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.159204:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c412 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.159209:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c412 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.159220:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c412 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.159223:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.159225:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c412 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.159228:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c412 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.159245:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x46a4c46c (ffff9ee343a13900) 00010000:00010000:3.0:1762166813.159248:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.159251:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c412 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.159256:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c412 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.159294:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c404 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c86 expref: 39 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.159304:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.159306:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166813.159310:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c404 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c86 expref: 39 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.159319:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445800, rc 0) 00000100:00100000:3.0:1762166813.159384:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:43767:x1847765444295936:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 896us (1173us total) trans 4294969012 rc 301/301 00000100:00100000:3.0:1762166813.159392:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2567 00000100:00100000:1.0:1762166813.161051:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.161105:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444296192 00000100:00100000:3.0:1762166813.161115:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444296192 00000100:00100000:3.0:1762166813.161164:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 776 00000100:00100000:3.0:1762166813.161174:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:43767:x1847765444296192:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166813.161388:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:43767:x1847765444296192:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 216us (344us total) trans 4294969013 rc 0/0 00000100:00100000:3.0:1762166813.161394:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 776 00000100:00100000:2.0:1762166813.163036:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.163106:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444296448 00000100:00100000:3.0:1762166813.163115:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444296448 00000100:00100000:3.0:1762166813.163160:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2568 00000100:00100000:3.0:1762166813.163169:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:43767:x1847765444296448:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.163188:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.163206:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c420 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c8d expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.163268:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c427 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163282:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c427 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163293:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c427 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163307:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c42e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163314:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c42e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163322:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c42e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.163464:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00010000:00010000:3.0:1762166813.163550:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c427 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163556:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c427 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163562:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c427 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163566:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.163570:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c427 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163577:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c427 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163588:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.163591:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.163596:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c427 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163601:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c427 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163613:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c42e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163618:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c42e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163623:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c42e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163641:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.163644:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c42e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163650:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c42e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163657:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x46a4c46c (ffff9ee343a13e00) 00010000:00010000:3.0:1762166813.163660:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.163662:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c42e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163668:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c42e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.163708:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c420 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c8d expref: 41 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.163719:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.163722:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166813.163735:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c420 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c8d expref: 41 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.163744:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445c00, rc 0) 00000100:00100000:3.0:1762166813.163821:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:43767:x1847765444296448:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 652us (790us total) trans 4294969014 rc 301/301 00000100:00100000:3.0:1762166813.163828:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2568 00000100:00100000:1.0:1762166813.165079:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.165126:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444296576 00000100:00100000:3.0:1762166813.165134:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444296576 00000100:00100000:3.0:1762166813.165184:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 777 00000100:00100000:3.0:1762166813.165193:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3719b7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:43767:x1847765444296576:12345-192.168.203.35@tcp:33:lfs.0 00000004:00200000:3.0:1762166813.165267:0:5758:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00000004:00200000:3.0:1762166813.165271:0:5758:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:3.0:1762166813.165319:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3719b7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:43767:x1847765444296576:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 128us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166813.165324:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 777 00000100:00100000:1.0:1762166813.166281:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.166392:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444296704 00000100:00100000:3.0:1762166813.166399:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444296704 00000100:00100000:3.0:1762166813.166441:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2569 00000100:00100000:3.0:1762166813.166452:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:43767:x1847765444296704:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.166465:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.166483:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c43c lrc: 2/0,0 mode: --/CR res: [0x200000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c94 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.166537:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c443 lrc: 3/1,0 mode: --/PR res: [0x200000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.166549:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c443 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.166559:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c443 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.166595:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00000004:00200000:3.0:1762166813.166598:0:20128:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166813.166612:0:20128:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c443 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.166633:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c43c lrc: 0/0,0 mode: --/CR res: [0x200000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c94 expref: 42 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.166664:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c443 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c94 expref: 41 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.166671:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xe:0x0].0x0 (ffff9ee343a13600) 00010000:00010000:3.0:1762166813.166674:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166813.166677:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243444000, rc 0) 00000100:00100000:3.0:1762166813.166719:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+41:43767:x1847765444296704:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 269us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166813.166738:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2569 00000100:00100000:2.0:1762166813.168239:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.168287:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444296960 00000100:00100000:3.0:1762166813.168295:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444296960 00000100:00100000:3.0:1762166813.168338:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 778 00000100:00100000:3.0:1762166813.168347:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+41:43767:x1847765444296960:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166813.168570:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:43767:x1847765444296960:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 223us (336us total) trans 4294969015 rc 0/0 00000100:00100000:3.0:1762166813.168577:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 778 00000100:00100000:1.0:1762166813.170151:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.170206:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444297088 00000100:00100000:3.0:1762166813.170222:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444297088 00000100:00100000:3.0:1762166813.170265:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2570 00000100:00100000:3.0:1762166813.170273:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:43767:x1847765444297088:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.170290:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.170305:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c44a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c9b expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.170351:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c451 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170372:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c451 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170380:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c451 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170390:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c458 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170395:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c458 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170399:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c458 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170484:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c45f lrc: 3/1,0 mode: --/PR res: [0x200000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170492:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c45f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170499:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c45f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.170537:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00000004:00200000:3.0:1762166813.170540:0:20128:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166813.170571:0:20128:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c45f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170583:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c451 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170588:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c451 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170604:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c451 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170609:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.170613:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c451 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170620:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c451 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170632:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.170635:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.170639:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c451 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170644:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c451 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170657:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c458 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170663:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c458 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170668:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c458 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170673:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.170676:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c458 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170683:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c458 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170701:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x892874e3 (ffff9ee343a13b00) 00010000:00010000:3.0:1762166813.170703:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.170706:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c458 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170710:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c458 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.170749:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c44a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c9b expref: 44 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.170800:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c45f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c9b expref: 43 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.170808:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xf:0x0].0x0 (ffff9ee343a13000) 00010000:00010000:3.0:1762166813.170810:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166813.170813:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445600, rc 0) 00000100:00100000:3.0:1762166813.170859:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:43767:x1847765444297088:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 586us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166813.170865:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2570 00000100:00100000:1.0:1762166813.172682:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.172737:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444297344 00000100:00100000:3.0:1762166813.172746:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444297344 00000100:00100000:3.0:1762166813.172825:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2571 00000100:00100000:3.0:1762166813.172836:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:43767:x1847765444297344:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.172855:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.172870:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c466 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ca2 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1762166813.172999:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00010000:00010000:3.0:1762166813.173110:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c466 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ca2 expref: 45 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.173123:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.173127:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166813.173131:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c466 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ca2 expref: 45 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.173145:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445a00, rc 0) 00000100:00100000:3.0:1762166813.173197:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:43767:x1847765444297344:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 363us (521us total) trans 4294969016 rc 301/301 00000100:00100000:3.0:1762166813.173204:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2571 00000100:00100000:1.0:1762166813.174443:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.174484:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444297600 00000100:00100000:3.0:1762166813.174491:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444297600 00000100:00100000:3.0:1762166813.174535:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2572 00000100:00100000:3.0:1762166813.174543:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:43767:x1847765444297600:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166813.174582:0:20128:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166813.174601:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c45f lrc: 0/0,0 mode: --/PR res: [0x200000404:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c9b expref: 44 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.174617:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xf:0x0].0x0 (ffff9ee343a13000) 00010000:00010000:3.0:1762166813.174626:0:20128:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166813.174646:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c474 lrc: 3/0,1 mode: --/PW res: [0x200000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.174657:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c474 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.174678:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c474 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00010000:3.0:1762166813.174922:0:20128:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f25fb119 reply state 000000009508d8a7 transno 4294969017 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c474 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:3.0:1762166813.174931:0:20128:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1762166813.174942:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00000100:00100000:3.0:1762166813.175002:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+45:43767:x1847765444297600:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 459us (563us total) trans 4294969017 rc 0/0 00000100:00100000:3.0:1762166813.175009:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2572 00010000:00010000:0.0:1762166813.175872:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c474 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166813.175892:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c474 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166813.175900:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c474 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166813.175907:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc67600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166813.175911:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c474 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166813.175920:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c474 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166813.175938:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xf:0x0].0x0 (ffff9ee343a13500) 00010000:00010000:0.0:1762166813.175941:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166813.175946:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c474 lrc: 2/0,0 mode: --/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166813.175952:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c474 lrc: 0/0,0 mode: --/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:1.0:1762166813.176020:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.176100:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444297856 00000100:00100000:3.0:1762166813.176107:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444297856 00000100:00100000:3.0:1762166813.176145:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 779 00000100:00100000:3.0:1762166813.176154:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:43767:x1847765444297856:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166813.176378:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+45:43767:x1847765444297856:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 224us (358us total) trans 4294969018 rc 0/0 00000100:00100000:3.0:1762166813.176385:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 779 00000100:00100000:1.0:1762166813.187399:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.187486:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444298112 00000100:00100000:3.0:1762166813.187496:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444298112 00000100:00100000:3.0:1762166813.187557:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2573 00000100:00100000:3.0:1762166813.187565:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+45:43770:x1847765444298112:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.187584:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.187601:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9c47b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ca9 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.187671:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c482 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.187698:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c482 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.187708:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c482 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.187723:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c489 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.187756:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c489 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.187790:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c489 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.187918:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00010000:00010000:3.0:1762166813.188008:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c482 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.188014:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c482 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.188020:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c482 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.188026:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.188029:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c482 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.188036:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c482 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.188047:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.188056:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.188061:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c482 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.188066:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c482 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.188079:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c489 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.188084:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c489 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.188090:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c489 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.188094:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.188097:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c489 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.188103:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c489 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.188110:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x46a4c46c (ffff9ee343a13000) 00010000:00010000:3.0:1762166813.188112:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.188115:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c489 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.188118:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c489 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.188148:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9c47b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ca9 expref: 47 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.188169:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.188171:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166813.188176:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9c47b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ca9 expref: 47 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.188185:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fc67000, rc 0) 00000100:00100000:3.0:1762166813.188240:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:43770:x1847765444298112:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 674us (850us total) trans 4294969019 rc 301/301 00000100:00100000:3.0:1762166813.188247:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2573 00000100:00100000:1.0:1762166813.190081:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.190134:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444298368 00000100:00100000:3.0:1762166813.190142:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444298368 00000100:00100000:3.0:1762166813.190190:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2574 00000100:00100000:3.0:1762166813.190198:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:43770:x1847765444298368:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.190217:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.190233:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9c497 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90cb0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.190289:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9c49e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190300:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9c49e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190318:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9c49e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190336:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c4a5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190357:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190364:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.190465:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00010000:00010000:3.0:1762166813.190540:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9c49e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190548:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9c49e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190554:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9c49e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190559:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.190563:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9c49e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190569:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9c49e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190579:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.190582:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.190586:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9c49e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190591:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66a00/0xf915a5bdf3c9c49e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190602:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190616:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c4a5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190622:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c4a5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190627:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc67600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.190630:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c4a5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190635:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c4a5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190642:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x46a4c46c (ffff9ee343a13b00) 00010000:00010000:3.0:1762166813.190644:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.190647:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c4a5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190652:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67600/0xf915a5bdf3c9c4a5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.190683:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9c497 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cb0 expref: 48 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.190692:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.190694:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166813.190697:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66400/0xf915a5bdf3c9c497 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cb0 expref: 48 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.190705:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fc66400, rc 0) 00000100:00100000:3.0:1762166813.190792:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:43770:x1847765444298368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 593us (716us total) trans 4294969020 rc 301/301 00000100:00100000:3.0:1762166813.190804:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2574 00000100:00100000:1.0:1762166813.191907:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.191979:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444298624 00000100:00100000:3.0:1762166813.191986:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444298624 00000100:00100000:3.0:1762166813.192030:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 780 00000100:00100000:3.0:1762166813.192037:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:43770:x1847765444298624:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166813.192205:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:43770:x1847765444298624:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 164us (298us total) trans 4294969021 rc 0/0 00000100:00100000:3.0:1762166813.192213:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 780 00000100:00100000:1.0:1762166813.193130:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.193172:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444298752 00000100:00100000:3.0:1762166813.193179:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444298752 00000100:00100000:3.0:1762166813.193221:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 781 00000100:00100000:3.0:1762166813.193230:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:43770:x1847765444298752:12345-192.168.203.35@tcp:33:lfs.0 00000004:00200000:3.0:1762166813.193299:0:5758:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00000004:00200000:3.0:1762166813.193304:0:5758:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:3.0:1762166813.193358:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:43770:x1847765444298752:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 129us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166813.193366:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 781 00000100:00100000:1.0:1762166813.194929:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.194975:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444298880 00000100:00100000:3.0:1762166813.194982:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444298880 00000100:00100000:3.0:1762166813.195023:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2575 00000100:00100000:3.0:1762166813.195031:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:43770:x1847765444298880:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.195048:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.195067:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9c4b3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90cb7 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.195130:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c4ba lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195160:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c4ba lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195171:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c4ba lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195185:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c4c1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195192:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195199:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195280:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c4c8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195288:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195296:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.195327:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00000004:00200000:3.0:1762166813.195331:0:20128:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166813.195362:0:20128:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195373:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c4ba lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195379:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c4ba lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195396:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c4ba lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195401:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.195405:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c4ba lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195412:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c4ba lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195424:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.195427:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.195431:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c4ba lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195437:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66200/0xf915a5bdf3c9c4ba lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195449:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195455:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c4c1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195460:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c4c1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195465:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc66600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.195467:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c4c1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195473:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c4c1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195488:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x46a4c46c (ffff9ee343a13000) 00010000:00010000:3.0:1762166813.195490:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.195493:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c4c1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195498:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3c9c4c1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.195527:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67000/0xf915a5bdf3c9c4b3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cb7 expref: 50 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.195540:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cb7 expref: 49 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.195547:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xe:0x0].0x0 (ffff9ee343a13600) 00010000:00010000:3.0:1762166813.195550:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166813.195552:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445600, rc 0) 00000100:00100000:3.0:1762166813.195605:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:43770:x1847765444298880:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 574us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166813.195612:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2575 00000100:00100000:1.0:1762166813.197518:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.197579:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444299008 00000100:00100000:3.0:1762166813.197588:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444299008 00000100:00100000:3.0:1762166813.197648:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 268 00000100:00100000:3.0:1762166813.197657:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:2361:x1847765444299008:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166813.197672:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166813.197691:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c4c8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cb7 expref: 49 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.197718:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xe:0x0].0x0 (ffff9ee343a13600) 00010000:00010000:3.0:1762166813.197722:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166813.197798:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2361:x1847765444299008:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 141us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166813.197806:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 268 00000100:00100000:1.0:1762166813.199314:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166813.199386:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444299264 00000100:00100000:0.0:1762166813.199394:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444299264 00000100:00100000:0.0:1762166813.199435:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 782 00000100:00100000:0.0:1762166813.199442:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:43770:x1847765444299264:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166813.199686:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:43770:x1847765444299264:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 244us (379us total) trans 4294969022 rc 0/0 00000100:00100000:0.0:1762166813.199691:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 782 00000100:00100000:1.0:1762166813.222120:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.222158:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444299520 00000100:00100000:3.0:1762166813.222167:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444299520 00000100:00100000:3.0:1762166813.222215:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2576 00000100:00100000:3.0:1762166813.222222:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:43778:x1847765444299520:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.222241:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.222258:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c4cf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90cbe expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.222333:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c4d6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222349:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c4d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222362:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c4d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222375:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c4dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222381:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c4dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222386:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c4dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.222520:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00010000:00010000:3.0:1762166813.222604:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c4d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222611:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c4d6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222618:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c4d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222623:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.222627:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c4d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222634:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c4d6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222644:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.222647:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.222651:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c4d6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222656:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c4d6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222666:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c4dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222672:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c4dd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222677:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c4dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222688:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.222690:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c4dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222694:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c4dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222699:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x892874e3 (ffff9ee343a13000) 00010000:00010000:3.0:1762166813.222700:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.222702:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c4dd lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222705:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c4dd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.222751:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c4cf lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cbe expref: 51 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.222783:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.222788:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166813.222792:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c4cf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cbe expref: 51 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.222803:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445600, rc 0) 00000100:00100000:3.0:1762166813.222857:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:43778:x1847765444299520:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 634us (745us total) trans 4294969023 rc 301/301 00000100:00100000:3.0:1762166813.222864:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2576 00000100:00100000:1.0:1762166813.224232:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.224281:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444299776 00000100:00100000:3.0:1762166813.224289:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444299776 00000100:00100000:3.0:1762166813.224337:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2577 00000100:00100000:3.0:1762166813.224345:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:43778:x1847765444299776:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.224362:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.224374:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c4eb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90cc5 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.224424:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c4f2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224435:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c4f2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224444:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c4f2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224455:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c4f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224462:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224467:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.224557:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00010000:00010000:3.0:1762166813.224609:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c4f2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224614:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c4f2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224617:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c4f2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224627:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.224629:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c4f2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224633:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c4f2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224640:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.224642:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.224645:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c4f2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224649:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c4f2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224655:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224658:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c4f9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224661:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c4f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224664:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.224666:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c4f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224669:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c4f9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224672:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x892874e3 (ffff9ee343a13b00) 00010000:00010000:3.0:1762166813.224674:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.224678:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c4f9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224682:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c4f9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.224705:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c4eb lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cc5 expref: 52 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.224711:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.224712:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166813.224714:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c4eb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cc5 expref: 52 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.224720:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243444800, rc 0) 00000100:00100000:3.0:1762166813.224787:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:43778:x1847765444299776:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 443us (558us total) trans 4294969024 rc 301/301 00000100:00100000:3.0:1762166813.224792:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2577 00000100:00100000:1.0:1762166813.225912:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166813.225954:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444300032 00000100:00100000:0.0:1762166813.225962:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444300032 00000100:00100000:0.0:1762166813.226017:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 783 00000100:00100000:0.0:1762166813.226026:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3719b4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:43778:x1847765444300032:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166813.226201:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3719b4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:43778:x1847765444300032:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 176us (293us total) trans 4294969025 rc 0/0 00000100:00100000:0.0:1762166813.226209:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 783 00000100:00100000:1.0:1762166813.227430:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166813.227487:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444300160 00000100:00100000:0.0:1762166813.227495:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444300160 00000100:00100000:0.0:1762166813.227535:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 784 00000100:00100000:0.0:1762166813.227544:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:43778:x1847765444300160:12345-192.168.203.35@tcp:33:lfs.0 00000004:00200000:0.0:1762166813.227618:0:5759:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00000004:00200000:0.0:1762166813.227623:0:5759:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:0.0:1762166813.227688:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:43778:x1847765444300160:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 145us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166813.227696:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 784 00000100:00100000:1.0:1762166813.228880:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.228930:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444300288 00000100:00100000:3.0:1762166813.228937:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444300288 00000100:00100000:3.0:1762166813.228977:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2578 00000100:00100000:3.0:1762166813.228985:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:43778:x1847765444300288:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.228998:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.229021:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c507 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ccc expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.229071:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c50e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229086:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c50e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229108:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c50e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229122:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c515 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229134:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c515 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229141:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c515 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229223:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c51c lrc: 3/1,0 mode: --/PR res: [0x200000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229231:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c51c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229238:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c51c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.229265:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00000004:00200000:3.0:1762166813.229268:0:20128:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166813.229283:0:20128:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c51c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229293:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c50e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229298:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c50e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229304:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c50e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229320:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.229325:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c50e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229334:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c50e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229346:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.229348:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.229352:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c50e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229357:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c50e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229369:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c515 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229373:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c515 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229378:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c515 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229382:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.229384:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c515 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229389:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c515 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229396:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x892874e3 (ffff9ee343a13e00) 00010000:00010000:3.0:1762166813.229398:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.229407:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c515 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229413:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c515 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.229448:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c507 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ccc expref: 54 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.229460:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c51c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ccc expref: 53 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.229466:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xf:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:3.0:1762166813.229468:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166813.229471:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445800, rc 0) 00000100:00100000:3.0:1762166813.229518:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:43778:x1847765444300288:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 532us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166813.229525:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2578 00000100:00100000:1.0:1762166813.232854:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166813.232926:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444300544 00000100:00100000:0.0:1762166813.232935:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444300544 00000100:00100000:0.0:1762166813.232995:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 785 00000100:00100000:0.0:1762166813.233006:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:43778:x1847765444300544:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166813.233249:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+54:43778:x1847765444300544:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 245us (402us total) trans 4294969026 rc 0/0 00000100:00100000:0.0:1762166813.233257:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 785 00000100:00100000:1.0:1762166813.251426:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.251484:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444300800 00000100:00100000:3.0:1762166813.251495:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444300800 00000100:00100000:3.0:1762166813.251550:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2579 00000100:00100000:3.0:1762166813.251559:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+54:43784:x1847765444300800:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.251596:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.251617:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c523 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90cd3 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.251758:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c52a lrc: 3/1,0 mode: --/CR res: [0x200000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.251810:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c52a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.251837:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c52a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.251849:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00010000:00010000:3.0:1762166813.251972:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c523 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cd3 expref: 57 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.251985:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c52a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cd3 expref: 56 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.251995:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xe:0x0].0x0 (ffff9ee343a13600) 00010000:00010000:3.0:1762166813.251998:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166813.252001:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445400, rc 0) 00000100:00100000:3.0:1762166813.252074:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+56:43784:x1847765444300800:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 516us (658us total) trans 4294969027 rc 0/0 00000100:00100000:3.0:1762166813.252082:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2579 00000100:00100000:1.0:1762166813.253321:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.253361:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444301056 00000100:00100000:3.0:1762166813.253367:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444301056 00000100:00100000:3.0:1762166813.253401:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2580 00000100:00100000:3.0:1762166813.253409:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+56:43784:x1847765444301056:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166813.253446:0:20128:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166813.253464:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c443 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c94 expref: 56 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.253477:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xe:0x0].0x0 (ffff9ee343a13600) 00010000:00010000:3.0:1762166813.253481:0:20128:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166813.253495:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c538 lrc: 3/0,1 mode: --/PW res: [0x200000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.253516:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c538 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.253524:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c538 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00010000:3.0:1762166813.253733:0:20128:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f3e2e529 reply state 00000000b597bd2d transno 4294969028 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c538 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:3.0:1762166813.253742:0:20128:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1762166813.253755:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00000100:00100000:3.0:1762166813.253844:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+57:43784:x1847765444301056:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 434us (525us total) trans 4294969028 rc 0/0 00000100:00100000:3.0:1762166813.253851:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2580 00010000:00010000:2.0:1762166813.255314:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c538 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166813.255327:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c538 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166813.255334:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c538 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166813.255339:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166813.255343:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c538 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166813.255350:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c538 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166813.255363:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xe:0x0].0x0 (ffff9ee343a13600) 00010000:00010000:2.0:1762166813.255366:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166813.255370:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c538 lrc: 2/0,0 mode: --/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:2.0:1762166813.255375:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c538 lrc: 0/0,0 mode: --/PW res: [0x200000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:1.0:1762166813.261334:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.261372:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444301312 00000100:00100000:3.0:1762166813.261384:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444301312 00000100:00100000:3.0:1762166813.261452:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2581 00000100:00100000:3.0:1762166813.261464:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+56:43785:x1847765444301312:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.261488:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.261507:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c53f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90cda expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.261574:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c546 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.261586:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c546 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.261595:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c546 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.261618:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c54d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.261623:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c54d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.261626:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c54d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.261788:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00010000:00010000:3.0:1762166813.261900:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c546 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.261907:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c546 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.261914:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c546 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.261925:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.261929:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c546 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.261937:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c546 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.261948:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.261951:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.261955:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c546 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.261961:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c546 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.261983:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c54d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.261988:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c54d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.261992:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c54d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.261996:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.261999:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c54d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.262006:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c54d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.262012:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x46a4c46c (ffff9ee343a13e00) 00010000:00010000:3.0:1762166813.262015:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.262017:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c54d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.262022:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c54d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.262055:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c53f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cda expref: 58 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.262065:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.262067:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166813.262070:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c53f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cda expref: 58 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.262087:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445c00, rc 0) 00000100:00100000:3.0:1762166813.262142:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+57:43785:x1847765444301312:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 682us (819us total) trans 4294969029 rc 301/301 00000100:00100000:3.0:1762166813.262147:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2581 00000100:00100000:1.0:1762166813.263446:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166813.263537:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444301568 00000100:00100000:0.0:1762166813.263545:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444301568 00000100:00100000:0.0:1762166813.263594:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 786 00000100:00100000:0.0:1762166813.263602:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+57:43785:x1847765444301568:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166813.263839:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+58:43785:x1847765444301568:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 236us (396us total) trans 4294969030 rc 0/0 00000100:00100000:0.0:1762166813.263857:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 786 00000100:00100000:1.0:1762166813.265490:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.265608:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444301824 00000100:00100000:3.0:1762166813.265621:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444301824 00000100:00100000:3.0:1762166813.265676:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2582 00000100:00100000:3.0:1762166813.265686:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+58:43785:x1847765444301824:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.265706:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.265723:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c55b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ce1 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.265810:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c562 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.265820:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c562 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.265827:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c562 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.265836:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c569 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.265841:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c569 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.265844:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c569 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.265942:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00010000:00010000:3.0:1762166813.266028:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c562 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.266034:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c562 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.266040:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c562 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.266046:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.266049:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c562 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.266056:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c562 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.266067:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.266070:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.266074:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c562 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.266080:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c562 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.266093:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c569 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.266098:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c569 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.266102:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c569 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.266113:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.266116:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c569 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.266121:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c569 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.266128:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x46a4c46c (ffff9ee343a13b00) 00010000:00010000:3.0:1762166813.266130:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.266133:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c569 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.266138:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c569 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.266172:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c55b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ce1 expref: 60 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.266182:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.266184:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166813.266188:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c55b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ce1 expref: 60 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.266197:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243444000, rc 0) 00000100:00100000:3.0:1762166813.266252:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+59:43785:x1847765444301824:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 568us (768us total) trans 4294969031 rc 301/301 00000100:00100000:3.0:1762166813.266257:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2582 00000100:00100000:1.0:1762166813.267452:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166813.267513:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444302080 00000100:00100000:0.0:1762166813.267519:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444302080 00000100:00100000:0.0:1762166813.267564:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 787 00000100:00100000:0.0:1762166813.267574:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+59:43785:x1847765444302080:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166813.267817:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+60:43785:x1847765444302080:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 243us (367us total) trans 4294969032 rc 0/0 00000100:00100000:0.0:1762166813.267826:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 787 00000100:00100000:1.0:1762166813.269046:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166813.269103:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444302208 00000100:00100000:0.0:1762166813.269110:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444302208 00000100:00100000:0.0:1762166813.269149:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 788 00000100:00100000:0.0:1762166813.269158:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3719b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+60:43785:x1847765444302208:12345-192.168.203.35@tcp:33:lfs.0 00000004:00200000:0.0:1762166813.269220:0:5759:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00000004:00200000:0.0:1762166813.269223:0:5759:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:0.0:1762166813.269272:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3719b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+60:43785:x1847765444302208:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 115us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166813.269279:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 788 00000100:00100000:1.0:1762166813.270211:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.270269:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444302336 00000100:00100000:3.0:1762166813.270275:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444302336 00000100:00100000:3.0:1762166813.270334:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2583 00000100:00100000:3.0:1762166813.270342:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+60:43785:x1847765444302336:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.270355:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.270374:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c577 lrc: 2/0,0 mode: --/CR res: [0x200000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ce8 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.270447:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c57e lrc: 3/1,0 mode: --/PR res: [0x200000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.270461:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c57e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.270471:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c57e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.270504:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00000004:00200000:3.0:1762166813.270508:0:20128:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166813.270522:0:20128:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c57e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.270540:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c577 lrc: 0/0,0 mode: --/CR res: [0x200000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ce8 expref: 62 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.270554:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c57e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ce8 expref: 61 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.270561:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xe:0x0].0x0 (ffff9ee343a13600) 00010000:00010000:3.0:1762166813.270564:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166813.270567:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243444e00, rc 0) 00000100:00100000:3.0:1762166813.270616:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+61:43785:x1847765444302336:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 274us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166813.270633:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2583 00000100:00100000:1.0:1762166813.272351:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.272391:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444302592 00000100:00100000:3.0:1762166813.272398:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444302592 00000100:00100000:3.0:1762166813.272441:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2584 00000100:00100000:3.0:1762166813.272450:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+61:43785:x1847765444302592:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.272467:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.272481:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c585 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90cef expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.272569:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c58c lrc: 3/1,0 mode: --/CR res: [0x200000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.272592:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c58c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.272601:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c58c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.272611:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00010000:00010000:3.0:1762166813.272740:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c585 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cef expref: 64 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.272751:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c58c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cef expref: 63 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.272756:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xf:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:3.0:1762166813.272759:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166813.272779:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445600, rc 0) 00000100:00100000:3.0:1762166813.272824:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+63:43785:x1847765444302592:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 376us (479us total) trans 4294969033 rc 0/0 00000100:00100000:3.0:1762166813.272852:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2584 00000100:00100000:1.0:1762166813.274084:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.274136:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444302848 00000100:00100000:3.0:1762166813.274141:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444302848 00000100:00100000:3.0:1762166813.274172:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2585 00000100:00100000:3.0:1762166813.274177:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+63:43785:x1847765444302848:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166813.274209:0:20128:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166813.274224:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c51c lrc: 0/0,0 mode: --/PR res: [0x200000404:0xf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ccc expref: 63 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.274235:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xf:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:3.0:1762166813.274237:0:20128:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166813.274250:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c59a lrc: 3/0,1 mode: --/PW res: [0x200000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.274260:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c59a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.274267:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c59a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00010000:3.0:1762166813.274441:0:20128:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b475a37c reply state 000000004a846ec6 transno 4294969034 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c59a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000100:00100000:3.0:1762166813.274450:0:20128:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1762166813.274462:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00000100:00100000:3.0:1762166813.274538:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+64:43785:x1847765444302848:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 358us (463us total) trans 4294969034 rc 0/0 00000100:00100000:3.0:1762166813.274545:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2585 00010000:00010000:0.0:1762166813.275833:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c59a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166813.275845:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c59a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166813.275851:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c59a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166813.275855:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166813.275860:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c59a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166813.275883:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c59a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166813.275895:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xf:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:0.0:1762166813.275897:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166813.275902:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c59a lrc: 2/0,0 mode: --/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166813.275908:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c59a lrc: 0/0,0 mode: --/PW res: [0x200000404:0xf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00000100:00100000:1.0:1762166813.288624:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.288699:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444303104 00000100:00100000:3.0:1762166813.288721:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444303104 00000100:00100000:3.0:1762166813.288821:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2586 00000100:00100000:3.0:1762166813.288831:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+63:43788:x1847765444303104:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.288853:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.288874:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c5a1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90cf6 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.288940:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c5a8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.288972:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c5a8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.288984:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c5a8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.288997:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c5af lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.289004:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c5af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.289010:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c5af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.289125:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00010000:00010000:3.0:1762166813.289204:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c5a8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.289212:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c5a8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.289218:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c5a8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.289234:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.289237:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c5a8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.289244:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c5a8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.289255:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.289258:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.289261:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c5a8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.289266:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c5a8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.289278:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c5af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.289282:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c5af lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.289287:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c5af lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.289291:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.289293:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c5af lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.289298:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c5af lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.289302:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x46a4c46c (ffff9ee343a13b00) 00010000:00010000:3.0:1762166813.289304:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.289312:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c5af lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.289317:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c5af lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.289354:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c5a1 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cf6 expref: 65 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.289363:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.289365:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166813.289368:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c5a1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cf6 expref: 65 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.289376:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445800, rc 0) 00000100:00100000:3.0:1762166813.289429:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+64:43788:x1847765444303104:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 600us (814us total) trans 4294969035 rc 301/301 00000100:00100000:3.0:1762166813.289438:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2586 00000100:00100000:1.0:1762166813.290979:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166813.291040:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444303360 00000100:00100000:0.0:1762166813.291048:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444303360 00000100:00100000:0.0:1762166813.291101:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 789 00000100:00100000:0.0:1762166813.291110:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+64:43788:x1847765444303360:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166813.291315:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+65:43788:x1847765444303360:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 205us (341us total) trans 4294969036 rc 0/0 00000100:00100000:0.0:1762166813.291323:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 789 00000100:00100000:1.0:1762166813.293270:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166813.293321:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444303616 00000100:00100000:3.0:1762166813.293330:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444303616 00000100:00100000:3.0:1762166813.293387:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2587 00000100:00100000:3.0:1762166813.293403:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+65:43788:x1847765444303616:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166813.293428:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166813.293458:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c5bd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90cfd expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.293530:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c5c4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293544:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c5c4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293564:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c5c4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293579:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c5cb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293586:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c5cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293592:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c5cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:3.0:1762166813.293704:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00010000:00010000:3.0:1762166813.293818:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c5c4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293824:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c5c4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293828:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c5c4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293831:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.293834:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c5c4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293839:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c5c4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293846:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.293848:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.293851:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c5c4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293866:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c5c4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293879:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c5cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293884:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c5cb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293890:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c5cb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293895:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166813.293898:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c5cb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293903:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c5cb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293911:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x46a4c46c (ffff9ee343a13e00) 00010000:00010000:3.0:1762166813.293913:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166813.293916:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c5cb lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293921:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c5cb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:3.0:1762166813.293952:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c5bd lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cfd expref: 67 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.293958:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:3.0:1762166813.293960:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166813.293968:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c5bd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cfd expref: 67 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166813.293974:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243444800, rc 0) 00000100:00100000:3.0:1762166813.294021:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+66:43788:x1847765444303616:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 625us (759us total) trans 4294969037 rc 301/301 00000100:00100000:3.0:1762166813.294028:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2587 00000100:00100000:1.0:1762166813.297334:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166813.297402:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444303872 00000100:00100000:0.0:1762166813.297412:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444303872 00000100:00100000:0.0:1762166813.297469:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 790 00000100:00100000:0.0:1762166813.297479:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+66:43788:x1847765444303872:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166813.297708:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+67:43788:x1847765444303872:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 230us (379us total) trans 4294969038 rc 0/0 00000100:00100000:0.0:1762166813.297716:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 790 00000100:00100000:1.0:1762166813.299196:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166813.299286:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444304000 00000100:00100000:0.0:1762166813.299293:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444304000 00000100:00100000:0.0:1762166813.299351:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 791 00000100:00100000:0.0:1762166813.299360:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+67:43788:x1847765444304000:12345-192.168.203.35@tcp:33:lfs.0 00000004:00200000:0.0:1762166813.299475:0:5759:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 512 00000004:00200000:0.0:1762166813.299481:0:5759:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:0.0:1762166813.299550:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+67:43788:x1847765444304000:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 187us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166813.299560:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 791 00000100:00100000:2.0:1762166813.863989:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451925120:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1762166813.863989:0:7838:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 434656223743ns, next at 435656221086ns, rc = 0 00000100:00100000:2.0:1762166813.864058:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166813.864166:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451925120 00000100:00100000:0.0:1762166813.864174:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451925120 00000100:00100000:0.0:1762166813.864259:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1762166813.864272:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765451925120:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1762166813.864289:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1762166813.864314:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1762166813.864366:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765451925120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166813.864377:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1762166813.864413:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451925120:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1762166814.056602:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166814.376055:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1762166814.376085:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451925248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762166814.376152:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166814.376221:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451925248 00000100:00100000:0.0:1762166814.376229:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451925248 00000100:00100000:0.0:1762166814.376298:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1762166814.376309:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765451925248:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1762166814.376317:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1762166814.376344:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3856662528 avail 3854565376 00000100:00100000:0.0:1762166814.376391:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765451925248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166814.376397:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1762166814.376520:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451925248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166814.452378:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166814.452450:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444304256 00000100:00100000:0.0:1762166814.452463:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444304256 00000100:00100000:0.0:1762166814.452524:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2588 00000100:00100000:0.0:1762166814.452534:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+67:44091:x1847765444304256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166814.452565:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166814.452585:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c5d9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d04 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166814.452640:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c5e0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.452649:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.452667:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.452676:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c5e7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.452680:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.452684:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:0.0:1762166814.452833:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00010000:00010000:0.0:1762166814.452932:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.452940:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c5e0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.452946:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c5e0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.452951:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166814.452955:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c5e0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.452968:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c5e0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.452980:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166814.452983:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166814.452987:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c5e0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.452994:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c5e0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.453006:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.453012:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c5e7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.453017:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c5e7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.453020:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166814.453022:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c5e7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.453025:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c5e7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.453030:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x892874e3 (ffff9ee36062bf00) 00010000:00010000:0.0:1762166814.453032:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166814.453033:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c5e7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.453037:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c5e7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.453072:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c5d9 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d04 expref: 69 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166814.453078:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166814.453080:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166814.453082:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c5d9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d04 expref: 69 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166814.453089:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687800, rc 0) 00000100:00100000:0.0:1762166814.453134:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+68:44091:x1847765444304256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 603us (772us total) trans 4294969039 rc 301/301 00000100:00100000:0.0:1762166814.453140:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2588 00000100:00100000:1.0:1762166814.454166:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166814.454208:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444304512 00000100:00100000:0.0:1762166814.454214:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444304512 00000100:00100000:0.0:1762166814.454251:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 792 00000100:00100000:0.0:1762166814.454259:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+68:44091:x1847765444304512:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166814.454409:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+69:44091:x1847765444304512:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 150us (244us total) trans 4294969040 rc 0/0 00000100:00100000:0.0:1762166814.454417:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 792 00000100:00100000:1.0:1762166814.455586:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166814.455633:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444304768 00000100:00100000:0.0:1762166814.455639:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444304768 00000100:00100000:0.0:1762166814.455677:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2589 00000100:00100000:0.0:1762166814.455685:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+69:44091:x1847765444304768:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166814.455699:0:20128:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166814.455713:0:20128:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686200/0xf915a5bdf3c9c5f5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d0b expref: -99 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166814.455824:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c5fc lrc: 3/1,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.455838:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c5fc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.455847:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c5fc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.455859:0:20128:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c603 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.455865:0:20128:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c603 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.455870:0:20128:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c603 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20128 initiator: MDT0 00000004:00200000:0.0:1762166814.455955:0:20128:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00010000:00010000:0.0:1762166814.456013:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c5fc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.456020:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c5fc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.456026:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c5fc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.456031:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166814.456034:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c5fc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.456041:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c5fc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.456056:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166814.456060:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166814.456063:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c5fc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.456069:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c5fc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.456080:0:20128:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c603 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.456086:0:20128:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c603 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.456091:0:20128:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c603 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.456096:0:20128:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166814.456098:0:20128:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c603 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.456103:0:20128:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c603 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.456110:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x892874e3 (ffff9ee36062b400) 00010000:00010000:0.0:1762166814.456112:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166814.456115:0:20128:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c603 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.456120:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c603 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20128 initiator: MDT0 00010000:00010000:0.0:1762166814.456148:0:20128:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686200/0xf915a5bdf3c9c5f5 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d0b expref: 71 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166814.456162:0:20128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee343a13c00) 00010000:00010000:0.0:1762166814.456165:0:20128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166814.456168:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686200/0xf915a5bdf3c9c5f5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d0b expref: 71 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166814.456176:0:20128:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686200, rc 0) 00000100:00100000:0.0:1762166814.456218:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+70:44091:x1847765444304768:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 534us (635us total) trans 4294969041 rc 301/301 00000100:00100000:0.0:1762166814.456225:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2589 00000100:00100000:3.0:1762166814.457121:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166814.457165:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444305024 00000100:00100000:0.0:1762166814.457171:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444305024 00000100:00100000:0.0:1762166814.457205:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 793 00000100:00100000:0.0:1762166814.457213:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+70:44091:x1847765444305024:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166814.457344:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+71:44091:x1847765444305024:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 131us (223us total) trans 4294969042 rc 0/0 00000100:00100000:0.0:1762166814.457351:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 793 00000100:00100000:1.0:1762166814.458285:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166814.458321:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444305152 00000100:00100000:0.0:1762166814.458326:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444305152 00000100:00100000:0.0:1762166814.458353:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 794 00000100:00100000:0.0:1762166814.458359:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3719b6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+71:44091:x1847765444305152:12345-192.168.203.35@tcp:33:lfs.0 00000004:00200000:0.0:1762166814.458410:0:5759:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 512 00000004:00200000:0.0:1762166814.458413:0:5759:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:0.0:1762166814.458453:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3719b6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+71:44091:x1847765444305152:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 95us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166814.458458:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 794 00010000:00010000:1.0:1762166815.081632:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1762166815.925664:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869395 is committed 00010000:00010000:0.0:1762166816.104052:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1762166816.447308:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969042 is committed 00000004:00080000:3.0:1762166816.447504:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 102 committed 00000100:00100000:1.0:1762166816.447617:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451925376:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762166816.447618:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451925504:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166816.447782:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.447807:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451925376 00000100:00100000:0.0:1762166816.447814:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451925376 00000100:00100000:0.0:1762166816.447862:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:0.0:1762166816.447871:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451925376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1762166816.447897:0:12402:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:90 count 1 00010000:00010000:0.0:1762166816.447920:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c611 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.447939:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c014 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b83 expref: 7 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166816.447948:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166816.447950:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166816.447953:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c611 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.447977:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c014 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b83 expref: 7 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166816.447990:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b83 expref: 7 pid: 6535 timeout: 537 lvb_type: 1 00000100:00100000:0.0:1762166816.448002:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765451925632:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166816.448073:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2435c1e40 going to sleep for 11 seconds 00000100:00080000:0.0:1762166816.448091:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166816.448104:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.448142:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451925504 00000100:00100000:0.0:1762166816.448146:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451925504 00000100:00100000:0.0:1762166816.448293:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:0.0:1762166816.448305:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765451925504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1762166816.448317:0:6532:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:91 count 1 00010000:00010000:0.0:1762166816.448329:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c618 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.448341:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c187 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bec expref: 7 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166816.448348:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166816.448349:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166816.448353:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c618 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.448371:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c187 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bec expref: 7 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166816.448381:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c187 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bec expref: 7 pid: 12402 timeout: 537 lvb_type: 1 00000100:00100000:0.0:1762166816.448390:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451925760:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166816.448432:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2435c1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.450008:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765451925632:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166816.450019:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166816.450034:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c611 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166816.450047:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444305280 00000100:00100000:2.0:1762166816.450053:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444305280 00000100:00100000:3.0:1762166816.450058:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166816.450092:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b83 expref: 8 pid: 6535 timeout: 537 lvb_type: 1 00000100:00100000:2.0:1762166816.450126:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444305408 00000100:00100000:2.0:1762166816.450129:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444305408 00010000:00010000:2.0:1762166816.450141:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c187 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bec expref: 9 pid: 12402 timeout: 537 lvb_type: 1 00000100:00100000:2.0:1762166816.450162:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 565 00000100:00100000:2.0:1762166816.450169:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444305280:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166816.450179:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166816.450181:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451925760:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166816.450184:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b83 expref: 9 pid: 6535 timeout: 537 lvb_type: 1 00010000:00010000:0.0:1762166816.450193:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c618 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166816.450195:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c014 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b83 expref: 9 pid: 6535 timeout: 537 lvb_type: 1 00010000:00010000:2.0:1762166816.450217:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c014 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90b83 expref: 9 pid: 6535 timeout: 537 lvb_type: 1 00010000:00010000:2.0:1762166816.450228:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166816.450230:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166816.450234:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166816.450241:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c611 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166816.450270:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166816.450271:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 566 00000100:00100000:3.0:1762166816.450284:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444305408:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166816.450295:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166816.450301:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c187 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bec expref: 8 pid: 12402 timeout: 537 lvb_type: 1 00000100:00100000:2.0:1762166816.450310:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444305280:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 139us (293us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166816.450318:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c187 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bec expref: 8 pid: 12402 timeout: 537 lvb_type: 1 00000100:00100000:2.0:1762166816.450323:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 565 00010000:00010000:3.0:1762166816.450342:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c187 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bec expref: 7 pid: 12402 timeout: 537 lvb_type: 1 00000100:00080000:2.0:1762166816.450350:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1762166816.450366:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166816.450368:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166816.450372:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166816.450380:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c618 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762166816.450386:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836721 is committed 00010000:00010000:2.0:1762166816.450415:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166816.450424:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166816.450433:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166816.450441:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c611 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166816.450462:0:12402:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166816.450549:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166816.450565:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.450574:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166816.450580:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2360:x1847765444305408:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 297us (521us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166816.450586:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166816.450594:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 566 00010000:00010000:1.0:1762166816.450601:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.450616:0:6532:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1762166816.450901:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3294:x1847765451925504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2600us (2796us total) trans 17179869397 rc 0/0 00000100:00100000:2.0:1762166816.450909:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765451925376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3040us (3148us total) trans 17179869396 rc 0/0 00000100:00100000:1.0:1762166816.450909:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:2.0:1762166816.450915:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00010000:00010000:1.0:1762166816.450934:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1762166816.450944:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869395 gen 2 00010000:00010000:1.0:1762166816.450945:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c611 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762166816.450952:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f284700, transno 17179869395 00010000:00010000:1.0:1762166816.450956:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166816.450961:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c611 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166816.450967:0:3293:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee36dce4a80 x1847765451925376/t17179869396(17179869396) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166832 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1762166816.450971:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c611 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762166816.450988:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce4a80/2, rc 0, transno 17179869396 00010000:00010000:1.0:1762166816.450994:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c611 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166816.450995:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451925376:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1762166816.451008:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c611 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.451025:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166816.451028:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.451034:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166816.451037:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.451043:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c618 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.451052:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c618 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.451063:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c618 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.451075:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166816.451077:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166816.451079:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166816.451178:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1762166816.451332:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce6300/2, rc 0, transno 17179869397 00000100:00100000:0.0:1762166816.451337:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451925504:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762166816.868282:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166816.868331:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166816.868370:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166816.868380:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444305664 00000100:00100000:1.0:1762166816.868392:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444305664 00000100:00100000:2.0:1762166816.868405:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166816.868434:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444305920 00000100:00100000:2.0:1762166816.868445:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444305920 00000100:00100000:1.0:1762166816.868460:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 228 00000100:00100000:1.0:1762166816.868473:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765444305664:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:2.0:1762166816.868484:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444305792 00000100:00100000:2.0:1762166816.868489:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444305792 00000100:00100000:2.0:1762166816.868525:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 181 00000100:00100000:2.0:1762166816.868534:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2358:x1847765444305920:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:0.0:1762166816.868549:0:5749:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444305536 00000100:00100000:0.0:1762166816.868554:0:5749:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444305536 00000100:00100000:1.0:1762166816.868560:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765444305664:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 88us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.868571:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 228 00000100:00100000:2.0:1762166816.868574:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2358:x1847765444305920:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 40us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166816.868583:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 181 00000100:00100000:0.0:1762166816.868591:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 503 00000100:00100000:0.0:1762166816.868598:0:5749:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34bd45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2359:x1847765444305536:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:2.0:1762166816.868602:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 182 00000100:00100000:2.0:1762166816.868608:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2359:x1847765444305792:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:0.0:1762166816.868625:0:5749:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34bd45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2359:x1847765444305536:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 29us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166816.868630:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2359:x1847765444305792:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 24us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166816.868632:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 503 00000100:00100000:2.0:1762166816.868636:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 182 00000100:00080000:2.0:1762166816.868656:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1762166816.868661:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166816.936024:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1847765451926016:0@lo:400:kworker.0 00000100:00100000:2.0:1762166816.936027:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451925888:0@lo:400:kworker.0 00000100:00100000:2.0:1762166816.936105:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166816.936113:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166816.936159:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1847765451926400:0@lo:400:kworker.0 00000100:00100000:2.0:1762166816.936185:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166816.936185:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451926144:0@lo:400:kworker.0 00000100:00100000:2.0:1762166816.936220:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451925888 00000100:00100000:1.0:1762166816.936225:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166816.936228:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451925888 00000100:00100000:1.0:1762166816.936264:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762166816.936273:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765451926272:0@lo:400:kworker.0 00000100:00100000:2.0:1762166816.936292:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1762166816.936302:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166816.936311:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765451925888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166816.936340:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451926144 00000100:00100000:1.0:1762166816.936344:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451926144 00000100:00100000:2.0:1762166816.936382:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765451925888:12345-0@lo:400:kworker.0 Request processed in 74us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.936384:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1762166816.936392:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451926144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166816.936396:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1762166816.936433:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451926144:12345-0@lo:400:kworker.0 Request processed in 42us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.936448:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:2.0:1762166816.936453:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166816.936476:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451926016 00000100:00100000:1.0:1762166816.936481:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451926016 00000100:00100000:2.0:1762166816.936486:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451925888:0@lo:400:kworker.0 00000100:00100000:1.0:1762166816.936515:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451926400 00000100:00100000:1.0:1762166816.936519:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451926400 00000100:00100000:2.0:1762166816.936520:0:20128:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451926272 00000100:00100000:2.0:1762166816.936526:0:20128:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451926272 00000100:00100000:1.0:1762166816.936551:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1762166816.936560:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1847765451926016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166816.936566:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1762166816.936576:0:20128:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1847765451926400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166816.936603:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1847765451926016:12345-0@lo:400:kworker.0 Request processed in 44us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.936611:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1762166816.936629:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1762166816.936630:0:20128:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1847765451926400:12345-0@lo:400:kworker.0 Request processed in 53us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.936639:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1847765451926272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166816.936641:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:2.0:1762166816.936665:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166816.936682:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1847765451926272:12345-0@lo:400:kworker.0 Request processed in 44us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166816.936692:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1847765451926400:0@lo:400:kworker.0 00000100:00100000:1.0:1762166816.936692:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1762166816.936795:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765451926272:0@lo:400:kworker.0 00000100:00100000:2.0:1762166816.936797:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1847765451926016:0@lo:400:kworker.0 00000100:00100000:1.0:1762166816.936817:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836721 gen 2 00000004:00080000:1.0:1762166816.936823:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e2bc700, transno 21474836719 00000004:00080000:1.0:1762166816.936839:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e2bea00, transno 21474836720 00000004:00080000:1.0:1762166816.936844:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e2bd500, transno 21474836721 00000100:00100000:1.0:1762166816.936850:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451926144:0@lo:400:kworker.0 00000004:00080000:2.0:1762166816.937043:0:6728:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00010000:00010000:0.0:1762166817.128164:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166818.152213:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1762166818.266030:0:29982:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 47: Verify mirror obj alloc =========== 05:46:58 (1762166818) 00000001:02000400:1.0:1762166818.870068:0:30031:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-flr test_47 needs >= 3 OSTs 00000100:00100000:2.0:1762166818.985071:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451926528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1762166818.985171:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166818.985269:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451926528 00000100:00100000:0.0:1762166818.985281:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451926528 00000100:00100000:0.0:1762166818.985370:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1762166818.985383:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765451926528:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1762166818.985402:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1762166818.985437:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1762166818.985507:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765451926528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166818.985515:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1762166818.985637:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451926528:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1762166819.175968:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166819.496069:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451926656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762166819.496152:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166819.496220:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451926656 00000100:00100000:3.0:1762166819.496229:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451926656 00000100:00080000:2.0:1762166819.496290:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166819.496312:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1762166819.496325:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451926656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1762166819.496362:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1762166819.496423:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451926656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166819.496442:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1762166819.496481:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451926656:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1762166819.550404:0:30079:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 48: Verify snapshot mirror ============ 05:46:59 (1762166819) 00000100:00100000:1.0:1762166819.588477:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166819.588588:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444306048 00000100:00100000:2.0:1762166819.588600:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444306048 00000100:00080000:3.0:1762166819.588657:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166819.588676:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2590 00000100:00100000:2.0:1762166819.588699:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:45253:x1847765444306048:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166819.588720:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166819.588740:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9c61f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d12 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.588849:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c626 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.588864:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c626 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.588876:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c626 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.588890:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c62d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.588897:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c62d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.588905:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c62d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.589016:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c626 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.589023:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c626 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.589029:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c626 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.589035:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166819.589040:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c626 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.589047:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c626 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.589069:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13700) 00010000:00010000:2.0:1762166819.589073:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166819.589078:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c626 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.589083:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15200/0xf915a5bdf3c9c626 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.589095:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c62d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.589100:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c62d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.589105:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c62d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.589110:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166819.589112:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c62d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.589117:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c62d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.589124:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee360714c00) 00010000:00010000:2.0:1762166819.589126:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166819.589128:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c62d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.589134:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9c62d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.589165:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9c61f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d12 expref: 18 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.589185:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13700) 00010000:00010000:2.0:1762166819.589188:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166819.589192:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9c61f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d12 expref: 18 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.589202:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14e00, rc 0) 00000100:00100000:2.0:1762166819.589263:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:45253:x1847765444306048:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 569us (792us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166819.589271:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2590 00000100:00100000:1.0:1762166819.592032:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166819.592095:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444306304 00000100:00100000:2.0:1762166819.592104:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444306304 00000100:00100000:2.0:1762166819.592157:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2591 00000100:00100000:2.0:1762166819.592167:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:45253:x1847765444306304:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166819.592184:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166819.592186:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1762166819.592208:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66c00/0xf915a5bdf3c9bdc1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ae2 expref: 17 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.592222:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13700) 00010000:00010000:2.0:1762166819.592231:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166819.592250:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c634 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d19 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.592363:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c63b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.592378:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c63b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.592391:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c63b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.592404:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c642 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.592411:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c642 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.592417:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c642 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.593026:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c649 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.593036:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c649 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.593044:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c649 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:2.0:1762166819.593053:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 0 00010000:00010000:2.0:1762166819.593078:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c63b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.593085:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c63b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.593091:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c63b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.593097:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166819.593101:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c63b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.593118:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c63b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.593128:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee360714d00) 00010000:00010000:2.0:1762166819.593131:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166819.593134:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c63b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.593141:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9c63b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000004:00010000:2.0:1762166819.593152:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008994ae10 reply state 000000003fe7a81d transno 4294969043 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c642 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:2.0:1762166819.593160:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166819.593182:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9c634 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d19 expref: 19 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.593195:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c649 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d19 expref: 18 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.593200:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee360714800) 00010000:00010000:2.0:1762166819.593202:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166819.593203:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14400, rc 0) 00000100:00100000:2.0:1762166819.593268:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45253:x1847765444306304:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1102us (1246us total) trans 4294969043 rc 0/0 00000100:00100000:2.0:1762166819.593275:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2591 00010000:00010000:2.0:1762166819.595093:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c642 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.595112:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c642 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.595125:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c642 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.595131:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166819.595135:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c642 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.595143:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c642 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.595158:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee360714900) 00010000:00010000:2.0:1762166819.595162:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166819.595166:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c642 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.595173:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9c642 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:2.0:1762166819.596610:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.596757:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444306560 00000100:00100000:1.0:1762166819.596800:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444306560 00000100:00100000:1.0:1762166819.596859:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2592 00000100:00100000:1.0:1762166819.596870:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:45253:x1847765444306560:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166819.596894:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166819.596919:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c657 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d20 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.597016:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c65e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.597031:0:6558:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c649 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d19 expref: 19 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.597041:0:6558:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c65e lrc: 4/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.597080:0:6558:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c649 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d19 expref: 19 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.597093:0:6558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c649 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d19 expref: 19 pid: 6558 timeout: 540 lvb_type: 0 00000100:00100000:1.0:1762166819.597108:0:6558:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451926784:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166819.597203:0:6558:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166819.600646:0:6558:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451926784:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166819.600652:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166819.600697:0:6558:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c65e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166819.600732:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444306688 00000100:00100000:0.0:1762166819.600742:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444306688 00010000:00010000:0.0:1762166819.600801:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c649 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d19 expref: 20 pid: 6558 timeout: 540 lvb_type: 0 00000100:00100000:0.0:1762166819.600855:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 567 00000100:00100000:0.0:1762166819.600866:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765444306688:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166819.600880:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166819.600886:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c649 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d19 expref: 20 pid: 6558 timeout: 540 lvb_type: 0 00010000:00010000:0.0:1762166819.600897:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c649 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d19 expref: 20 pid: 6558 timeout: 540 lvb_type: 0 00010000:00010000:0.0:1762166819.600915:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9c649 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d19 expref: 20 pid: 6558 timeout: 540 lvb_type: 0 00010000:00010000:0.0:1762166819.600932:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee360714800) 00010000:00010000:0.0:1762166819.600936:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c65e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.600944:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c65e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.600952:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c65e lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.600979:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166819.601010:0:6558:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c65e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.601020:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c65e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:1.0:1762166819.601038:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 0 00000100:00100000:0.0:1762166819.601046:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765444306688:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 180us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166819.601055:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 567 00000004:00080000:1.0:1762166819.601366:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x64:0x0], index 0: 0 00000004:00080000:1.0:1762166819.601380:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5e:0x0], index 1: 0 00010000:00010000:1.0:1762166819.601543:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c65e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.601552:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c65e lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.601566:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c65e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.601572:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166819.601576:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c65e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.601584:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c65e lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.601595:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee360714800) 00010000:00010000:1.0:1762166819.601598:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166819.601601:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c65e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.601607:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c65e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.601668:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c657 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d20 expref: 19 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.601677:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166819.601693:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166819.601698:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c657 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d20 expref: 19 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.601710:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453800, rc 0) 00000100:00100000:1.0:1762166819.601754:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:45253:x1847765444306560:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 4886us (5150us total) trans 4294969044 rc 301/301 00000100:00100000:1.0:1762166819.601954:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2592 00000100:00100000:3.0:1762166819.604089:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166819.604152:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444306944 00000100:00100000:0.0:1762166819.604168:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444306944 00000100:00100000:0.0:1762166819.604295:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 795 00000100:00100000:0.0:1762166819.604311:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:45253:x1847765444306944:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166819.604872:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45253:x1847765444306944:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 565us (787us total) trans 4294969045 rc 0/0 00000100:00100000:0.0:1762166819.604880:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 795 00000100:00100000:0.0:1762166819.606205:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166819.606241:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444307200 00000100:00100000:3.0:1762166819.606251:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444307200 00000100:00100000:3.0:1762166819.606311:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 796 00000100:00100000:3.0:1762166819.606320:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45253:x1847765444307200:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166819.606539:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:45253:x1847765444307200:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 220us (340us total) trans 4294969046 rc 0/0 00000100:00100000:3.0:1762166819.606548:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 796 00000100:00100000:3.0:1762166819.613616:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.613693:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444307328 00000100:00100000:1.0:1762166819.613708:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444307328 00000100:00100000:1.0:1762166819.613802:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2593 00000100:00100000:1.0:1762166819.613815:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:45256:x1847765444307328:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:1.0:1762166819.613843:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166819.613878:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c66c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d27 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.613946:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c673 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.613958:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.613966:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:1.0:1762166819.614032:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:1.0:1762166819.614035:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166819.614062:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.614083:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c66c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d27 expref: 22 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.614096:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c673 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d27 expref: 21 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.614104:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166819.614107:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762166819.614111:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452200, rc 0) 00000100:00100000:1.0:1762166819.614187:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:45256:x1847765444307328:12345-192.168.203.35@tcp:101:dd.0 Request processed in 375us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166819.614195:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2593 00000100:00100000:1.0:1762166819.615994:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.616037:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444307584 00000100:00100000:1.0:1762166819.616044:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444307584 00000100:00100000:1.0:1762166819.616114:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2594 00000100:00100000:1.0:1762166819.616131:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:45256:x1847765444307584:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:1.0:1762166819.616148:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166819.616152:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166819.616176:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c673 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d27 expref: 21 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.616193:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166819.616219:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166819.616239:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9c67a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d2e expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.616403:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c681 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616426:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c681 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616442:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c681 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616473:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c688 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616486:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c688 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616498:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c688 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616601:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9c68f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616610:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9c68f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616620:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9c68f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:1.0:1762166819.616630:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 0 00010000:00010000:1.0:1762166819.616759:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c681 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616797:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c681 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616810:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c681 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616818:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166819.616823:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c681 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616832:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c681 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616848:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:1.0:1762166819.616851:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166819.616857:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c681 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616863:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c681 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616887:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c688 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616894:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c688 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616900:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c688 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616907:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166819.616913:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c688 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616922:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c688 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616943:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee34ada3f00) 00010000:00010000:1.0:1762166819.616946:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166819.616950:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c688 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.616957:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c688 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.617021:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9c67a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d2e expref: 23 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.617053:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9c68f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d2e expref: 22 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.617060:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:1.0:1762166819.617063:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166819.617066:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453000, rc 0) 00000100:00100000:1.0:1762166819.617125:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45256:x1847765444307584:12345-192.168.203.35@tcp:101:dd.0 Request processed in 1001us (1137us total) trans 4294969047 rc 0/0 00000100:00100000:1.0:1762166819.617138:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2594 00000100:00100000:1.0:1762166819.618555:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.618705:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444307840 00000100:00100000:1.0:1762166819.618716:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444307840 00000100:00100000:1.0:1762166819.618805:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2595 00000100:00100000:1.0:1762166819.618818:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45256:x1847765444307840:12345-192.168.203.35@tcp:36:dd.0 00010000:00010000:1.0:1762166819.618885:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166819.618914:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453000/0xf915a5bdf3c9c68f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d2e expref: 22 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.618953:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:1.0:1762166819.618968:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166819.619315:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c69d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.619332:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c69d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.619343:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c69d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000001:00080000:0.0:1762166819.619502:0:6558:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294969048 00000004:00010000:0.0:1762166819.619535:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ed0cb5eb reply state 00000000b6871054 transno 4294969049 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c69d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166819.619546:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166819.619650:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:45256:x1847765444307840:12345-192.168.203.35@tcp:36:dd.0 Request processed in 832us (1100us total) trans 4294969049 rc 0/0 00000100:00100000:0.0:1762166819.619660:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2595 00000020:00080000:0.0:1762166819.619667:0:6558:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762166819.620660:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c69d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.620676:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c69d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.620696:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c69d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.620715:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166819.620719:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c69d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.620727:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c69d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.620741:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062bf00) 00010000:00010000:0.0:1762166819.620745:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166819.620749:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c69d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.620756:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c69d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:1.0:1762166819.621078:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166819.621214:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444307968 00000100:00100000:0.0:1762166819.621226:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444307968 00000100:00100000:0.0:1762166819.621286:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2596 00000100:00100000:0.0:1762166819.621298:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:45256:x1847765444307968:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:0.0:1762166819.621325:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166819.621344:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c6a4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d35 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166819.621402:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c6a4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d35 expref: 24 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166819.621415:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c6a4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d35 expref: 24 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166819.621434:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166819.621444:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166819.621447:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686a00, rc 0) 00000100:00100000:0.0:1762166819.621510:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:45256:x1847765444307968:12345-192.168.203.35@tcp:101:dd.0 Request processed in 214us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166819.621518:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2596 00000100:00100000:3.0:1762166819.622923:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166819.622987:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444308224 00000100:00100000:0.0:1762166819.622998:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444308224 00000100:00100000:0.0:1762166819.623061:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2597 00000100:00100000:0.0:1762166819.623075:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:45256:x1847765444308224:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:0.0:1762166819.623093:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166819.623096:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762166819.623123:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c6a4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d35 expref: 24 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166819.623137:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166819.623148:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166819.623160:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c6ab lrc: 2/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d3c expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166819.623213:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c6b2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.623225:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c6b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.623234:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c6b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000040:00080000:0.0:1762166819.623802:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].120, 88 off17808 00000004:00080000:0.0:1762166819.623818:0:6558:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440416054278ns, next at 431048225210ns, rc = 0 00000040:00080000:0.0:1762166819.623924:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].117, 88 off17528 00000004:00080000:0.0:1762166819.623937:0:6558:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440416173895ns, next at 435656221086ns, rc = 0 00010000:00010000:0.0:1762166819.641376:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c6b2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d3c expref: 26 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166819.641393:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b800) 00010000:00010000:0.0:1762166819.641396:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1762166819.641415:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c6ab lrc: 0/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d3c expref: 26 pid: 6558 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1762166819.641435:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c6b2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d3c expref: 25 pid: 6558 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762166819.641452:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969050 is committed 00000004:00080000:1.0:1762166819.641459:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 103 committed 00010000:00010000:0.0:1762166819.641465:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b800) 00010000:00010000:0.0:1762166819.641470:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1762166819.641472:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687c00, rc 0) 00000004:00080000:1.0:1762166819.641486:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 105 committed 00000100:00100000:0.0:1762166819.641544:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:45256:x1847765444308224:12345-192.168.203.35@tcp:101:dd.0 Request processed in 18472us (18624us total) trans 4294969050 rc 0/0 00000100:00100000:0.0:1762166819.641553:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2597 00000100:00100000:3.0:1762166819.641601:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451926912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166819.641658:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166819.641733:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1762166819.641744:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451927040:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166819.641795:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166819.641835:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451926912 00000100:00100000:0.0:1762166819.641844:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451926912 00000100:00100000:0.0:1762166819.641894:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451927040 00000100:00100000:0.0:1762166819.641898:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451927040 00000100:00100000:0.0:1762166819.641927:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:0.0:1762166819.641937:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1847765451926912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166819.641955:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:2.0:1762166819.641968:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765451927040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166819.642238:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765451927040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 273us (441us total) trans 17179869398 rc 0/0 00000100:00100000:2.0:1762166819.642246:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:0.0:1762166819.642254:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765451926912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 317us (596us total) trans 21474836722 rc 0/0 00000100:00100000:0.0:1762166819.642263:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000004:00080000:0.0:1762166819.642318:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b0000/2, rc 0, transno 21474836722 00000100:00100000:0.0:1762166819.642325:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451926912:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762166819.642332:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f284700/2, rc 0, transno 17179869398 00000100:00100000:1.0:1762166819.642340:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451927040:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166819.644247:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166819.644345:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444308352 00000100:00100000:3.0:1762166819.644353:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444308352 00000100:00100000:3.0:1762166819.644410:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 909 00000100:00100000:3.0:1762166819.644419:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:45256:x1847765444308352:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166819.644432:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166819.644453:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c6b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d43 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1762166819.644460:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1762166819.644478:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166819.644499:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166819.644501:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166819.644525:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c6b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d43 expref: 7 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.644549:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c6b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d43 expref: 7 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.644562:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243444800, rc 0) 00000100:00100000:3.0:1762166819.644614:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:45256:x1847765444308352:12345-192.168.203.35@tcp:101:dd.0 Request processed in 195us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166819.644621:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 909 00000100:00100000:1.0:1762166819.646588:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166819.646709:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444308480 00000100:00100000:0.0:1762166819.646717:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444308480 00002000:00010000:0.0:1762166819.646752:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/100 (0->18446744073709551615) 00002000:00100000:0.0:1762166819.646757:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34371b800 with x1847765444308480 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166819.646808:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee34371b800. 00000100:00100000:0.0:1762166819.646865:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 932 00000100:00100000:0.0:1762166819.646879:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2359:x1847765444308480:12345-192.168.203.35@tcp:10:dd.0 00002000:00010000:0.0:1762166819.647152:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166819.647155:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb mtime from disk: 0 -> 1762166819 00002000:00010000:0.0:1762166819.647158:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166819.647160:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb ctime from disk: 0 -> 1762166819 00002000:00010000:0.0:1762166819.647162:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166819.647217:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2359:x1847765444308480:12345-192.168.203.35@tcp:10:dd.0 Request processed in 343us (635us total) trans 21474836723 rc 0/0 00000100:00100000:0.0:1762166819.647225:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 932 00002000:00010000:0.0:1762166819.647229:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/100 (0->18446744073709551615) 00002000:00100000:0.0:1762166819.647232:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34371b800 with x1847765444308480 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166819.647236:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee34371b800. 00000100:00100000:0.0:1762166819.669608:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166819.669818:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444308608 00000100:00100000:2.0:1762166819.669843:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444308608 00002000:00100000:2.0:1762166819.669893:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x64:0x0] (0->1048575) req@ffff9ee36dce4380 x1847765444308608/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:605/0 lens 488/0 e 0 to 0 dl 1762166830 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166819.669905:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce4380 with x1847765444308608 ext(0->1048575) 00002000:00010000:2.0:1762166819.669911:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dce4380 00000100:00100000:2.0:1762166819.669954:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 933 00000100:00100000:2.0:1762166819.669964:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444308608:12345-192.168.203.35@tcp:4:dd.0 00000100:00100000:2.0:1762166819.680602:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2360:x1847765444308608:12345-192.168.203.35@tcp:4:dd.0 Request processed in 10628us (10991us total) trans 21474836724 rc 0/0 00000100:00100000:2.0:1762166819.680616:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 933 00002000:00100000:2.0:1762166819.680628:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x64:0x0] (0->1048575) req@ffff9ee36dce4380 x1847765444308608/t21474836724(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:605/0 lens 488/448 e 0 to 0 dl 1762166830 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166819.680638:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce4380 with x1847765444308608 ext(0->1048575) 00002000:00010000:2.0:1762166819.680644:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dce4380 00000100:00100000:3.0:1762166819.690408:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166819.690753:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444308736 00000100:00100000:2.0:1762166819.690787:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444308736 00002000:00100000:2.0:1762166819.690841:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x64:0x0] (1048576->2097151) req@ffff9ee36e3b2680 x1847765444308736/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:605/0 lens 488/0 e 0 to 0 dl 1762166830 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166819.690851:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b2680 with x1847765444308736 ext(1048576->2097151) 00002000:00010000:2.0:1762166819.690856:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b2680 00000100:00100000:2.0:1762166819.690891:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 934 00000100:00100000:2.0:1762166819.690901:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444308736:12345-192.168.203.35@tcp:4:dd.0 00000100:00100000:0.0:1762166819.697060:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444308736:12345-192.168.203.35@tcp:4:dd.0 Request processed in 6145us (6647us total) trans 21474836725 rc 0/0 00000100:00100000:0.0:1762166819.697079:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 934 00002000:00100000:0.0:1762166819.697094:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x64:0x0] (1048576->2097151) req@ffff9ee36e3b2680 x1847765444308736/t21474836725(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:605/0 lens 488/448 e 0 to 0 dl 1762166830 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166819.697125:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b2680 with x1847765444308736 ext(1048576->2097151) 00002000:00010000:0.0:1762166819.697132:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b2680 00000100:00100000:0.0:1762166819.704955:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.705134:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444308992 00000100:00100000:1.0:1762166819.705150:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444308992 00000100:00100000:1.0:1762166819.705222:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2598 00000100:00100000:1.0:1762166819.705235:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:45256:x1847765444308992:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:1.0:1762166819.705265:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166819.705269:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166819.705302:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c6b2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d3c expref: 17 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.705324:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b800) 00010000:00010000:1.0:1762166819.705339:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166819.705355:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c6c0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d4a expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.705417:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c6c7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.705447:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c6c7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.705457:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c6c7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00080000:1.0:1762166819.705962:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x65:0x0], index 0: 0 00000040:00080000:1.0:1762166819.706103:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].121, 88 off17896 00000004:00080000:1.0:1762166819.706112:0:6558:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440498348782ns, next at 431048225210ns, rc = 0 00000040:00080000:1.0:1762166819.706155:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].122, 88 off17984 00000004:00080000:1.0:1762166819.706160:0:6558:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440498397130ns, next at 431048225210ns, rc = 0 00000040:00080000:1.0:1762166819.706208:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].118, 88 off17616 00000004:00080000:1.0:1762166819.706213:0:6558:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440498450457ns, next at 435656221086ns, rc = 0 00000001:00080000:1.0:1762166819.725622:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969051 is committed 00000004:00080000:1.0:1762166819.725640:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 104 committed 00000004:00080000:1.0:1762166819.725659:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 107 committed 00000004:00080000:1.0:1762166819.725670:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 106 committed 00010000:00010000:2.0:1762166819.725794:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c6c7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d4a expref: 18 pid: 6558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166819.725827:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451927424:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762166819.725829:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:2.0:1762166819.725840:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1762166819.725861:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c6c0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d4a expref: 18 pid: 6558 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1762166819.725866:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451927168:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1762166819.725882:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c6c7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d4a expref: 17 pid: 6558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166819.725906:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166819.725917:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:2.0:1762166819.725920:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1762166819.725923:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453800, rc 0) 00000100:00100000:1.0:1762166819.725940:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166819.725964:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451927424 00000100:00100000:3.0:1762166819.725973:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451927424 00000100:00100000:0.0:1762166819.725976:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1762166819.725978:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:45256:x1847765444308992:12345-192.168.203.35@tcp:101:dd.0 Request processed in 20743us (21037us total) trans 4294969051 rc 0/0 00000100:00100000:0.0:1762166819.725985:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451927296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166819.725988:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2598 00000100:00100000:1.0:1762166819.725989:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451927168 00000100:00100000:1.0:1762166819.725995:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451927168 00000100:00100000:0.0:1762166819.726015:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166819.726032:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451927296 00000100:00100000:3.0:1762166819.726037:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451927296 00000100:00100000:1.0:1762166819.726048:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:1.0:1762166819.726060:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3294:x1847765451927424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166819.726070:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:3.0:1762166819.726083:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765451927168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166819.726083:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:0.0:1762166819.726094:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3294:x1847765451927296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166819.726321:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765451927424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 263us (414us total) trans 17179869399 rc 0/0 00000100:00100000:1.0:1762166819.726330:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00002000:00010000:3.0:1762166819.726346:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1762166819.726351:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb mtime from disk: 1762166819 -> 1762166819 00002000:00010000:3.0:1762166819.726354:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166819.726357:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb ctime from disk: 1762166819 -> 1762166819 00002000:00010000:3.0:1762166819.726360:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:2.0:1762166819.726371:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b2300/2, rc 0, transno 17179869399 00000100:00100000:0.0:1762166819.726374:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765451927296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 281us (359us total) trans 21474836727 rc 0/0 00000100:00100000:2.0:1762166819.726378:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451927424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166819.726381:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000004:00080000:2.0:1762166819.726392:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce6d80/2, rc 0, transno 21474836727 00000100:00100000:2.0:1762166819.726396:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451927296:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166819.726412:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765451927168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 333us (472us total) trans 21474836726 rc 0/0 00000100:00100000:3.0:1762166819.726420:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000004:00080000:1.0:1762166819.726496:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce4000/2, rc 0, transno 21474836726 00000100:00100000:1.0:1762166819.726501:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451927168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166819.730831:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166819.730912:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444309120 00000100:00100000:3.0:1762166819.730935:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444309120 00000100:00100000:3.0:1762166819.730998:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 913 00000100:00100000:3.0:1762166819.731024:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:45256:x1847765444309120:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166819.731043:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166819.731064:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c6ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d51 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166819.731088:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166819.731111:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166819.731114:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166819.731126:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c6ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d51 expref: 13 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.731142:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c6ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d51 expref: 13 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.731155:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445a00, rc 0) 00000100:00100000:3.0:1762166819.731215:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:45256:x1847765444309120:12345-192.168.203.35@tcp:101:dd.0 Request processed in 194us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166819.731222:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 913 00000100:00100000:2.0:1762166819.742335:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166819.742374:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166819.742396:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444309248 00000100:00100000:0.0:1762166819.742407:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444309248 00000100:00100000:1.0:1762166819.742458:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444309504 00002000:00100000:0.0:1762166819.742459:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x65:0x0] (2097152->3145727) req@ffff9ee36f285f80 x1847765444309248/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:605/0 lens 488/0 e 0 to 0 dl 1762166830 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1762166819.742462:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444309504 00002000:00100000:0.0:1762166819.742470:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f285f80 with x1847765444309248 ext(2097152->3145727) 00002000:00010000:0.0:1762166819.742475:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f285f80 00000100:00100000:1.0:1762166819.742509:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 797 00000100:00100000:0.0:1762166819.742509:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 935 00000100:00100000:0.0:1762166819.742518:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444309248:12345-192.168.203.35@tcp:4:dd.0 00000100:00100000:1.0:1762166819.742519:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:45256:x1847765444309504:12345-192.168.203.35@tcp:35:dd.0 00000001:00080000:1.0:1762166819.742893:0:5758:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294969052 00000100:00100000:1.0:1762166819.743015:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45256:x1847765444309504:12345-192.168.203.35@tcp:35:dd.0 Request processed in 496us (639us total) trans 4294969053 rc 0/0 00000100:00100000:1.0:1762166819.743023:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 797 00000020:00080000:1.0:1762166819.743030:0:5758:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166819.749896:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765444309248:12345-192.168.203.35@tcp:4:dd.0 Request processed in 7367us (7562us total) trans 21474836728 rc 0/0 00000100:00100000:0.0:1762166819.749922:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 935 00002000:00100000:0.0:1762166819.749940:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x65:0x0] (2097152->3145727) req@ffff9ee36f285f80 x1847765444309248/t21474836728(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:605/0 lens 488/448 e 0 to 0 dl 1762166830 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166819.749951:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f285f80 with x1847765444309248 ext(2097152->3145727) 00002000:00010000:0.0:1762166819.749958:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f285f80 00000100:00100000:2.0:1762166819.756189:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.756323:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444309632 00000100:00100000:1.0:1762166819.756334:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444309632 00000100:00100000:1.0:1762166819.756401:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2599 00000100:00100000:1.0:1762166819.756412:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45258:x1847765444309632:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166819.756437:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166819.756460:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c6d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d58 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.756526:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9c6dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.756541:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9c6dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.756554:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9c6dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:1.0:1762166819.756620:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:1.0:1762166819.756623:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166819.756697:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9c6dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.756723:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c6d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d58 expref: 21 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.756745:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9c6dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d58 expref: 20 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.756754:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:1.0:1762166819.756756:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762166819.756759:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350453e00, rc 0) 00000100:00100000:1.0:1762166819.756888:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:45258:x1847765444309632:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 478us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166819.756895:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2599 00000100:00100000:3.0:1762166819.758902:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.758982:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444309888 00000100:00100000:1.0:1762166819.758989:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444309888 00000100:00100000:1.0:1762166819.759036:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2600 00000100:00100000:1.0:1762166819.759044:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:45258:x1847765444309888:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166819.759060:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166819.759075:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9c6e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d5f expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.759143:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9c6ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759155:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9c6ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759165:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9c6ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759191:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c6f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759198:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759205:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759324:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9c6ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759331:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9c6ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759338:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9c6ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759344:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166819.759347:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9c6ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759354:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9c6ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759365:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:1.0:1762166819.759368:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166819.759373:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9c6ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759379:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9c6ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759391:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759403:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c6f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759409:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c6f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759414:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166819.759417:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c6f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759423:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c6f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759431:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee34ada3700) 00010000:00010000:1.0:1762166819.759433:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166819.759436:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c6f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759441:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c6f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.759473:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9c6e3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d5f expref: 21 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.759483:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:1.0:1762166819.759485:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166819.759494:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9c6e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d5f expref: 21 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.759503:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452a00, rc 0) 00000100:00100000:1.0:1762166819.759557:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:45258:x1847765444309888:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 514us (660us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166819.759567:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2600 00000100:00100000:2.0:1762166819.761453:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.761554:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444310016 00000100:00100000:1.0:1762166819.761566:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444310016 00000100:00100000:1.0:1762166819.761637:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2601 00000100:00100000:1.0:1762166819.761648:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:45258:x1847765444310016:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:1.0:1762166819.761744:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c6f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.761815:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c6f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.761834:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c6f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.761853:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c6ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.761860:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c6ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.761867:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c6ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762007:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c706 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762016:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c706 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762024:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c706 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:1.0:1762166819.762067:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145729 00000004:00200000:1.0:1762166819.762091:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166819.762105:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c706 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762116:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c6f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762122:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c6f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762129:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c6f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762135:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166819.762139:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c6f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762148:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c6f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762160:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:1.0:1762166819.762164:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166819.762169:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c6f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762175:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c6f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762187:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c6ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762193:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c6ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762198:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c6ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762210:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166819.762214:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c6ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762220:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c6ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762228:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166819.762230:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166819.762233:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c6ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762239:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c6ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762253:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c706 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762257:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c706 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762260:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c706 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762263:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166819.762265:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c706 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762268:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c706 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762271:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:1.0:1762166819.762273:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166819.762280:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c706 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.762284:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c706 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:1.0:1762166819.762376:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:45258:x1847765444310016:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 729us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166819.762385:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2601 00000100:00100000:2.0:1762166819.772128:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.772277:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444310272 00000100:00100000:1.0:1762166819.772298:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444310272 00000100:00100000:1.0:1762166819.772386:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2602 00000100:00100000:1.0:1762166819.772399:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:45261:x1847765444310272:12345-192.168.203.35@tcp:101:bash.0 00010000:00010000:1.0:1762166819.772431:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166819.772469:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c70d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d66 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.772588:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c714 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.772606:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.772622:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.772638:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c71b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.772646:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c71b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.772654:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c71b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.772911:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9c722 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.772920:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9c722 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.772928:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9c722 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:1.0:1762166819.772950:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145729 00010000:00010000:1.0:1762166819.773111:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.773119:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c714 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.773134:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c714 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.773142:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166819.773148:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c714 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.773157:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c714 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.773174:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:1.0:1762166819.773177:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166819.773182:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c714 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.773189:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c714 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.773224:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c71b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.773231:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c71b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.773237:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c71b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.773242:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166819.773245:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c71b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.773251:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c71b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.773259:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166819.773262:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166819.773265:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c71b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.773271:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c71b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.773324:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c70d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d66 expref: 23 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.773341:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9c722 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d66 expref: 22 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.773349:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:1.0:1762166819.773357:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166819.773361:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452a00, rc 0) 00000100:00100000:1.0:1762166819.773459:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45261:x1847765444310272:12345-192.168.203.35@tcp:101:bash.0 Request processed in 1062us (1343us total) trans 4294969054 rc 0/0 00000100:00100000:1.0:1762166819.773468:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2602 00000100:00100000:3.0:1762166819.782118:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166819.782286:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444310400 00000100:00100000:0.0:1762166819.782308:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444310400 00002000:00100000:0.0:1762166819.782380:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x64:0x0] (0->32767) req@ffff9ee242ce8a80 x1847765444310400/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:605/0 lens 488/0 e 0 to 0 dl 1762166830 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166819.782803:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242ce8a80 with x1847765444310400 ext(0->32767) 00002000:00010000:0.0:1762166819.782811:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242ce8a80 00000100:00100000:0.0:1762166819.782861:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 936 00000100:00100000:0.0:1762166819.782872:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2358:x1847765444310400:12345-192.168.203.35@tcp:3:md5sum.0 00000100:00100000:0.0:1762166819.784610:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2358:x1847765444310400:12345-192.168.203.35@tcp:3:md5sum.0 Request processed in 1732us (2506us total) trans 0 rc 32768/32768 00000100:00100000:0.0:1762166819.784621:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 936 00002000:00100000:0.0:1762166819.784629:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x64:0x0] (0->32767) req@ffff9ee242ce8a80 x1847765444310400/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:605/0 lens 488/440 e 0 to 0 dl 1762166830 ref 1 fl Complete:/600/0 rc 32768/32768 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166819.784638:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242ce8a80 with x1847765444310400 ext(0->32767) 00002000:00010000:0.0:1762166819.784644:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242ce8a80 00000100:00100000:2.0:1762166819.791608:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166819.791651:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166819.791674:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444310528 00000100:00100000:0.0:1762166819.791698:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444310528 00002000:00100000:0.0:1762166819.791756:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x64:0x0] (32768->1081343) req@ffff9ee34317ca80 x1847765444310528/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:605/0 lens 488/0 e 0 to 0 dl 1762166830 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166819.791815:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34317ca80 with x1847765444310528 ext(32768->1081343) 00002000:00010000:0.0:1762166819.791822:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee34317ca80 00000100:00100000:0.0:1762166819.791854:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444310656 00000100:00100000:0.0:1762166819.791858:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444310656 00002000:00100000:0.0:1762166819.791876:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x64:0x0] (1081344->2097151) req@ffff9ee34317f800 x1847765444310656/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:605/0 lens 488/0 e 0 to 0 dl 1762166830 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166819.791884:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34317f800 with x1847765444310656 ext(1081344->2097151) 00002000:00010000:0.0:1762166819.791888:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee34317f800 00000100:00100000:0.0:1762166819.791917:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 937 00000100:00100000:0.0:1762166819.791942:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444310528:12345-192.168.203.35@tcp:3:md5sum.0 00000100:00100000:1.0:1762166819.791961:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 938 00000100:00100000:1.0:1762166819.791990:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444310656:12345-192.168.203.35@tcp:3:md5sum.0 00000100:00100000:3.0:1762166819.802880:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444310528:12345-192.168.203.35@tcp:3:md5sum.0 Request processed in 10942us (11271us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1762166819.802894:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 937 00002000:00100000:3.0:1762166819.802905:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x64:0x0] (32768->1081343) req@ffff9ee34317ca80 x1847765444310528/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:605/0 lens 488/440 e 0 to 0 dl 1762166830 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166819.802913:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34317ca80 with x1847765444310528 ext(32768->1081343) 00002000:00010000:3.0:1762166819.802924:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee34317ca80 00000100:00100000:3.0:1762166819.803225:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765444310656:12345-192.168.203.35@tcp:3:md5sum.0 Request processed in 11250us (11573us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1762166819.803234:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 938 00002000:00100000:3.0:1762166819.803241:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x64:0x0] (1081344->2097151) req@ffff9ee34317f800 x1847765444310656/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:605/0 lens 488/440 e 0 to 0 dl 1762166830 ref 1 fl Complete:/600/0 rc 1015808/1015808 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166819.803250:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34317f800 with x1847765444310656 ext(1081344->2097151) 00002000:00010000:3.0:1762166819.803254:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee34317f800 00000100:00100000:2.0:1762166819.816234:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.816303:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444310912 00000100:00100000:1.0:1762166819.816314:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444310912 00000100:00100000:1.0:1762166819.816368:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 798 00000100:00100000:1.0:1762166819.816382:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45261:x1847765444310912:12345-192.168.203.35@tcp:35:md5sum.0 00000100:00100000:1.0:1762166819.816726:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:45261:x1847765444310912:12345-192.168.203.35@tcp:35:md5sum.0 Request processed in 347us (502us total) trans 4294969055 rc 0/0 00000100:00100000:1.0:1762166819.816733:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 798 00000100:00100000:2.0:1762166819.826962:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.827199:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444311168 00000100:00100000:1.0:1762166819.827209:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444311168 00000100:00100000:1.0:1762166819.827271:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2603 00000100:00100000:1.0:1762166819.827282:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:45262:x1847765444311168:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166819.827309:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166819.827329:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c730 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d6d expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.827429:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c737 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.827444:0:6558:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9c722 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d66 expref: 24 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.827468:0:6558:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c737 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.827500:0:6558:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9c722 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d66 expref: 24 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.827513:0:6558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9c722 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d66 expref: 24 pid: 6558 timeout: 540 lvb_type: 0 00000100:00100000:1.0:1762166819.827530:0:6558:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451927552:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166819.827629:0:6558:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166819.829232:0:6558:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451927552:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166819.829258:0:6558:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c737 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:2.0:1762166819.829641:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166819.829727:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444311296 00000100:00100000:0.0:1762166819.829734:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444311296 00010000:00010000:0.0:1762166819.829799:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9c722 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d66 expref: 25 pid: 6558 timeout: 540 lvb_type: 0 00000100:00100000:0.0:1762166819.829837:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 568 00000100:00100000:0.0:1762166819.829847:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765444311296:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166819.829862:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166819.829869:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9c722 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d66 expref: 25 pid: 6558 timeout: 540 lvb_type: 0 00010000:00010000:0.0:1762166819.829881:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9c722 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d66 expref: 25 pid: 6558 timeout: 540 lvb_type: 0 00010000:00010000:0.0:1762166819.829900:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452a00/0xf915a5bdf3c9c722 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d66 expref: 25 pid: 6558 timeout: 540 lvb_type: 0 00010000:00010000:0.0:1762166819.829932:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:0.0:1762166819.829936:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c737 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.829946:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c737 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.829954:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c737 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.829983:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166819.830009:0:6558:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c737 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.830018:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c737 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:1.0:1762166819.830034:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145729 00000100:00100000:0.0:1762166819.830040:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444311296:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 191us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166819.830051:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 568 00010000:00010000:1.0:1762166819.830183:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c730 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d6d expref: 25 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.830197:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c737 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d6d expref: 24 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.830205:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:1.0:1762166819.830215:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166819.830218:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452200, rc 0) 00000100:00100000:1.0:1762166819.830255:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:45262:x1847765444311168:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2975us (3302us total) trans 4294969056 rc 0/0 00000100:00100000:1.0:1762166819.830264:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2603 00000100:00100000:2.0:1762166819.832235:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.832319:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444311424 00000100:00100000:1.0:1762166819.832325:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444311424 00000100:00100000:1.0:1762166819.832372:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2604 00000100:00100000:1.0:1762166819.832382:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:45262:x1847765444311424:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166819.832405:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166819.832422:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c745 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d74 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.832501:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c74c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.832519:0:6558:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c737 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d6d expref: 25 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.832527:0:6558:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c74c lrc: 4/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.832556:0:6558:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c737 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d6d expref: 25 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.832567:0:6558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c737 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d6d expref: 25 pid: 6558 timeout: 540 lvb_type: 0 00000100:00100000:1.0:1762166819.832576:0:6558:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451927680:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166819.832636:0:6558:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166819.833641:0:6558:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451927680:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166819.833660:0:6558:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c74c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:2.0:1762166819.833854:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166819.833929:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444311552 00000100:00100000:0.0:1762166819.833935:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444311552 00010000:00010000:0.0:1762166819.833971:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c737 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d6d expref: 26 pid: 6558 timeout: 540 lvb_type: 0 00000100:00100000:0.0:1762166819.834002:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 569 00000100:00100000:0.0:1762166819.834011:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444311552:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166819.834022:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166819.834028:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c737 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d6d expref: 26 pid: 6558 timeout: 540 lvb_type: 0 00010000:00010000:0.0:1762166819.834038:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c737 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d6d expref: 26 pid: 6558 timeout: 540 lvb_type: 0 00010000:00010000:0.0:1762166819.834069:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452200/0xf915a5bdf3c9c737 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d6d expref: 26 pid: 6558 timeout: 540 lvb_type: 0 00010000:00010000:0.0:1762166819.834083:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:0.0:1762166819.834087:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c74c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.834096:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c74c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.834103:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c74c lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166819.834129:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166819.834160:0:6558:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c74c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166819.834167:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765444311552:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 155us (312us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166819.834173:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c74c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166819.834180:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 569 00000004:00200000:2.0:1762166819.834214:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145729 00000004:00200000:2.0:1762166819.834219:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166819.834238:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c74c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.834277:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452c00/0xf915a5bdf3c9c745 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d74 expref: 25 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.834291:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c74c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d74 expref: 24 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.834299:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:2.0:1762166819.834302:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166819.834304:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452e00, rc 0) 00000100:00100000:2.0:1762166819.834346:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:45262:x1847765444311424:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1966us (2117us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166819.834353:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2604 00000100:00100000:2.0:1762166819.836153:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.836265:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444311808 00000100:00100000:1.0:1762166819.836283:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444311808 00000100:00100000:1.0:1762166819.836375:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2605 00000100:00100000:1.0:1762166819.836395:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:45262:x1847765444311808:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166819.836422:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166819.836446:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c753 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d7b expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.836575:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9c75a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.836592:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9c75a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.836603:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9c75a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:1.0:1762166819.836617:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145729 00010000:00010000:1.0:1762166819.836854:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453400/0xf915a5bdf3c9c753 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d7b expref: 27 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.836875:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9c75a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d7b expref: 26 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.836884:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:1.0:1762166819.836905:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166819.836910:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452400, rc 0) 00000100:00100000:1.0:1762166819.837005:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:45262:x1847765444311808:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 614us (856us total) trans 4294969057 rc 0/0 00000100:00100000:1.0:1762166819.837013:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2605 00000100:00100000:0.0:1762166819.838797:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166819.838841:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.838913:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444311936 00000100:00100000:3.0:1762166819.838914:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444312064 00000100:00100000:1.0:1762166819.838922:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444311936 00000100:00100000:3.0:1762166819.838923:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444312064 00000100:00100000:1.0:1762166819.838973:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 914 00000100:00100000:1.0:1762166819.838982:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444311936:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:3.0:1762166819.838993:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 915 00000100:00100000:3.0:1762166819.839005:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444312064:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762166819.839020:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c768 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.839028:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c76f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.839039:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c6b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d43 expref: 16 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.839052:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166819.839054:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166819.839057:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c768 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.839066:0:6535:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c6ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d51 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.839075:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166819.839076:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166819.839080:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c76f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.839087:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c6b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000080000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d43 expref: 16 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.839098:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c6b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d43 expref: 16 pid: 6532 timeout: 540 lvb_type: 0 00010000:00010000:3.0:1762166819.839106:0:6535:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c6ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d51 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166819.839111:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451927808:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166819.839124:0:6535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c6ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d51 expref: 16 pid: 6535 timeout: 540 lvb_type: 0 00000100:00100000:3.0:1762166819.839150:0:6535:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ce9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765451927936:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166819.839185:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166819.839189:0:6535:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242543f00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166819.840518:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451927808:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166819.840519:0:6535:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ce9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765451927936:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166819.840543:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c768 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.840549:0:6535:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c76f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166819.844908:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.844975:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444312192 00000100:00100000:1.0:1762166819.844993:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444312192 00010000:00010000:1.0:1762166819.845049:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c6ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d51 expref: 17 pid: 6535 timeout: 540 lvb_type: 0 00000100:00100000:1.0:1762166819.845269:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 570 00000100:00100000:1.0:1762166819.845285:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444312192:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166819.845305:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1762166819.845344:0:29775:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:1.0:1762166819.845348:0:29775:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb mtime from disk: 0 -> 1762166820 00002000:00010000:1.0:1762166819.845350:0:29775:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb ctime from disk: 0 -> 1762166820 00010000:00010000:1.0:1762166819.845358:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c6ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d51 expref: 17 pid: 6535 timeout: 540 lvb_type: 0 00010000:00010000:1.0:1762166819.845373:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c6ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d51 expref: 17 pid: 6535 timeout: 540 lvb_type: 0 00010000:00010000:1.0:1762166819.845403:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c6ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d51 expref: 17 pid: 6535 timeout: 540 lvb_type: 0 00010000:00010000:1.0:1762166819.845420:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166819.845422:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166819.845428:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c76f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.845454:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c76f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.845486:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166819.845527:0:6535:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c76f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.845540:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c76f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166819.845555:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444312192:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 275us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166819.845565:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 570 00010000:00010000:2.0:1762166819.845568:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c76f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.845578:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c76f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.845586:0:6535:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c76f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.845593:0:6535:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166819.845597:0:6535:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c76f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.845605:0:6535:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c76f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.845618:0:6535:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c76f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.845636:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c76f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166819.845701:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765444312064:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 6697us (6858us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166819.845710:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 915 00000100:00100000:3.0:1762166819.845948:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.846017:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444312320 00000100:00100000:1.0:1762166819.846025:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444312320 00010000:00010000:1.0:1762166819.846048:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c6b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d43 expref: 15 pid: 6532 timeout: 540 lvb_type: 0 00000100:00100000:1.0:1762166819.846081:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 571 00000100:00100000:1.0:1762166819.846087:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242cea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444312320:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166819.846095:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166819.846104:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c6b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d43 expref: 15 pid: 6532 timeout: 540 lvb_type: 0 00010000:00010000:1.0:1762166819.846115:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c6b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d43 expref: 15 pid: 6532 timeout: 540 lvb_type: 0 00010000:00010000:1.0:1762166819.846130:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c6b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d43 expref: 15 pid: 6532 timeout: 540 lvb_type: 0 00010000:00010000:1.0:1762166819.846140:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166819.846141:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166819.846151:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c768 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.846164:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c768 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.846191:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166819.846211:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c768 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166819.846213:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242cea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765444312320:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 125us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166819.846230:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 571 00010000:00010000:2.0:1762166819.846232:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c768 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.846250:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c768 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.846257:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c768 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.846264:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c768 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.846269:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350452000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166819.846273:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c768 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.846279:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c768 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.846297:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c768 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.846304:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee350452000/0xf915a5bdf3c9c768 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166819.846344:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765444311936:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 7363us (7586us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166819.846352:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 914 00000100:00100000:0.0:1762166819.847697:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.847751:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444312576 00000100:00100000:1.0:1762166819.847760:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444312576 00000100:00100000:1.0:1762166819.847827:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2606 00000100:00100000:1.0:1762166819.847836:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:45262:x1847765444312576:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762166819.847889:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762166819.847909:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c74c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d74 expref: 26 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.847928:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c6c7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d4a expref: 25 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.847938:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:1.0:1762166819.847942:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166819.847971:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9c776 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.847982:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9c776 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.847988:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9c776 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00080000:1.0:1762166819.848396:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5f:0x0], index 1: 0 00000040:00080000:1.0:1762166819.848509:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].123, 88 off18072 00000004:00080000:1.0:1762166819.848516:0:6558:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440640753181ns, next at 431048225210ns, rc = 0 00000040:00080000:1.0:1762166819.848555:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].124, 88 off18160 00000004:00080000:1.0:1762166819.848560:0:6558:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440640797176ns, next at 431048225210ns, rc = 0 00000040:00080000:1.0:1762166819.848609:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].119, 88 off17704 00000004:00080000:1.0:1762166819.848614:0:6558:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440640851781ns, next at 435656221086ns, rc = 0 00000040:00080000:1.0:1762166819.848659:0:6558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].120, 88 off17792 00000004:00080000:1.0:1762166819.848664:0:6558:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440640901328ns, next at 435656221086ns, rc = 0 00000004:00010000:3.0:1762166819.861183:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006619c97c reply state 00000000fe72f6dd transno 4294969058 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9c776 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166819.861200:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1762166819.861284:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969058 is committed 00000004:00080000:1.0:1762166819.861294:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 106 committed 00010000:00080000:3.0:1762166819.861303:0:6558:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000004:00080000:1.0:1762166819.861317:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 105 committed 00000004:00080000:1.0:1762166819.861322:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 109 committed 00000100:00100000:3.0:1762166819.861329:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:45262:x1847765444312576:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 13487us (13646us total) trans 4294969058 rc 0/0 00000004:00080000:1.0:1762166819.861334:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 108 committed 00000100:00100000:3.0:1762166819.861342:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2606 00010000:00010000:2.0:1762166819.861366:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9c776 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.861382:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9c776 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.861390:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9c776 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.861396:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee350453a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166819.861400:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9c776 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.861409:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9c776 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.861428:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:2.0:1762166819.861432:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166819.861439:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9c776 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166819.861461:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453a00/0xf915a5bdf3c9c776 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166819.861468:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451928064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166819.861483:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451928192:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166819.861493:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451928448:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166819.861532:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166819.861537:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451928320:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166819.861578:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166819.861591:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451928064 00000100:00100000:0.0:1762166819.861601:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451928064 00000100:00100000:1.0:1762166819.861620:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166819.861635:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451928448 00000100:00100000:2.0:1762166819.861640:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451928448 00000100:00100000:0.0:1762166819.861651:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451928192 00000100:00100000:0.0:1762166819.861657:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451928192 00000100:00100000:3.0:1762166819.861666:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:1.0:1762166819.861670:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166819.861692:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765451928064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166819.861701:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451928320 00000100:00100000:2.0:1762166819.861706:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451928320 00000100:00100000:0.0:1762166819.861710:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:0.0:1762166819.861724:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765451928448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166819.861732:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:1.0:1762166819.861740:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:2.0:1762166819.861744:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765451928192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166819.861755:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3293:x1847765451928320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166819.862002:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765451928192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 260us (381us total) trans 17179869400 rc 0/0 00000100:00100000:1.0:1762166819.862012:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765451928320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 260us (343us total) trans 21474836730 rc 0/0 00000100:00100000:2.0:1762166819.862015:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:3.0:1762166819.862016:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765451928064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 335us (481us total) trans 21474836729 rc 0/0 00000100:00100000:1.0:1762166819.862028:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:3.0:1762166819.862039:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:0.0:1762166819.862039:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765451928448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 317us (460us total) trans 17179869401 rc 0/0 00000100:00100000:0.0:1762166819.862061:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000004:00080000:3.0:1762166819.862088:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34371b100/2, rc 0, transno 21474836729 00000004:00080000:1.0:1762166819.862088:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce5180/2, rc 0, transno 17179869400 00000004:00080000:2.0:1762166819.862090:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f2d3480/2, rc 0, transno 17179869401 00000100:00100000:3.0:1762166819.862098:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451928064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166819.862101:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451928192:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166819.862102:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451928448:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762166819.862148:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee343718a80/2, rc 0, transno 21474836730 00000100:00100000:1.0:1762166819.862154:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451928320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166819.864079:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166819.864173:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444312704 00000100:00100000:3.0:1762166819.864181:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444312704 00000100:00100000:3.0:1762166819.864225:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2607 00000100:00100000:3.0:1762166819.864235:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:45262:x1847765444312704:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166819.864266:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166819.864283:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c77d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d82 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.864331:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c77d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d82 expref: 19 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.864344:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c77d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d82 expref: 19 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.864360:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:3.0:1762166819.864363:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166819.864367:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243444000, rc 0) 00000100:00100000:3.0:1762166819.864418:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45262:x1847765444312704:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 185us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166819.864424:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2607 00000100:00100000:3.0:1762166819.866241:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.866322:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444312832 00000100:00100000:1.0:1762166819.866332:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444312832 00000100:00100000:1.0:1762166819.866391:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2608 00000100:00100000:1.0:1762166819.866400:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45262:x1847765444312832:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166819.866419:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166819.866439:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c784 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d89 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.866547:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c78b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.866562:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c78b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.866572:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c78b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:1.0:1762166819.866600:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145729 00000004:00200000:1.0:1762166819.866604:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166819.866618:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c78b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166819.866642:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453800/0xf915a5bdf3c9c784 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d89 expref: 21 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.866656:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c78b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d89 expref: 20 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166819.866691:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:1.0:1762166819.866693:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166819.866696:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee350452e00, rc 0) 00000100:00100000:1.0:1762166819.866741:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:45262:x1847765444312832:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 342us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166819.866747:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2608 00000100:00100000:2.0:1762166819.868199:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166819.868226:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166819.868253:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444312960 00000100:00100000:0.0:1762166819.868261:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444312960 00000100:00100000:0.0:1762166819.868304:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444313088 00000100:00100000:0.0:1762166819.868319:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444313088 00000100:00100000:3.0:1762166819.868332:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 920 00000100:00100000:2.0:1762166819.868346:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 921 00000100:00100000:3.0:1762166819.868349:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2361:x1847765444312960:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:2.0:1762166819.868363:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765444313088:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166819.868366:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166819.868373:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166819.868385:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c792 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d90 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.868388:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee341673400/0xf915a5bdf3c9c799 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d97 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166819.868422:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x64:0x0] initial LVB size: 2097152, mtime: 0x69088823, atime: 0x0, ctime: 0x69088823, blocks: 0x1 00002000:00010000:2.0:1762166819.868422:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x65:0x0] initial LVB size: 3145728, mtime: 0x69088824, atime: 0x0, ctime: 0x69088824, blocks: 0x1 00010000:00010000:2.0:1762166819.868438:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166819.868439:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166819.868442:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166819.868451:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166819.868454:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c792 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d90 expref: 16 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166819.868458:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee341673400/0xf915a5bdf3c9c799 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d97 expref: 16 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166819.868475:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee341673400/0xf915a5bdf3c9c799 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d97 expref: 16 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166819.868484:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c792 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d90 expref: 16 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166819.868491:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee341673400, rc 0) 00010000:00010000:3.0:1762166819.868497:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445c00, rc 0) 00000100:00100000:2.0:1762166819.868551:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444313088:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 194us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166819.868552:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444312960:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 208us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166819.868566:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 921 00000100:00100000:3.0:1762166819.868573:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 920 00000100:00100000:0.0:1762166819.895442:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166819.895493:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166819.895537:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166819.895575:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444313216 00000100:00100000:1.0:1762166819.895589:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444313216 00000100:00100000:2.0:1762166819.895657:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444313344 00000100:00100000:2.0:1762166819.895673:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444313344 00000100:00100000:1.0:1762166819.895696:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444313472 00000100:00100000:1.0:1762166819.895705:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444313472 00000100:00100000:3.0:1762166819.895710:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 939 00000100:00100000:3.0:1762166819.895731:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765444313216:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762166819.895810:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7a0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166819.895827:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 940 00010000:00010000:3.0:1762166819.895829:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166819.895837:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166819.895848:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166819.895851:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 941 00000100:00100000:2.0:1762166819.895862:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765444313344:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762166819.895889:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765444313472:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762166819.895904:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.895924:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee341672600/0xf915a5bdf3c9c7a7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166819.895938:0:26247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c7ae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.895939:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166819.895948:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166819.895957:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee341672600/0xf915a5bdf3c9c7a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166819.895965:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166819.895970:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166819.895976:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee341672600/0xf915a5bdf3c9c7a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166819.895978:0:26247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c7ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166819.896021:0:26247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c7ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.902020:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.902042:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.902056:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.902072:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166819.902076:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.902085:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.902329:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.902347:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166819.902466:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765444313216:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 6734us (7027us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1762166819.902477:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 939 00010000:00010000:2.0:1762166819.904224:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee341672600/0xf915a5bdf3c9c7a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.904256:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee341672600/0xf915a5bdf3c9c7a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.904265:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee341672600/0xf915a5bdf3c9c7a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.904273:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee341672600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166819.904278:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee341672600/0xf915a5bdf3c9c7a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.904288:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee341672600/0xf915a5bdf3c9c7a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.904307:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee341672600/0xf915a5bdf3c9c7a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.904329:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee341672600/0xf915a5bdf3c9c7a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166819.904418:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765444313344:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 8570us (8921us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1762166819.904430:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 940 00010000:00010000:2.0:1762166819.905052:0:26247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c7ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.905063:0:26247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c7ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.905081:0:26247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c7ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.905086:0:26247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166819.905090:0:26247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c7ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.905096:0:26247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c7ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.905106:0:26247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c7ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.905112:0:26247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c7ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166819.905157:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2359:x1847765444313472:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 9286us (9619us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1762166819.905165:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 941 00000100:00100000:0.0:1762166819.908798:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166819.908842:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444313600 00000100:00100000:2.0:1762166819.908862:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444313600 00000100:00080000:3.0:1762166819.908945:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166819.908946:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 942 00000100:00100000:2.0:1762166819.908961:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2360:x1847765444313600:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:2.0:1762166819.909013:0:26247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166819.909023:0:26247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c7b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.909050:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166819.909052:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166819.909057:0:26247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.909072:0:26247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762166819.931102:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869401 is committed 00002000:00010000:3.0:1762166819.931121:0:26247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1762166819.931127:0:26247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb mtime from disk: 0 -> 1762166820 00002000:00010000:3.0:1762166819.931129:0:26247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb ctime from disk: 0 -> 1762166820 00002000:00010000:3.0:1762166819.931131:0:26247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb blocks from disk: 1 -> 2051 00000001:00080000:2.0:1762166819.931135:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869402 is committed 00010000:00010000:3.0:1762166819.931146:0:26247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.931155:0:26247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.931175:0:26247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c7b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.931181:0:26247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee341672a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166819.931184:0:26247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c7b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.931189:0:26247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c7b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.931203:0:26247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c7b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.931208:0:26247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c7b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166819.931288:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2360:x1847765444313600:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 22329us (22493us total) trans 17179869402 rc 0/0 00000100:00100000:3.0:1762166819.931295:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 942 00000100:00100000:0.0:1762166819.935709:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166819.935791:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444313728 00000100:00100000:0.0:1762166819.935802:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166819.935809:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444313728 00000100:00100000:3.0:1762166819.935938:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444313856 00000100:00100000:3.0:1762166819.935943:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444313856 00000100:00100000:0.0:1762166819.935983:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 943 00000100:00100000:3.0:1762166819.935999:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 944 00000100:00100000:0.0:1762166819.936001:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2361:x1847765444313728:12345-192.168.203.35@tcp:4:lfs.0 00000100:00100000:3.0:1762166819.936014:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2360:x1847765444313856:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:0.0:1762166819.936083:0:14122:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166819.936095:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c7bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.936096:0:26247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166819.936121:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166819.936126:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166819.936133:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c7bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.936146:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166819.936146:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c7bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.936152:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166819.936157:0:26247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.936170:0:26247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166819.990475:0:26247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:3.0:1762166819.990489:0:26247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb mtime from disk: 0 -> 1762166820 00002000:00010000:3.0:1762166819.990492:0:26247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb ctime from disk: 0 -> 1762166820 00002000:00010000:3.0:1762166819.990494:0:26247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb blocks from disk: 1 -> 4181 00010000:00010000:3.0:1762166819.990512:0:26247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762166819.990520:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869403 is committed 00010000:00010000:3.0:1762166819.990530:0:26247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.990545:0:26247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.990546:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c7bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762166819.990546:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869404 is committed 00010000:00010000:2.0:1762166819.990593:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c7bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.990602:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c7bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.990603:0:26247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166819.990615:0:26247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.990616:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166819.990627:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c7bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.990635:0:26247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.990647:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c7bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.990694:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c7bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.990703:0:26247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166819.990710:0:26247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166819.990750:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c7bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166819.990905:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2360:x1847765444313856:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 54883us (55090us total) trans 17179869404 rc 0/0 00000100:00100000:2.0:1762166819.990906:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2361:x1847765444313728:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 54899us (55193us total) trans 17179869403 rc 0/0 00000100:00100000:3.0:1762166819.990935:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 944 00000100:00100000:2.0:1762166819.990946:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 943 00000100:00100000:0.0:1762166820.001750:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166820.001896:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444314112 00000100:00100000:1.0:1762166820.001915:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444314112 00000100:00100000:1.0:1762166820.002010:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2609 00000100:00100000:1.0:1762166820.002026:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:45262:x1847765444314112:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762166820.002108:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166820.002157:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452e00/0xf915a5bdf3c9c78b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d89 expref: 20 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.002183:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:1.0:1762166820.002190:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166820.002621:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9c7ca lrc: 3/0,1 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166820.002638:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9c7ca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166820.002688:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9c7ca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000001:00080000:1.0:1762166820.002826:0:6558:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294969059 00000004:00010000:1.0:1762166820.002857:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ca457674 reply state 0000000077b0ded0 transno 4294969060 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9c7ca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:1.0:1762166820.002868:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166820.002994:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45262:x1847765444314112:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 972us (1252us total) trans 4294969060 rc 0/0 00000100:00100000:1.0:1762166820.003003:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2609 00000020:00080000:1.0:1762166820.003011:0:6558:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762166820.004397:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9c7ca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166820.004414:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9c7ca lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00000100:00100000:1.0:1762166820.004425:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166820.004429:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9c7ca lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166820.004438:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7d800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166820.004453:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9c7ca lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166820.004462:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9c7ca lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166820.004480:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:2.0:1762166820.004484:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166820.004489:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9c7ca lrc: 2/0,0 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166820.004496:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9c7ca lrc: 0/0,0 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166820.004543:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444314240 00000100:00100000:3.0:1762166820.004554:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444314240 00000100:00100000:3.0:1762166820.004615:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 922 00000100:00100000:3.0:1762166820.004627:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:45262:x1847765444314240:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166820.004644:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166820.004668:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90d9e expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166820.004707:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x5e:0x0] initial LVB size: 1048576, mtime: 0x69088824, atime: 0x0, ctime: 0x69088824, blocks: 0x803 00010000:00010000:3.0:1762166820.004731:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.004734:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.004745:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d9e expref: 7 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.004795:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d9e expref: 7 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.004834:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445800, rc 0) 00000100:00100000:3.0:1762166820.004890:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:45262:x1847765444314240:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 266us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166820.004898:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 922 00000100:00100000:2.0:1762166820.007265:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.007376:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444314368 00000100:00100000:3.0:1762166820.007392:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444314368 00000100:00100000:3.0:1762166820.007469:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 923 00000100:00100000:3.0:1762166820.007484:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:45262:x1847765444314368:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166820.007507:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166820.007532:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c7d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90da5 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166820.007565:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x5f:0x0] initial LVB size: 3145728, mtime: 0x69088824, atime: 0x0, ctime: 0x69088824, blocks: 0x1055 00010000:00010000:3.0:1762166820.007588:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.007591:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.007601:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c7d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90da5 expref: 8 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.007618:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c7d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90da5 expref: 8 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.007632:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243444c00, rc 0) 00000100:00100000:3.0:1762166820.007791:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:45262:x1847765444314368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 311us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166820.007799:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 923 00000100:00100000:0.0:1762166820.010088:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.010173:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444314496 00000100:00100000:2.0:1762166820.010189:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444314496 00002000:00010000:2.0:1762166820.010245:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/95 (3145728->18446744073709551615) 00002000:00100000:2.0:1762166820.010251:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b1500 with x1847765444314496 ext(3145728->18446744073709551615) 00002000:00010000:2.0:1762166820.010265:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e3b1500. 00000100:00100000:2.0:1762166820.010310:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 945 00000100:00100000:2.0:1762166820.010322:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2359:x1847765444314496:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762166820.010661:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1762166820.010665:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00002000:00010000:2.0:1762166820.010667:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166820.010670:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb ctime from disk: 1762166820 -> 1762166820 00002000:00010000:2.0:1762166820.010672:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb blocks from disk: 4181 -> 4181 00000100:00100000:2.0:1762166820.010807:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2359:x1847765444314496:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 486us (731us total) trans 17179869405 rc 0/0 00000100:00100000:2.0:1762166820.010815:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 945 00002000:00010000:2.0:1762166820.010818:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/95 (3145728->18446744073709551615) 00002000:00100000:2.0:1762166820.010821:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b1500 with x1847765444314496 ext(3145728->18446744073709551615) 00002000:00010000:2.0:1762166820.010826:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e3b1500. 00000100:00100000:1.0:1762166820.013040:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.013255:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444314752 00000100:00100000:3.0:1762166820.013270:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444314752 00000100:00100000:3.0:1762166820.013331:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2610 00000100:00100000:3.0:1762166820.013340:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:45262:x1847765444314752:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166820.013443:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c7df lrc: 3/0,1 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.013460:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c7df lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.013472:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c7df lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00010000:3.0:1762166820.013598:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bbc12a80 reply state 000000002982210a transno 4294969061 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c7df lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166820.013606:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166820.013704:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:45262:x1847765444314752:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 364us (678us total) trans 4294969061 rc 0/0 00000100:00100000:3.0:1762166820.013712:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2610 00010000:00010000:1.0:1762166820.015240:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c7df lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166820.015248:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c7df lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166820.015252:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c7df lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166820.015256:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166820.015259:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c7df lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166820.015264:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c7df lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166820.015274:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:1.0:1762166820.015276:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166820.015289:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c7df lrc: 2/0,0 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166820.015293:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444600/0xf915a5bdf3c9c7df lrc: 0/0,0 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:1.0:1762166820.015811:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166820.015845:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.015854:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444314880 00000100:00100000:2.0:1762166820.015861:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444314880 00000100:00100000:2.0:1762166820.015919:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444315008 00000100:00100000:0.0:1762166820.015990:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 924 00000100:00100000:0.0:1762166820.016001:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765444314880:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:2.0:1762166820.016026:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444315008 00000100:00100000:2.0:1762166820.016066:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 925 00000100:00100000:2.0:1762166820.016072:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444315008:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166820.016243:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1762166820.016247:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb mtime from disk: 1762166819 -> 1762166820 00002000:00010000:0.0:1762166820.016250:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb atime from disk: 0 -> 1762166820 00002000:00010000:0.0:1762166820.016252:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb ctime from disk: 1762166819 -> 1762166820 00002000:00010000:0.0:1762166820.016254:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:2.0:1762166820.016262:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1762166820.016265:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00002000:00010000:2.0:1762166820.016274:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb atime from disk: 0 -> 1762166820 00002000:00010000:2.0:1762166820.016276:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb ctime from disk: 1762166820 -> 1762166820 00002000:00010000:2.0:1762166820.016278:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166820.016314:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444314880:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 313us (549us total) trans 21474836732 rc 0/0 00000100:00100000:2.0:1762166820.016317:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765444315008:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 240us (466us total) trans 21474836731 rc 0/0 00000100:00100000:0.0:1762166820.016321:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 924 00000100:00100000:2.0:1762166820.016324:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 925 00000100:00100000:0.0:1762166820.018018:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166820.018106:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444315264 00000100:00100000:1.0:1762166820.018114:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444315264 00000100:00100000:1.0:1762166820.018169:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 799 00000100:00100000:1.0:1762166820.018180:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3719b7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45262:x1847765444315264:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166820.018238:0:5758:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x11:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9c75a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d7b expref: 22 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.018290:0:5758:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9c7e6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166820.018304:0:5758:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c77d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d82 expref: 22 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.018313:0:5758:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9c7e6 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166820.018349:0:5758:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c77d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d82 expref: 22 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.018362:0:5758:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c77d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d82 expref: 22 pid: 6558 timeout: 540 lvb_type: 0 00000100:00100000:1.0:1762166820.018376:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1847765451928576:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166820.018498:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166820.020589:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166820.020640:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1847765451928576:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166820.020648:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444315392 00000100:00100000:2.0:1762166820.020654:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444315392 00010000:00010000:1.0:1762166820.020687:0:5758:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9c7e6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166820.020701:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c77d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d82 expref: 23 pid: 6558 timeout: 540 lvb_type: 0 00000100:00100000:2.0:1762166820.020739:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 572 00000100:00100000:2.0:1762166820.020749:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444315392:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166820.020793:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166820.020805:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c77d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d82 expref: 23 pid: 6558 timeout: 540 lvb_type: 0 00010000:00010000:2.0:1762166820.020820:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c77d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d82 expref: 23 pid: 6558 timeout: 540 lvb_type: 0 00010000:00010000:2.0:1762166820.020852:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444000/0xf915a5bdf3c9c77d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d82 expref: 23 pid: 6558 timeout: 540 lvb_type: 0 00010000:00010000:2.0:1762166820.020875:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:2.0:1762166820.020879:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9c7e6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166820.020888:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9c7e6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166820.020912:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9c7e6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166820.020944:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166820.020984:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765444315392:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 238us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166820.020991:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 572 00010000:00010000:1.0:1762166820.021050:0:5758:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9c7e6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166820.021055:0:5758:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9c7e6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00000040:00080000:1.0:1762166820.021651:0:5758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].125, 88 off18248 00000004:00080000:1.0:1762166820.021662:0:5758:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440813898285ns, next at 431048225210ns, rc = 0 00000040:00080000:1.0:1762166820.021709:0:5758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].126, 88 off18336 00000004:00080000:1.0:1762166820.021714:0:5758:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440813951218ns, next at 431048225210ns, rc = 0 00000040:00080000:1.0:1762166820.021828:0:5758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].121, 88 off17880 00000004:00080000:1.0:1762166820.021835:0:5758:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440814072558ns, next at 435656221086ns, rc = 0 00000040:00080000:1.0:1762166820.021882:0:5758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].122, 88 off17968 00000004:00080000:1.0:1762166820.021887:0:5758:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440814124441ns, next at 435656221086ns, rc = 0 00000001:00080000:0.0:1762166820.037459:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969062 is committed 00000004:00080000:0.0:1762166820.037487:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 108 committed 00000004:00080000:0.0:1762166820.037517:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 107 committed 00000004:00080000:0.0:1762166820.037521:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 111 committed 00000004:00010000:3.0:1762166820.037523:0:5758:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005cfd6fc5 reply state 0000000094636f32 transno 4294969062 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9c7e6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00000004:00080000:0.0:1762166820.037537:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 110 committed 00000100:00100000:3.0:1762166820.037539:0:5758:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1762166820.037553:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:3.0:1762166820.037556:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166820.037566:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452400/0xf915a5bdf3c9c75a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d7b expref: 18 pid: 6558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166820.037646:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451928832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166820.037647:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451928704:0@lo:2:osp-syn-1-0.0 00010000:00080000:3.0:1762166820.037701:0:5758:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1762166820.037718:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166820.037725:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3719b7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:45262:x1847765444315264:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 19544us (19707us total) trans 4294969062 rc 0/0 00000100:00100000:3.0:1762166820.037735:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 799 00000100:00100000:1.0:1762166820.037779:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451928704 00000100:00100000:1.0:1762166820.037786:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451928704 00000100:00100000:1.0:1762166820.037836:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:1.0:1762166820.037844:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3295:x1847765451928704:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762166820.037989:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9c7e6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166820.037998:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9c7e6 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166820.038006:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9c7e6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166820.038012:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166820.038017:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9c7e6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166820.038025:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9c7e6 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5758 initiator: MDT0 00002000:00010000:1.0:1762166820.038038:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb size from disk: 1048576 -> 1048576 00010000:00010000:2.0:1762166820.038043:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee34ada3d00) 00002000:00010000:1.0:1762166820.038044:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00010000:00010000:2.0:1762166820.038050:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00002000:00010000:1.0:1762166820.038051:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:2.0:1762166820.038055:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9c7e6 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 00002000:00010000:1.0:1762166820.038056:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb ctime from disk: 1762166820 -> 1762166820 00010000:00010000:2.0:1762166820.038063:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9c7e6 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 00002000:00010000:1.0:1762166820.038073:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb blocks from disk: 2051 -> 2051 00000100:00100000:1.0:1762166820.038117:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765451928704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 273us (399us total) trans 17179869406 rc 0/0 00000100:00100000:1.0:1762166820.038125:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00100000:2.0:1762166820.038145:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451929088:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1762166820.038149:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166820.038161:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166820.038171:0:3295:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869401 gen 2 00000004:00080000:0.0:1762166820.038178:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce4a80, transno 17179869396 00000100:00100000:2.0:1762166820.038189:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762166820.038190:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce6300, transno 17179869397 00000004:00080000:0.0:1762166820.038195:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f284700, transno 17179869398 00000004:00080000:0.0:1762166820.038198:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b2300, transno 17179869399 00000004:00080000:0.0:1762166820.038202:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce5180, transno 17179869400 00000004:00080000:0.0:1762166820.038207:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f2d3480, transno 17179869401 00000100:00100000:0.0:1762166820.038216:0:3295:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee37f622d80 x1847765451928704/t17179869406(17179869406) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166836 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1762166820.038218:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1762166820.038228:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451928960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762166820.038230:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f622d80/2, rc 0, transno 17179869406 00000100:00100000:0.0:1762166820.038238:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451928704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166820.038256:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166820.038274:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451928832 00000100:00100000:0.0:1762166820.038280:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451928832 00000100:00100000:0.0:1762166820.038324:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451929088 00000100:00100000:0.0:1762166820.038328:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451929088 00000100:00100000:2.0:1762166820.038338:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451928960 00000100:00100000:2.0:1762166820.038344:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451928960 00000100:00100000:0.0:1762166820.038362:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:0.0:1762166820.038373:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765451928832:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762166820.038385:0:7836:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 2 in progress, 1 in flight, 5 done 00000100:00100000:1.0:1762166820.038455:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1762166820.038464:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765451929088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166820.038470:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:2.0:1762166820.038482:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765451928960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762166820.038482:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1762166820.038489:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00002000:00010000:0.0:1762166820.038493:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166820.038495:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb ctime from disk: 1762166820 -> 1762166820 00002000:00010000:0.0:1762166820.038497:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb blocks from disk: 4181 -> 4181 00000100:00100000:0.0:1762166820.038539:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765451928832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (375us total) trans 17179869407 rc 0/0 00000100:00100000:0.0:1762166820.038553:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00002000:00010000:1.0:1762166820.038576:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1762166820.038579:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00002000:00010000:1.0:1762166820.038581:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb atime from disk: 1762166820 -> 1762166820 00002000:00010000:1.0:1762166820.038583:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb ctime from disk: 1762166820 -> 1762166820 00002000:00010000:1.0:1762166820.038585:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:2.0:1762166820.038619:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1762166820.038623:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765451929088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 161us (434us total) trans 21474836733 rc 0/0 00002000:00010000:2.0:1762166820.038625:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00000100:00100000:1.0:1762166820.038630:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00002000:00010000:2.0:1762166820.038631:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb atime from disk: 1762166820 -> 1762166820 00002000:00010000:2.0:1762166820.038636:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb ctime from disk: 1762166820 -> 1762166820 00002000:00010000:2.0:1762166820.038638:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:1.0:1762166820.038656:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f622a00/2, rc 0, transno 17179869407 00000100:00100000:1.0:1762166820.038662:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451928832:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166820.038675:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765451928960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 196us (419us total) trans 21474836734 rc 0/0 00000100:00100000:2.0:1762166820.038697:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000004:00080000:0.0:1762166820.038703:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317ea00/2, rc 0, transno 21474836734 00000100:00100000:0.0:1762166820.038711:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451928960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762166820.038723:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317c700/2, rc 0, transno 21474836733 00000100:00100000:0.0:1762166820.038726:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451929088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166820.039633:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.039931:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444315520 00000100:00100000:3.0:1762166820.039936:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444315520 00000100:00100000:3.0:1762166820.039967:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2611 00000100:00100000:3.0:1762166820.039975:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:45262:x1847765444315520:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166820.039992:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166820.040022:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c7ed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90dac expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.040068:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c7ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dac expref: 18 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.040081:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c7ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dac expref: 18 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.040096:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee343a13b00) 00010000:00010000:3.0:1762166820.040099:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166820.040102:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243444800, rc 0) 00000100:00100000:3.0:1762166820.040146:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:45262:x1847765444315520:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 171us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166820.040153:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2611 00000100:00100000:3.0:1762166820.042075:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166820.042205:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444315776 00000100:00100000:1.0:1762166820.042215:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444315776 00000100:00100000:1.0:1762166820.042266:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 800 00000100:00100000:1.0:1762166820.042282:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:45262:x1847765444315776:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166820.042622:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45262:x1847765444315776:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 346us (557us total) trans 4294969063 rc 0/0 00000100:00100000:1.0:1762166820.042631:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 800 00000100:00100000:2.0:1762166820.052752:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.053267:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444316032 00000100:00100000:3.0:1762166820.053278:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444316032 00000100:00100000:3.0:1762166820.053335:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2612 00000100:00100000:3.0:1762166820.053348:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45263:x1847765444316032:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166820.053401:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166820.053421:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c7f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90db3 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.053497:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c7fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.053509:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c7fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.053521:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c7fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.053533:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c802 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.053539:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c802 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.053545:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c802 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.053876:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c809 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.053885:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c809 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.053892:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c809 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166820.053901:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00010000:00010000:3.0:1762166820.053987:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c7fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.054004:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c7fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.054010:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c7fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.054015:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166820.054019:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c7fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.054027:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c7fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.054038:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:3.0:1762166820.054042:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166820.054046:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c7fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.054051:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c7fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.054064:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c802 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.054070:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c802 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.054075:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c802 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.054079:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166820.054082:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c802 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.054097:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c802 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.054105:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee343a13700) 00010000:00010000:3.0:1762166820.054107:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166820.054110:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c802 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.054115:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c802 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.054160:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c7f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90db3 expref: 22 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.054172:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c809 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90db3 expref: 21 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.054179:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee343a13b00) 00010000:00010000:3.0:1762166820.054182:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166820.054184:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243444a00, rc 0) 00000100:00100000:3.0:1762166820.054248:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:45263:x1847765444316032:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 903us (1507us total) trans 4294969064 rc 0/0 00000100:00100000:3.0:1762166820.054256:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2612 00000100:00100000:0.0:1762166820.057146:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.057189:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.057264:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444316160 00000100:00100000:3.0:1762166820.057273:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444316160 00000100:00100000:3.0:1762166820.057327:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444316288 00000100:00100000:3.0:1762166820.057330:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444316288 00000100:00100000:3.0:1762166820.057363:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 930 00000100:00100000:3.0:1762166820.057376:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444316160:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:2.0:1762166820.057378:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 931 00000100:00100000:2.0:1762166820.057396:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765444316288:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166820.057453:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee341672800/0xf915a5bdf3c9c817 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.057458:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c81e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.057481:0:6535:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee341673400/0xf915a5bdf3c9c799 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d97 expref: 18 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166820.057482:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c792 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d90 expref: 18 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166820.057504:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.057505:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.057508:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.057511:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c81e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.057517:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.057522:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee341672800/0xf915a5bdf3c9c817 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.057557:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c792 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d90 expref: 18 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166820.057558:0:6535:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee341673400/0xf915a5bdf3c9c799 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d97 expref: 18 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166820.057585:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c792 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d90 expref: 18 pid: 12402 timeout: 540 lvb_type: 1 00010000:00010000:2.0:1762166820.057586:0:6535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee341673400/0xf915a5bdf3c9c799 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d97 expref: 18 pid: 12400 timeout: 540 lvb_type: 1 00000100:00100000:3.0:1762166820.057616:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242523b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451929216:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166820.057618:0:6535:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765451929344:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166820.058336:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347174600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166820.058622:0:6535:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34718b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166820.060405:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.060444:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.060463:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242523b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451929216:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166820.060466:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444316416 00000100:00100000:0.0:1762166820.060471:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444316544 00000100:00100000:1.0:1762166820.060475:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444316416 00000100:00100000:0.0:1762166820.060477:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444316544 00010000:00010000:3.0:1762166820.060490:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c81e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.060514:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c792 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d90 expref: 20 pid: 12402 timeout: 540 lvb_type: 1 00010000:00010000:1.0:1762166820.060516:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee341673400/0xf915a5bdf3c9c799 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d97 expref: 20 pid: 12400 timeout: 540 lvb_type: 1 00000100:00100000:0.0:1762166820.060569:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 573 00000100:00100000:0.0:1762166820.060580:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3456e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444316544:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166820.060594:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166820.060616:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c792 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d90 expref: 20 pid: 12402 timeout: 540 lvb_type: 1 00010000:00010000:0.0:1762166820.060628:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c792 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d90 expref: 20 pid: 12402 timeout: 540 lvb_type: 1 00010000:00010000:0.0:1762166820.060651:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee243445c00/0xf915a5bdf3c9c792 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d90 expref: 20 pid: 12402 timeout: 540 lvb_type: 1 00010000:00010000:0.0:1762166820.060691:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.060693:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.060697:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c81e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.060706:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c81e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.060732:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166820.060738:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 574 00000100:00100000:1.0:1762166820.060751:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765444316416:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166820.060788:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166820.060805:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee341673400/0xf915a5bdf3c9c799 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d97 expref: 19 pid: 12400 timeout: 540 lvb_type: 1 00010000:00010000:3.0:1762166820.060806:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c81e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.060827:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c81e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.060833:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee341673400/0xf915a5bdf3c9c799 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d97 expref: 19 pid: 12400 timeout: 540 lvb_type: 1 00010000:00010000:1.0:1762166820.060856:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166820.060859:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166820.060862:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee341672800/0xf915a5bdf3c9c817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.060869:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c81e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.060871:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee341672800/0xf915a5bdf3c9c817 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.060891:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c81e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.060900:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c81e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.060901:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166820.060909:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166820.060914:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c81e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.060922:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c81e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166820.060942:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765444316416:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 180us (528us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166820.060950:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c81e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166820.060951:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 574 00010000:00010000:3.0:1762166820.060962:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c81e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166820.061014:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444316160:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3642us (3876us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166820.061023:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 930 00010000:00010000:2.0:1762166820.061147:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee341673400/0xf915a5bdf3c9c799 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d97 expref: 17 pid: 12400 timeout: 540 lvb_type: 1 00000100:00100000:2.0:1762166820.061161:0:6535:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765451929344:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166820.061176:0:6535:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee341672800/0xf915a5bdf3c9c817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.061185:0:6535:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee341672800/0xf915a5bdf3c9c817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.061192:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee341672800/0xf915a5bdf3c9c817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.061207:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee341672800/0xf915a5bdf3c9c817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.061227:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee341672800/0xf915a5bdf3c9c817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.061233:0:6535:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee341672800/0xf915a5bdf3c9c817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.061239:0:6535:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee341672800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166820.061242:0:6535:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee341672800/0xf915a5bdf3c9c817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.061248:0:6535:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee341672800/0xf915a5bdf3c9c817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.061260:0:6535:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee341672800/0xf915a5bdf3c9c817 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.061266:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee341672800/0xf915a5bdf3c9c817 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166820.061279:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3456e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444316544:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 699us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.061287:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 573 00000100:00100000:2.0:1762166820.061318:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444316288:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3928us (4126us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166820.061327:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 931 00000100:00100000:0.0:1762166820.063974:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.064140:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444316800 00000100:00100000:3.0:1762166820.064164:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444316800 00000100:00100000:3.0:1762166820.064219:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2613 00000100:00100000:3.0:1762166820.064230:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:45263:x1847765444316800:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166820.064302:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.064317:0:6558:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c7ed lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dac expref: 21 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.064325:0:6558:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c809 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90db3 expref: 21 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.064332:0:6558:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.064362:0:6558:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c809 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90db3 expref: 21 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.064375:0:6558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c809 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90db3 expref: 21 pid: 6558 timeout: 540 lvb_type: 0 00000100:00100000:3.0:1762166820.064388:0:6558:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242523b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451929472:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166820.064472:0:6558:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c7ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dac expref: 21 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.064480:0:6558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c7ed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dac expref: 21 pid: 6558 timeout: 540 lvb_type: 0 00000100:00100000:3.0:1762166820.064488:0:6558:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242523100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451929600:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166820.064518:0:6558:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347174600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166820.066812:0:6558:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242523b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451929472:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166820.066834:0:6558:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242523100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451929600:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166820.066866:0:6558:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166820.066874:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166820.066969:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444316928 00000100:00100000:1.0:1762166820.066981:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444316928 00010000:00010000:1.0:1762166820.067056:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c809 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90db3 expref: 22 pid: 6558 timeout: 540 lvb_type: 0 00000100:00100000:1.0:1762166820.067114:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 575 00000100:00100000:1.0:1762166820.067125:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765444316928:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166820.067145:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166820.067153:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c809 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90db3 expref: 22 pid: 6558 timeout: 540 lvb_type: 0 00010000:00010000:1.0:1762166820.067168:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c809 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90db3 expref: 22 pid: 6558 timeout: 540 lvb_type: 0 00010000:00010000:1.0:1762166820.067198:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c809 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90db3 expref: 22 pid: 6558 timeout: 540 lvb_type: 0 00010000:00010000:1.0:1762166820.067217:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee343a13b00) 00010000:00010000:1.0:1762166820.067220:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166820.067229:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166820.067235:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166820.067241:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166820.067321:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765444316928:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 196us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166820.067330:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 575 00000100:00100000:1.0:1762166820.067843:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.068014:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444317056 00000100:00100000:0.0:1762166820.068021:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444317056 00010000:00010000:0.0:1762166820.068054:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c7ed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dac expref: 21 pid: 6558 timeout: 540 lvb_type: 0 00000100:00100000:0.0:1762166820.068092:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 576 00000100:00100000:0.0:1762166820.068101:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765444317056:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166820.068112:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166820.068117:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c7ed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dac expref: 21 pid: 6558 timeout: 540 lvb_type: 0 00010000:00010000:0.0:1762166820.068127:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c7ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dac expref: 21 pid: 6558 timeout: 540 lvb_type: 0 00010000:00010000:0.0:1762166820.068158:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444800/0xf915a5bdf3c9c7ed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dac expref: 21 pid: 6558 timeout: 540 lvb_type: 0 00010000:00010000:0.0:1762166820.068171:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee343a13b00) 00010000:00010000:0.0:1762166820.068175:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166820.068184:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166820.068193:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166820.068224:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166820.068267:0:6558:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166820.068277:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444317056:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 173us (430us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166820.068285:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166820.068296:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 576 00000004:00010000:3.0:1762166820.068636:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000023ed050d reply state 00000000bf297d78 transno 4294969065 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166820.068646:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166820.068740:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:45263:x1847765444316800:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 4511us (4777us total) trans 4294969065 rc 0/0 00000100:00100000:3.0:1762166820.068749:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2613 00010000:00010000:0.0:1762166820.069898:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166820.069914:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166820.069923:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166820.069933:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.069938:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166820.069947:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166820.069983:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee343a13b00) 00010000:00010000:0.0:1762166820.069986:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00010000:00010000:0.0:1762166820.069992:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166820.069998:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445a00/0xf915a5bdf3c9c825 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:1.0:1762166820.070814:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.070981:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444317312 00000100:00100000:3.0:1762166820.070990:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444317312 00000100:00100000:3.0:1762166820.071047:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 801 00000100:00100000:3.0:1762166820.071056:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:45263:x1847765444317312:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166820.071251:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:45263:x1847765444317312:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 195us (443us total) trans 4294969066 rc 0/0 00000100:00100000:3.0:1762166820.071258:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 801 00000100:00100000:1.0:1762166820.077197:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.077328:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444317568 00000100:00100000:3.0:1762166820.077346:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444317568 00000100:00100000:3.0:1762166820.077449:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2614 00000100:00100000:3.0:1762166820.077462:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:45264:x1847765444317568:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166820.077497:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166820.077501:0:6558:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1762166820.077536:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350453e00/0xf915a5bdf3c9c6dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d58 expref: 21 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.077557:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:3.0:1762166820.077570:0:6558:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166820.077589:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c82c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90dba expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.077851:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c833 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.077865:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c833 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.077877:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c833 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.077889:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c83a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.077895:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c83a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.077900:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c83a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.077985:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c841 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.078004:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c841 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.078018:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c841 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166820.078030:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00010000:00010000:3.0:1762166820.078167:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c833 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.078175:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c833 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.078181:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c833 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.078187:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166820.078192:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c833 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.078200:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c833 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.078208:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13a00) 00010000:00010000:3.0:1762166820.078212:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166820.078215:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c833 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.078221:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c833 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.078231:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c83a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.078247:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c83a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.078253:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c83a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.078257:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243445e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166820.078260:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c83a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.078266:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c83a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.078273:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee343a13800) 00010000:00010000:3.0:1762166820.078276:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166820.078279:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c83a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.078284:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c83a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166820.078330:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c82c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dba expref: 23 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.078346:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c841 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dba expref: 22 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.078354:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee343a13700) 00010000:00010000:3.0:1762166820.078356:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166820.078359:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243444a00, rc 0) 00000100:00100000:3.0:1762166820.078437:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45264:x1847765444317568:12345-192.168.203.35@tcp:101:dd.0 Request processed in 978us (1249us total) trans 4294969067 rc 0/0 00000100:00100000:3.0:1762166820.078450:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2614 00000100:00100000:0.0:1762166820.080707:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.080908:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444317824 00000100:00100000:3.0:1762166820.080918:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444317824 00000100:00100000:0.0:1762166820.081005:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2615 00000100:00100000:0.0:1762166820.081017:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45264:x1847765444317824:12345-192.168.203.35@tcp:36:dd.0 00010000:00010000:0.0:1762166820.081075:0:5756:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166820.081104:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444a00/0xf915a5bdf3c9c841 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dba expref: 22 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.081122:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee343a13700) 00010000:00010000:0.0:1762166820.081133:0:5756:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166820.081360:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c84f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.081373:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c84f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.081383:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c84f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000001:00080000:0.0:1762166820.081445:0:5756:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294969068 00000004:00010000:0.0:1762166820.081470:0:5756:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000021216f1f reply state 0000000050f627ac transno 4294969069 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c84f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:0.0:1762166820.081492:0:5756:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166820.081578:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:45264:x1847765444317824:12345-192.168.203.35@tcp:36:dd.0 Request processed in 563us (881us total) trans 4294969069 rc 0/0 00000100:00100000:0.0:1762166820.081585:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2615 00000020:00080000:0.0:1762166820.081590:0:5756:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166820.083169:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166820.083251:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c84f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.083261:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c84f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.083282:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c84f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.083288:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166820.083292:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c84f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.083300:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c84f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00000100:00100000:0.0:1762166820.083304:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444317952 00010000:00010000:2.0:1762166820.083314:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062be00) 00010000:00010000:2.0:1762166820.083318:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166820.083322:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444317952 00010000:00010000:2.0:1762166820.083323:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c84f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.083332:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c84f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000100:00100000:0.0:1762166820.083377:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2616 00000100:00100000:0.0:1762166820.083386:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:45264:x1847765444317952:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:0.0:1762166820.083402:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.083416:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c856 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90dc1 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.083453:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c856 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dc1 expref: 24 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.083465:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c856 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dc1 expref: 24 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.083480:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b200) 00010000:00010000:0.0:1762166820.083483:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166820.083486:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687800, rc 0) 00000100:00100000:0.0:1762166820.083527:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:45264:x1847765444317952:12345-192.168.203.35@tcp:101:dd.0 Request processed in 142us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.083533:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2616 00000100:00100000:1.0:1762166820.086183:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.086239:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444318208 00000100:00100000:0.0:1762166820.086246:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444318208 00000100:00100000:0.0:1762166820.086323:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2617 00000100:00100000:0.0:1762166820.086336:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:45264:x1847765444318208:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:0.0:1762166820.086355:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.086359:0:5756:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762166820.086382:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c856 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dc1 expref: 24 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.086400:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b200) 00010000:00010000:0.0:1762166820.086413:0:5756:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166820.086426:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c85d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90dc8 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.086466:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c864 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.086478:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c864 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.086487:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c864 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000040:00080000:0.0:1762166820.086951:0:5756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].127, 88 off18424 00000004:00080000:0.0:1762166820.086961:0:5756:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440879197561ns, next at 431048225210ns, rc = 0 00000040:00080000:0.0:1762166820.086994:0:5756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].128, 88 off18512 00000004:00080000:0.0:1762166820.086999:0:5756:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440879235827ns, next at 431048225210ns, rc = 0 00000040:00080000:0.0:1762166820.087032:0:5756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].123, 88 off18056 00000004:00080000:0.0:1762166820.087037:0:5756:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440879274202ns, next at 435656221086ns, rc = 0 00000040:00080000:0.0:1762166820.087078:0:5756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].124, 88 off18144 00000004:00080000:0.0:1762166820.087083:0:5756:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440879320372ns, next at 435656221086ns, rc = 0 00000001:00080000:0.0:1762166820.104437:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969070 is committed 00000004:00080000:0.0:1762166820.104466:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 110 committed 00000004:00080000:0.0:1762166820.104478:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 109 committed 00000004:00080000:0.0:1762166820.104483:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 113 committed 00000004:00080000:0.0:1762166820.104499:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 112 committed 00000100:00100000:0.0:1762166820.104561:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451929728:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166820.104576:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451929856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166820.104639:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166820.104640:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c864 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dc8 expref: 18 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.104655:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:3.0:1762166820.104658:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:2.0:1762166820.104736:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451929984:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166820.104808:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166820.104833:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1762166820.104838:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c85d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dc8 expref: 18 pid: 5756 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1762166820.104841:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451930112:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762166820.104870:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c864 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dc8 expref: 17 pid: 5756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.104871:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166820.104907:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:3.0:1762166820.104910:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762166820.104913:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687c00, rc 0) 00000100:00100000:0.0:1762166820.104944:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451929856 00000100:00100000:0.0:1762166820.104952:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451929856 00000100:00100000:3.0:1762166820.104985:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:45264:x1847765444318208:12345-192.168.203.35@tcp:101:dd.0 Request processed in 18652us (18807us total) trans 4294969070 rc 0/0 00000100:00100000:0.0:1762166820.104993:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451929984 00000100:00100000:3.0:1762166820.104997:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2617 00000100:00100000:0.0:1762166820.104998:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451929984 00000100:00100000:0.0:1762166820.105018:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451930112 00000100:00100000:0.0:1762166820.105021:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451930112 00000100:00100000:0.0:1762166820.105050:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:3.0:1762166820.105058:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:0.0:1762166820.105062:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765451929856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166820.105072:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765451929984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762166820.105288:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1762166820.105292:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00002000:00010000:0.0:1762166820.105295:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166820.105298:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb ctime from disk: 1762166820 -> 1762166820 00002000:00010000:0.0:1762166820.105301:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb blocks from disk: 4181 -> 4181 00000100:00100000:3.0:1762166820.105317:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765451929984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 248us (507us total) trans 21474836735 rc 0/0 00000100:00100000:3.0:1762166820.105327:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00100000:0.0:1762166820.105344:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765451929856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 285us (704us total) trans 17179869408 rc 0/0 00000100:00100000:3.0:1762166820.105348:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:0.0:1762166820.105358:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:3.0:1762166820.105363:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765451930112:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762166820.105405:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb4a80/2, rc 0, transno 17179869408 00000100:00100000:0.0:1762166820.105413:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451929856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166820.105426:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166820.105451:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451929728 00000100:00100000:0.0:1762166820.105454:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451929728 00000100:00100000:0.0:1762166820.105475:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:0.0:1762166820.105482:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765451929728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166820.105494:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765451930112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 135us (622us total) trans 21474836736 rc 0/0 00000100:00100000:3.0:1762166820.105502:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000004:00080000:3.0:1762166820.105538:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435aa680/2, rc 0, transno 21474836736 00000100:00100000:3.0:1762166820.105544:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451930112:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762166820.105556:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a9880/2, rc 0, transno 21474836735 00000100:00100000:3.0:1762166820.105561:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451929984:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762166820.105581:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1762166820.105585:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00002000:00010000:0.0:1762166820.105587:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166820.105589:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb ctime from disk: 1762166820 -> 1762166820 00002000:00010000:0.0:1762166820.105591:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb blocks from disk: 2051 -> 2051 00000100:00100000:0.0:1762166820.105637:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765451929728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 155us (209us total) trans 17179869409 rc 0/0 00000100:00100000:0.0:1762166820.105643:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000004:00080000:3.0:1762166820.105881:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f2d3480/2, rc 0, transno 17179869409 00000100:00100000:3.0:1762166820.105887:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451929728:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166820.108069:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.108126:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444318336 00000100:00100000:3.0:1762166820.108133:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444318336 00000100:00100000:3.0:1762166820.108183:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 936 00000100:00100000:3.0:1762166820.108192:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:45264:x1847765444318336:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166820.108203:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166820.108222:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c86b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90dcf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166820.108242:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x64:0x0] initial LVB size: 2097152, mtime: 0x69088824, atime: 0x69088824, ctime: 0x69088824, blocks: 0x1 00010000:00010000:3.0:1762166820.108259:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.108262:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.108270:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c86b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dcf expref: 16 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.108284:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c86b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dcf expref: 16 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.108315:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee243445000, rc 0) 00000100:00100000:3.0:1762166820.108369:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:45264:x1847765444318336:12345-192.168.203.35@tcp:101:dd.0 Request processed in 178us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166820.108375:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 936 00000100:00100000:2.0:1762166820.109882:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.109961:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444318464 00000100:00100000:0.0:1762166820.109968:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444318464 00000100:00100000:0.0:1762166820.110009:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 937 00000100:00100000:0.0:1762166820.110018:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:45264:x1847765444318464:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:0.0:1762166820.110030:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.110045:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c872 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90dd6 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166820.110062:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x65:0x0] initial LVB size: 3145728, mtime: 0x69088824, atime: 0x69088824, ctime: 0x69088824, blocks: 0x1 00010000:00010000:0.0:1762166820.110078:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.110080:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.110087:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c872 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dd6 expref: 17 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.110101:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c872 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dd6 expref: 17 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.110120:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687800, rc 0) 00000100:00100000:0.0:1762166820.110165:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:45264:x1847765444318464:12345-192.168.203.35@tcp:101:dd.0 Request processed in 148us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.110184:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 937 00000100:00100000:1.0:1762166820.111413:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166820.111453:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.111483:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444318720 00000100:00100000:2.0:1762166820.111490:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444318720 00002000:00010000:2.0:1762166820.111522:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/101 (0->18446744073709551615) 00002000:00100000:2.0:1762166820.111527:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb4380 with x1847765444318720 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166820.111535:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444318592 00002000:00010000:2.0:1762166820.111535:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb4380. 00000100:00100000:3.0:1762166820.111541:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444318592 00002000:00010000:3.0:1762166820.111563:0:26247:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/100 (0->18446744073709551615) 00002000:00100000:3.0:1762166820.111568:0:26247:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb7480 with x1847765444318592 ext(0->18446744073709551615) 00000100:00100000:2.0:1762166820.111571:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 946 00002000:00010000:3.0:1762166820.111577:0:26247:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb7480. 00000100:00100000:3.0:1762166820.111629:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 947 00000100:00100000:3.0:1762166820.111640:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444318592:12345-192.168.203.35@tcp:10:dd.0 00000100:00100000:2.0:1762166820.111672:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765444318720:12345-192.168.203.35@tcp:10:dd.0 00002000:00010000:3.0:1762166820.112430:0:26247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb size from disk: 2097152 -> 0 00002000:00010000:3.0:1762166820.112435:0:26247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00002000:00010000:3.0:1762166820.112438:0:26247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb atime from disk: 1762166820 -> 1762166820 00002000:00010000:3.0:1762166820.112442:0:26247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb ctime from disk: 1762166820 -> 1762166820 00002000:00010000:3.0:1762166820.112445:0:26247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762166820.112506:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765444318592:12345-192.168.203.35@tcp:10:dd.0 Request processed in 867us (1051us total) trans 21474836737 rc 0/0 00000100:00100000:3.0:1762166820.112516:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 947 00002000:00010000:3.0:1762166820.112520:0:26247:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/100 (0->18446744073709551615) 00002000:00100000:3.0:1762166820.112524:0:26247:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb7480 with x1847765444318592 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166820.112530:0:26247:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb7480. 00002000:00010000:2.0:1762166820.113497:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb size from disk: 3145728 -> 0 00002000:00010000:2.0:1762166820.113502:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00002000:00010000:2.0:1762166820.113505:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb atime from disk: 1762166820 -> 1762166820 00002000:00010000:2.0:1762166820.113507:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb ctime from disk: 1762166820 -> 1762166820 00002000:00010000:2.0:1762166820.113509:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166820.113538:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765444318720:12345-192.168.203.35@tcp:10:dd.0 Request processed in 1948us (2127us total) trans 21474836738 rc 0/0 00000100:00100000:2.0:1762166820.113546:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 946 00002000:00010000:2.0:1762166820.113549:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/101 (0->18446744073709551615) 00002000:00100000:2.0:1762166820.113552:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb4380 with x1847765444318720 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166820.113557:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb4380. 00000100:00100000:1.0:1762166820.136037:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.136242:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444318848 00000100:00100000:3.0:1762166820.136254:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444318848 00002000:00100000:3.0:1762166820.136309:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x64:0x0] (0->1048575) req@ffff9ee37fcb6680 x1847765444318848/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:606/0 lens 488/0 e 0 to 0 dl 1762166831 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166820.136321:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb6680 with x1847765444318848 ext(0->1048575) 00002000:00010000:3.0:1762166820.136326:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb6680 00000100:00100000:3.0:1762166820.136366:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 948 00000100:00100000:3.0:1762166820.136380:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765444318848:12345-192.168.203.35@tcp:4:dd.0 00000100:00100000:3.0:1762166820.142390:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765444318848:12345-192.168.203.35@tcp:4:dd.0 Request processed in 6005us (6353us total) trans 21474836739 rc 0/0 00000100:00100000:3.0:1762166820.142403:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 948 00002000:00100000:3.0:1762166820.142418:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x64:0x0] (0->1048575) req@ffff9ee37fcb6680 x1847765444318848/t21474836739(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:606/0 lens 488/448 e 0 to 0 dl 1762166831 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166820.142428:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb6680 with x1847765444318848 ext(0->1048575) 00002000:00010000:3.0:1762166820.142435:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb6680 00000100:00100000:1.0:1762166820.164397:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.164462:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444318976 00000100:00100000:3.0:1762166820.164473:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444318976 00002000:00100000:3.0:1762166820.164520:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x64:0x0] (1048576->2097151) req@ffff9ee37fcb5500 x1847765444318976/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:606/0 lens 488/0 e 0 to 0 dl 1762166831 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166820.164530:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb5500 with x1847765444318976 ext(1048576->2097151) 00002000:00010000:3.0:1762166820.164537:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb5500 00000100:00100000:3.0:1762166820.164571:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 949 00000100:00100000:3.0:1762166820.164582:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765444318976:12345-192.168.203.35@tcp:4:dd.0 00000100:00100000:3.0:1762166820.170660:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2359:x1847765444318976:12345-192.168.203.35@tcp:4:dd.0 Request processed in 6069us (6262us total) trans 21474836740 rc 0/0 00000100:00100000:3.0:1762166820.170674:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 949 00002000:00100000:3.0:1762166820.170706:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x64:0x0] (1048576->2097151) req@ffff9ee37fcb5500 x1847765444318976/t21474836740(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:606/0 lens 488/448 e 0 to 0 dl 1762166831 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166820.170717:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb5500 with x1847765444318976 ext(1048576->2097151) 00002000:00010000:3.0:1762166820.170723:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb5500 00000100:00100000:0.0:1762166820.185215:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.185261:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.185470:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444319104 00000100:00100000:3.0:1762166820.185480:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444319104 00002000:00100000:3.0:1762166820.185526:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x65:0x0] (2097152->3145727) req@ffff9ee242cea680 x1847765444319104/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:606/0 lens 488/0 e 0 to 0 dl 1762166831 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166820.185536:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242cea680 with x1847765444319104 ext(2097152->3145727) 00002000:00010000:3.0:1762166820.185542:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242cea680 00000100:00100000:3.0:1762166820.185579:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 950 00000100:00100000:3.0:1762166820.185587:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444319104:12345-192.168.203.35@tcp:4:dd.0 00000100:00100000:1.0:1762166820.186623:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444319360 00000100:00100000:1.0:1762166820.186630:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444319360 00000100:00100000:1.0:1762166820.186672:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 802 00000100:00100000:1.0:1762166820.186688:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:45264:x1847765444319360:12345-192.168.203.35@tcp:35:dd.0 00000100:00100000:1.0:1762166820.187030:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:45264:x1847765444319360:12345-192.168.203.35@tcp:35:dd.0 Request processed in 350us (1767us total) trans 4294969071 rc 0/0 00000100:00100000:1.0:1762166820.187037:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 802 00000100:00100000:2.0:1762166820.196758:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444319104:12345-192.168.203.35@tcp:4:dd.0 Request processed in 11162us (11542us total) trans 21474836741 rc 0/0 00000100:00100000:2.0:1762166820.196798:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 950 00002000:00100000:2.0:1762166820.196812:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x65:0x0] (2097152->3145727) req@ffff9ee242cea680 x1847765444319104/t21474836741(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:606/0 lens 488/448 e 0 to 0 dl 1762166831 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166820.196823:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242cea680 with x1847765444319104 ext(2097152->3145727) 00002000:00010000:2.0:1762166820.196829:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242cea680 00010000:00010000:0.0:1762166820.200047:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166820.200625:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.200702:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444319488 00000100:00100000:3.0:1762166820.200716:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444319488 00000100:00100000:3.0:1762166820.200807:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2618 00000100:00100000:3.0:1762166820.200817:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:45265:x1847765444319488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166820.200840:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166820.200861:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c879 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ddd expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.200968:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686200/0xf915a5bdf3c9c880 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.200983:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686200/0xf915a5bdf3c9c880 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.200994:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686200/0xf915a5bdf3c9c880 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:0.0:1762166820.201054:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:0.0:1762166820.201058:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166820.201079:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686200/0xf915a5bdf3c9c880 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.201107:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445e00/0xf915a5bdf3c9c879 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ddd expref: 20 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.201123:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686200/0xf915a5bdf3c9c880 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ddd expref: 19 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.201131:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:0.0:1762166820.201134:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166820.201141:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686200, rc 0) 00000100:00100000:0.0:1762166820.201195:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45265:x1847765444319488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 379us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.201203:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2618 00000100:00100000:0.0:1762166820.202586:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.202647:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444319616 00000100:00100000:2.0:1762166820.202666:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444319616 00000100:00100000:2.0:1762166820.202745:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2619 00000100:00100000:2.0:1762166820.202755:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45265:x1847765444319616:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166820.202791:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166820.202814:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341672600/0xf915a5bdf3c9c887 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90de4 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.202873:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c88e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.202885:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c88e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.202899:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c88e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.202914:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673c00/0xf915a5bdf3c9c895 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.202920:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673c00/0xf915a5bdf3c9c895 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.202935:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673c00/0xf915a5bdf3c9c895 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203027:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673200/0xf915a5bdf3c9c89c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203037:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673200/0xf915a5bdf3c9c89c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203043:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673200/0xf915a5bdf3c9c89c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:2.0:1762166820.203070:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00000004:00200000:2.0:1762166820.203074:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166820.203086:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673200/0xf915a5bdf3c9c89c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203096:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673200/0xf915a5bdf3c9c89c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203110:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c88e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203117:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c88e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203123:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c88e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203128:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee341672a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166820.203132:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c88e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203144:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c88e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203155:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:2.0:1762166820.203158:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166820.203162:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c88e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203168:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c88e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203179:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673c00/0xf915a5bdf3c9c895 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203185:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673c00/0xf915a5bdf3c9c895 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203190:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673c00/0xf915a5bdf3c9c895 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203195:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee341673c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166820.203203:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673c00/0xf915a5bdf3c9c895 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203209:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673c00/0xf915a5bdf3c9c895 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203216:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee360714d00) 00010000:00010000:2.0:1762166820.203218:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166820.203220:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673c00/0xf915a5bdf3c9c895 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203223:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673c00/0xf915a5bdf3c9c895 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.203253:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341672600/0xf915a5bdf3c9c887 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90de4 expref: 21 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.203261:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673200/0xf915a5bdf3c9c89c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90de4 expref: 20 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.203265:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:2.0:1762166820.203267:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166820.203268:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee341673200, rc 0) 00000100:00100000:2.0:1762166820.203309:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:45265:x1847765444319616:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 558us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166820.203314:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2619 00000100:00100000:2.0:1762166820.205968:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.206067:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444319872 00000100:00100000:0.0:1762166820.206076:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444319872 00000100:00100000:0.0:1762166820.206130:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2620 00000100:00100000:0.0:1762166820.206141:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:45265:x1847765444319872:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.206161:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.206179:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c8a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90deb expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.206266:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c8aa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.206279:0:5756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673200/0xf915a5bdf3c9c89c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90de4 expref: 21 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.206287:0:5756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c8aa lrc: 4/0,1 mode: --/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.206319:0:5756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673200/0xf915a5bdf3c9c89c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90de4 expref: 21 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.206332:0:5756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673200/0xf915a5bdf3c9c89c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90de4 expref: 21 pid: 5756 timeout: 540 lvb_type: 0 00000100:00100000:0.0:1762166820.206344:0:5756:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1847765451930240:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166820.207029:0:5756:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720b40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166820.208816:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.208821:0:5756:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1847765451930240:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166820.208844:0:5756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c8aa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:2.0:1762166820.208955:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444320000 00000100:00100000:2.0:1762166820.208962:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444320000 00010000:00010000:2.0:1762166820.208996:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673200/0xf915a5bdf3c9c89c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90de4 expref: 22 pid: 5756 timeout: 540 lvb_type: 0 00000100:00100000:2.0:1762166820.209047:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 577 00000100:00100000:2.0:1762166820.209056:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444320000:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166820.209070:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166820.209077:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673200/0xf915a5bdf3c9c89c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90de4 expref: 22 pid: 5756 timeout: 540 lvb_type: 0 00010000:00010000:2.0:1762166820.209088:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673200/0xf915a5bdf3c9c89c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90de4 expref: 22 pid: 5756 timeout: 540 lvb_type: 0 00010000:00010000:2.0:1762166820.209109:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee341673200/0xf915a5bdf3c9c89c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90de4 expref: 22 pid: 5756 timeout: 540 lvb_type: 0 00010000:00010000:2.0:1762166820.209123:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:2.0:1762166820.209127:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c8aa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.209135:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c8aa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.209142:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c8aa lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.209172:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166820.209219:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765444320000:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 164us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166820.209227:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 577 00010000:00010000:0.0:1762166820.209279:0:5756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c8aa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.209287:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c8aa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:0.0:1762166820.209303:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00010000:00010000:0.0:1762166820.209437:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c8a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90deb expref: 22 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.209452:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c8aa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90deb expref: 21 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.209459:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.209462:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166820.209465:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687a00, rc 0) 00000100:00100000:0.0:1762166820.209504:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:45265:x1847765444319872:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3365us (3543us total) trans 4294969072 rc 0/0 00000100:00100000:0.0:1762166820.209512:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2620 00000100:00100000:1.0:1762166820.211282:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.211408:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444320128 00000100:00100000:0.0:1762166820.211415:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444320128 00000100:00100000:0.0:1762166820.211463:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2621 00000100:00100000:0.0:1762166820.211471:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:45265:x1847765444320128:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.211490:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.211507:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8b8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90df2 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.211583:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c8bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.211607:0:5756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c8aa lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90deb expref: 22 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.211615:0:5756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c8bf lrc: 4/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.211645:0:5756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c8aa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90deb expref: 22 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.211671:0:5756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c8aa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90deb expref: 22 pid: 5756 timeout: 541 lvb_type: 0 00000100:00100000:0.0:1762166820.211693:0:5756:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1847765451930368:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166820.211806:0:5756:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720b40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166820.213648:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.213701:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444320256 00000100:00100000:2.0:1762166820.213710:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444320256 00000100:00100000:0.0:1762166820.213736:0:5756:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1847765451930368:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166820.213757:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c8aa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90deb expref: 23 pid: 5756 timeout: 541 lvb_type: 0 00010000:00010000:0.0:1762166820.213759:0:5756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c8bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:2.0:1762166820.213814:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 578 00000100:00100000:2.0:1762166820.213823:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444320256:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166820.213835:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166820.213840:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c8aa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90deb expref: 23 pid: 5756 timeout: 541 lvb_type: 0 00010000:00010000:2.0:1762166820.213851:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c8aa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90deb expref: 23 pid: 5756 timeout: 541 lvb_type: 0 00010000:00010000:2.0:1762166820.213871:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c8aa lrc: 0/0,0 mode: --/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90deb expref: 23 pid: 5756 timeout: 541 lvb_type: 0 00010000:00010000:2.0:1762166820.213886:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:2.0:1762166820.213890:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c8bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.213899:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c8bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.213906:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c8bf lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.213930:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166820.213960:0:5756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c8bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.213970:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c8bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:2.0:1762166820.213985:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444320256:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 161us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166820.213994:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 578 00000004:00200000:0.0:1762166820.214005:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00000004:00200000:0.0:1762166820.214010:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166820.214027:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c8bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.214056:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8b8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90df2 expref: 22 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.214079:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c8bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90df2 expref: 21 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.214086:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.214089:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166820.214092:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687200, rc 0) 00000100:00100000:0.0:1762166820.214130:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:45265:x1847765444320128:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2660us (2854us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.214137:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2621 00000100:00100000:1.0:1762166820.215837:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.215882:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444320512 00000100:00100000:0.0:1762166820.215890:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444320512 00000100:00100000:0.0:1762166820.215939:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 803 00000100:00100000:0.0:1762166820.215949:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:45265:x1847765444320512:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166820.216133:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45265:x1847765444320512:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 185us (300us total) trans 4294969073 rc 0/0 00000100:00100000:0.0:1762166820.216140:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 803 00000100:00100000:2.0:1762166820.226533:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.226618:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444320768 00000100:00100000:0.0:1762166820.226627:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444320768 00000100:00100000:0.0:1762166820.226699:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2622 00000100:00100000:0.0:1762166820.226709:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45267:x1847765444320768:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.226732:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.226750:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c8c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90df9 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.226850:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c8cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.226869:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c8cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.226891:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c8cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.226905:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c8d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.226911:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.226916:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.227016:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c8cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.227023:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c8cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.227029:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c8cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.227034:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.227038:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c8cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.227044:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c8cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.227055:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:0.0:1762166820.227058:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.227068:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c8cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.227073:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c8cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.227086:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.227092:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c8d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.227097:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c8d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.227109:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.227112:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c8d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.227118:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c8d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.227124:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee36062b700) 00010000:00010000:0.0:1762166820.227127:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.227129:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c8d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.227134:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c8d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.227172:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c8c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90df9 expref: 23 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.227182:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:0.0:1762166820.227189:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166820.227194:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c8c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90df9 expref: 23 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.227203:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686000, rc 0) 00000100:00100000:0.0:1762166820.227262:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45267:x1847765444320768:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 555us (737us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166820.227269:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2622 00000100:00100000:1.0:1762166820.228874:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.228946:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444320896 00000100:00100000:0.0:1762166820.228952:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444320896 00000100:00100000:0.0:1762166820.228992:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2623 00000100:00100000:0.0:1762166820.229001:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45267:x1847765444320896:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166820.229050:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229066:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229076:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229088:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229095:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229101:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229167:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c8e9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229182:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229187:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:0.0:1762166820.229212:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00000004:00200000:0.0:1762166820.229215:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166820.229223:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229230:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229234:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229238:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229241:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.229244:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229250:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229258:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:0.0:1762166820.229261:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.229265:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229270:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229287:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229293:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229298:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229303:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.229306:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229311:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229317:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee36062b300) 00010000:00010000:0.0:1762166820.229320:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.229323:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229327:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229342:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229347:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c8e9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229352:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c8e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229355:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.229362:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c8e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229365:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c8e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229371:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.229372:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.229374:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c8e9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.229377:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c8e9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000100:00100000:0.0:1762166820.229426:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45267:x1847765444320896:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 426us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.229430:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2623 00000100:00100000:1.0:1762166820.242915:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.242970:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444321152 00000100:00100000:0.0:1762166820.242981:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444321152 00000100:00100000:0.0:1762166820.243030:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2624 00000100:00100000:0.0:1762166820.243041:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45270:x1847765444321152:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.243061:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.243081:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c8f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e00 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.243161:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243174:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243185:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243211:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243218:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243224:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243333:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243343:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243356:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243364:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.243368:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243375:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243387:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:0.0:1762166820.243390:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.243395:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243400:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c8f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243411:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243422:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243427:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243431:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.243434:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243439:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243446:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee36062b300) 00010000:00010000:0.0:1762166820.243449:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.243451:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243456:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c8fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.243486:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c8f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e00 expref: 23 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.243496:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:0.0:1762166820.243498:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166820.243501:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c8f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e00 expref: 23 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.243509:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686600, rc 0) 00000100:00100000:0.0:1762166820.243566:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45270:x1847765444321152:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 527us (659us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166820.243578:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2624 00000100:00100000:2.0:1762166820.245154:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.245194:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444321280 00000100:00100000:0.0:1762166820.245202:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444321280 00000100:00100000:0.0:1762166820.245242:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2625 00000100:00100000:0.0:1762166820.245250:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45270:x1847765444321280:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166820.245314:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c905 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245326:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c905 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245334:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c905 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245345:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c90c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245351:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c90c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245356:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c90c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245429:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c913 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245437:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c913 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245442:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c913 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:0.0:1762166820.245471:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00000004:00200000:0.0:1762166820.245481:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166820.245492:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c913 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245503:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c905 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245509:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c905 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245514:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c905 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245519:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.245522:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c905 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245528:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c905 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245537:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:0.0:1762166820.245540:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.245543:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c905 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245549:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c905 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245560:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c90c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245565:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c90c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245570:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c90c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245579:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.245582:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c90c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245587:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c90c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245594:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee36062b700) 00010000:00010000:0.0:1762166820.245596:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.245599:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c90c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245604:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c90c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245618:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c913 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245624:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c913 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245629:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c913 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245633:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.245635:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c913 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245640:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c913 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245646:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.245648:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.245655:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c913 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.245673:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c913 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000100:00100000:0.0:1762166820.245740:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45270:x1847765444321280:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 490us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.245748:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2625 00000100:00100000:1.0:1762166820.292847:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.293038:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444321536 00000100:00100000:0.0:1762166820.293049:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444321536 00000100:00100000:0.0:1762166820.293116:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2626 00000100:00100000:0.0:1762166820.293126:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45285:x1847765444321536:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.293145:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.293164:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c91a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e07 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.293232:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c921 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293246:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c921 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293258:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c921 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293272:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c928 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293284:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293290:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293441:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c92f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293450:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c92f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293457:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c92f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:0.0:1762166820.293467:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00010000:00010000:0.0:1762166820.293550:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c921 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293556:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c921 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293560:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c921 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293564:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.293566:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c921 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293571:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c921 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293579:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:0.0:1762166820.293580:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.293584:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c921 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293587:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c921 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293605:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293611:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c928 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293616:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c928 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293620:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.293623:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c928 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293628:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c928 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293635:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee36062b700) 00010000:00010000:0.0:1762166820.293638:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.293640:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c928 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293646:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c928 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.293699:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c91a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e07 expref: 25 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.293712:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c92f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e07 expref: 24 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.293719:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.293731:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166820.293735:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686600, rc 0) 00000100:00100000:0.0:1762166820.293837:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:45285:x1847765444321536:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 713us (998us total) trans 4294969074 rc 0/0 00000100:00100000:0.0:1762166820.293845:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2626 00000100:00100000:1.0:1762166820.296799:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.296887:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444321664 00000100:00100000:2.0:1762166820.296897:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444321664 00000100:00100000:2.0:1762166820.296972:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 269 00000100:00100000:2.0:1762166820.296983:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444321664:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166820.296999:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166820.297029:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c92f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e07 expref: 24 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.297048:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:2.0:1762166820.297053:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166820.297117:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444321664:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 135us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166820.297134:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 269 00000100:00100000:1.0:1762166820.322189:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166820.322245:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166820.322291:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.322355:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444321792 00000100:00100000:2.0:1762166820.322374:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444321792 00000100:00100000:0.0:1762166820.322385:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444321920 00000100:00100000:0.0:1762166820.322396:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444321920 00000100:00100000:3.0:1762166820.322432:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444322048 00000100:00100000:3.0:1762166820.322438:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444322048 00000100:00100000:0.0:1762166820.322472:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 951 00000100:00100000:0.0:1762166820.322488:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444321920:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762166820.322524:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c93d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.322543:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c86b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dcf expref: 26 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.322551:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166820.322553:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166820.322557:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c93d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.322589:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c86b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000080000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dcf expref: 26 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.322603:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c86b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dcf expref: 26 pid: 6532 timeout: 541 lvb_type: 0 00000100:00100000:0.0:1762166820.322619:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765451930496:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166820.322700:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166820.322705:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 952 00000100:00100000:3.0:1762166820.322718:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444322048:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762166820.322737:0:26247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c944 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.322757:0:26247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c872 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dd6 expref: 26 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.322798:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166820.322801:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166820.322804:0:26247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c944 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.322828:0:26247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c872 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dd6 expref: 27 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.322838:0:26247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dd6 expref: 27 pid: 6535 timeout: 541 lvb_type: 0 00000100:00100000:2.0:1762166820.322848:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 953 00000100:00100000:2.0:1762166820.322861:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444321792:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:3.0:1762166820.322868:0:26247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242523100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_015:lustre-OST0000_UUID:26247:1847765451930624:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166820.322880:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c94b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.322891:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166820.322893:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166820.322896:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c94b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166820.322905:0:26247:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3471743c0 going to sleep for 11 seconds 00010000:00010000:2.0:1762166820.322905:0:14122:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c94b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166820.326949:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.327013:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.327023:0:26247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242523100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_015:lustre-OST0000_UUID:26247:1847765451930624:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166820.327045:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444322304 00000100:00100000:1.0:1762166820.327054:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444322304 00000100:00100000:3.0:1762166820.327099:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444322176 00010000:00010000:1.0:1762166820.327102:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c86b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dcf expref: 28 pid: 6532 timeout: 541 lvb_type: 0 00000100:00100000:0.0:1762166820.327107:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765451930496:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166820.327110:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444322176 00010000:00010000:0.0:1762166820.327139:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c93d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.327149:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dd6 expref: 29 pid: 6535 timeout: 541 lvb_type: 0 00000100:00100000:1.0:1762166820.327157:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 579 00000100:00100000:1.0:1762166820.327179:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444322304:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166820.327196:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166820.327203:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 580 00002000:00010000:1.0:1762166820.327215:0:7415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb size from disk: 0 -> 2097152 00010000:00010000:2.0:1762166820.327216:0:26247:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c944 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166820.327228:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3456e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444322176:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166820.327229:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c86b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dcf expref: 29 pid: 6532 timeout: 541 lvb_type: 0 00010000:00010000:1.0:1762166820.327255:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c86b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dcf expref: 29 pid: 6532 timeout: 541 lvb_type: 0 00010000:00010000:3.0:1762166820.327256:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166820.327283:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee243445000/0xf915a5bdf3c9c86b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dcf expref: 29 pid: 6532 timeout: 541 lvb_type: 0 00002000:00010000:3.0:1762166820.327294:0:5741:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb size from disk: 0 -> 3145728 00010000:00010000:1.0:1762166820.327302:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.327305:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dd6 expref: 28 pid: 6535 timeout: 541 lvb_type: 0 00010000:00010000:1.0:1762166820.327307:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166820.327314:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c93d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.327330:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c872 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dd6 expref: 28 pid: 6535 timeout: 541 lvb_type: 0 00010000:00010000:1.0:1762166820.327331:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c93d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.327371:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166820.327388:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.327393:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c872 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dd6 expref: 28 pid: 6535 timeout: 541 lvb_type: 0 00010000:00010000:1.0:1762166820.327395:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c94b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.327435:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c94b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.327440:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.327445:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.327450:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c944 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.327461:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c944 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.327487:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166820.327490:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166820.327559:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3456e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444322176:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 346us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166820.327569:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 580 00010000:00010000:0.0:1762166820.327799:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c93d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.327811:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c93d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.327902:0:26247:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c944 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.327919:0:26247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c944 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166820.328892:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444322304:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1714us (1953us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166820.328904:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 579 00010000:00010000:1.0:1762166820.328981:0:14122:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c94b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.328992:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c94b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.337197:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c94b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.337221:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c94b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.337232:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c94b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.337240:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee341672a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166820.337245:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c94b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.337277:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c94b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.337301:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c94b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.337310:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee341672a00/0xf915a5bdf3c9c94b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166820.337408:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444321792:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 14543us (15222us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1762166820.337420:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 953 00010000:00010000:0.0:1762166820.340442:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c93d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.340478:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c93d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.340487:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c93d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.340494:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166820.340499:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c93d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.340507:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c93d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.340528:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c93d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.340554:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c93d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166820.340656:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444321920:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 18165us (18405us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1762166820.340667:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 951 00010000:00010000:2.0:1762166820.341471:0:26247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c944 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.341483:0:26247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c944 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.341491:0:26247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c944 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.341497:0:26247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee243444400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166820.341501:0:26247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c944 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.341508:0:26247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c944 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.341533:0:26247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c944 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.341540:0:26247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee243444400/0xf915a5bdf3c9c944 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.341608:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444322048:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 18893us (19315us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1762166820.341616:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 952 00000100:00100000:1.0:1762166820.346630:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.346720:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444322432 00000100:00100000:0.0:1762166820.346730:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444322432 00000100:00100000:0.0:1762166820.346795:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 938 00000100:00100000:0.0:1762166820.346805:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444322432:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.346824:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.346844:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c952 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e0e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166820.346866:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x64:0x0] initial LVB size: 2097152, mtime: 0x69088824, atime: 0x69088824, ctime: 0x69088824, blocks: 0x1 00010000:00010000:0.0:1762166820.346884:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.346886:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.346895:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c952 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e0e expref: 24 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166820.346912:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c952 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e0e expref: 24 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166820.346924:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687400, rc 0) 00000100:00100000:0.0:1762166820.346987:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444322432:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 182us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.347009:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 938 00000100:00100000:2.0:1762166820.347246:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.347439:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444322560 00000100:00100000:3.0:1762166820.347447:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444322560 00000100:00100000:0.0:1762166820.348087:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 939 00000100:00100000:0.0:1762166820.348101:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444322560:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.348119:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.348141:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c959 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e15 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166820.348166:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x65:0x0] initial LVB size: 3145728, mtime: 0x69088824, atime: 0x69088824, ctime: 0x69088824, blocks: 0x1 00010000:00010000:0.0:1762166820.348187:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.348190:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.348200:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c959 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e15 expref: 25 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166820.348215:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c959 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e15 expref: 25 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166820.348233:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686000, rc 0) 00000100:00100000:0.0:1762166820.348285:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765444322560:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 187us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.348295:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 939 00000100:00100000:2.0:1762166820.369009:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.369109:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444322816 00000100:00100000:0.0:1762166820.369124:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444322816 00000100:00100000:0.0:1762166820.369201:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 804 00000100:00100000:0.0:1762166820.369212:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:45285:x1847765444322816:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166820.369556:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:45285:x1847765444322816:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 344us (560us total) trans 4294969075 rc 0/0 00000100:00100000:0.0:1762166820.369585:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 804 00000100:00100000:1.0:1762166820.380164:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.380273:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444323072 00000100:00100000:0.0:1762166820.380292:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444323072 00000100:00100000:0.0:1762166820.380381:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2627 00000100:00100000:0.0:1762166820.380395:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:45288:x1847765444323072:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.380427:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.380453:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c960 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e1c expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.380589:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c967 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.380612:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c967 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.380624:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c967 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:0.0:1762166820.380639:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00010000:00010000:0.0:1762166820.380849:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c960 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e1c expref: 27 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.380877:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c967 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e1c expref: 26 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.380886:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.380890:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166820.380894:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686a00, rc 0) 00000100:00100000:0.0:1762166820.380999:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:45288:x1847765444323072:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 606us (842us total) trans 4294969076 rc 0/0 00000100:00100000:0.0:1762166820.381031:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2627 00000100:00100000:1.0:1762166820.407430:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.407522:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444323200 00000100:00100000:2.0:1762166820.407536:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444323200 00000100:00100000:2.0:1762166820.407614:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 954 00000100:00100000:2.0:1762166820.407626:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2361:x1847765444323200:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762166820.407661:0:26247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee341672400/0xf915a5bdf3c9c975 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.407692:0:26247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d9e expref: 9 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.407701:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166820.407704:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166820.407707:0:26247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee341672400/0xf915a5bdf3c9c975 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.407743:0:26247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d9e expref: 9 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.407820:0:26247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d9e expref: 9 pid: 12402 timeout: 541 lvb_type: 0 00000100:00100000:2.0:1762166820.407843:0:26247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_015:lustre-OST0001_UUID:26247:1847765451930752:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166820.407910:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.407939:0:26247:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e39dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166820.407996:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444323328 00000100:00100000:0.0:1762166820.408002:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444323328 00000100:00100000:0.0:1762166820.408042:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 955 00000100:00100000:0.0:1762166820.408052:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2360:x1847765444323328:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762166820.408070:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c97c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.408082:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c7d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90da5 expref: 10 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.408090:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166820.408091:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166820.408094:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c97c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.408115:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c7d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90da5 expref: 10 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.408126:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c7d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90da5 expref: 10 pid: 12402 timeout: 541 lvb_type: 0 00000100:00100000:0.0:1762166820.408136:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765451930880:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166820.408154:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.408181:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720b40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166820.408184:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444323456 00000100:00100000:1.0:1762166820.408190:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444323456 00000100:00100000:1.0:1762166820.408233:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 956 00000100:00100000:1.0:1762166820.408243:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444323456:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762166820.408255:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9c983 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.408262:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166820.408264:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166820.408266:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9c983 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.408280:0:14122:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9c983 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.408895:0:26247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_015:lustre-OST0001_UUID:26247:1847765451930752:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166820.408914:0:26247:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee341672400/0xf915a5bdf3c9c975 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.409121:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.409141:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765451930880:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166820.409159:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c97c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.409162:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166820.409212:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444323584 00000100:00100000:1.0:1762166820.409218:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444323584 00010000:00010000:1.0:1762166820.409248:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d9e expref: 12 pid: 12402 timeout: 541 lvb_type: 0 00000100:00100000:3.0:1762166820.409255:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444323712 00000100:00100000:3.0:1762166820.409260:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444323712 00010000:00010000:3.0:1762166820.409275:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c7d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90da5 expref: 13 pid: 12402 timeout: 541 lvb_type: 0 00000100:00100000:1.0:1762166820.409285:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 581 00000100:00100000:1.0:1762166820.409297:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444323584:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166820.409309:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166820.409329:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d9e expref: 13 pid: 12402 timeout: 541 lvb_type: 0 00000100:00100000:3.0:1762166820.409340:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 582 00010000:00010000:1.0:1762166820.409345:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d9e expref: 13 pid: 12402 timeout: 541 lvb_type: 0 00000100:00100000:3.0:1762166820.409358:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444323712:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166820.409368:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166820.409371:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee243445800/0xf915a5bdf3c9c7d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90d9e expref: 13 pid: 12402 timeout: 541 lvb_type: 0 00010000:00010000:3.0:1762166820.409382:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c7d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90da5 expref: 12 pid: 12402 timeout: 541 lvb_type: 0 00010000:00010000:1.0:1762166820.409385:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166820.409389:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166820.409395:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee341672400/0xf915a5bdf3c9c975 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.409400:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c7d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90da5 expref: 12 pid: 12402 timeout: 541 lvb_type: 0 00010000:00010000:1.0:1762166820.409411:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee341672400/0xf915a5bdf3c9c975 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.409421:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee243444c00/0xf915a5bdf3c9c7d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90da5 expref: 12 pid: 12402 timeout: 541 lvb_type: 0 00010000:00010000:3.0:1762166820.409435:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.409437:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.409440:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c97c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.409442:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166820.409450:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c97c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.409458:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.409460:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.409465:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9c983 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.409465:0:26247:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee341672400/0xf915a5bdf3c9c975 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166820.409481:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444323584:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 186us (360us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166820.409486:0:26247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee341672400/0xf915a5bdf3c9c975 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.409489:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9c983 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166820.409493:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 581 00010000:00010000:3.0:1762166820.409527:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166820.409529:0:14122:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9c983 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.409538:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9c983 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.409600:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c97c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.409608:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c97c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166820.410218:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444323712:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 862us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166820.410226:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 582 00010000:00010000:2.0:1762166820.414797:0:26247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee341672400/0xf915a5bdf3c9c975 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.414818:0:26247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee341672400/0xf915a5bdf3c9c975 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.414828:0:26247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee341672400/0xf915a5bdf3c9c975 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.414848:0:26247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee341672400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166820.414853:0:26247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee341672400/0xf915a5bdf3c9c975 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.414863:0:26247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee341672400/0xf915a5bdf3c9c975 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.414880:0:26247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee341672400/0xf915a5bdf3c9c975 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.414888:0:26247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee341672400/0xf915a5bdf3c9c975 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.414974:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444323200:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 7346us (7552us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1762166820.414986:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 954 00010000:00010000:1.0:1762166820.416077:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9c983 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.416089:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9c983 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.416095:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9c983 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.416100:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7dc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166820.416103:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9c983 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.416108:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9c983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.416122:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9c983 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.416138:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9c983 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166820.416225:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2361:x1847765444323456:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 7981us (8069us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1762166820.416234:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 956 00010000:00010000:0.0:1762166820.418229:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c97c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.418258:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c97c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.418267:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c97c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.418274:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166820.418278:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c97c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.418291:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c97c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.418309:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c97c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.418316:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c97c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166820.418432:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2360:x1847765444323328:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 10377us (10518us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1762166820.418443:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 955 00000100:00100000:2.0:1762166820.421498:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.421616:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444323840 00000100:00100000:0.0:1762166820.421626:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444323840 00000100:00100000:0.0:1762166820.421691:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 940 00000100:00100000:0.0:1762166820.421701:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2360:x1847765444323840:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.421719:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.421740:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c98a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e23 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166820.421784:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x5e:0x0] initial LVB size: 1048576, mtime: 0x69088824, atime: 0x0, ctime: 0x69088824, blocks: 0x803 00010000:00010000:0.0:1762166820.421804:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.421806:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.421815:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c98a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e23 expref: 8 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166820.421831:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c98a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e23 expref: 8 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166820.421844:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687000, rc 0) 00000100:00100000:0.0:1762166820.421959:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444323840:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 258us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166820.421965:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.421966:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 940 00000100:00100000:0.0:1762166820.421983:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444323968 00000100:00100000:0.0:1762166820.421998:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444323968 00000100:00100000:0.0:1762166820.422019:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 941 00000100:00100000:0.0:1762166820.422025:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444323968:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.422032:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.422041:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c991 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e2a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166820.422054:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x5f:0x0] initial LVB size: 3145728, mtime: 0x69088824, atime: 0x0, ctime: 0x69088824, blocks: 0x1055 00010000:00010000:0.0:1762166820.422074:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.422076:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.422081:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c991 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e2a expref: 9 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166820.422093:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c991 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e2a expref: 9 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166820.422101:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686c00, rc 0) 00000100:00100000:0.0:1762166820.422138:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444323968:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 110us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.422144:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 941 00000100:00100000:2.0:1762166820.448948:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.449022:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444324096 00000100:00100000:0.0:1762166820.449033:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444324096 00000100:00100000:0.0:1762166820.449090:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2628 00000100:00100000:0.0:1762166820.449100:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:45290:x1847765444324096:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166820.449175:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c998 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449188:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c998 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449210:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c998 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449221:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c99f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449226:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c99f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449232:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c99f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449496:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c9a6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449505:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449512:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:0.0:1762166820.449545:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00000004:00200000:0.0:1762166820.449550:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166820.449561:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449572:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c998 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449578:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c998 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449584:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c998 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449600:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.449604:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c998 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449611:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c998 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449623:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:0.0:1762166820.449627:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.449631:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c998 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449637:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c998 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449649:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c99f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449655:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c99f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449660:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c99f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449665:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.449668:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c99f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449683:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c99f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449692:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee36062b800) 00010000:00010000:0.0:1762166820.449694:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.449705:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c99f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449711:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c99f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449731:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449737:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c9a6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449742:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c9a6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449747:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.449749:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c9a6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449755:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c9a6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449809:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.449812:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.449815:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c9a6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.449820:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c9a6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000100:00100000:0.0:1762166820.449898:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:45290:x1847765444324096:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 798us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.449907:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2628 00000100:00100000:2.0:1762166820.457725:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.457819:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444324352 00000100:00100000:0.0:1762166820.457844:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444324352 00000100:00100000:0.0:1762166820.457920:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2629 00000100:00100000:0.0:1762166820.457943:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:45291:x1847765444324352:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.457975:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.457999:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c9ad lrc: 2/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e31 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.458094:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c9b4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.458105:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c9b4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.458113:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c9b4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:0.0:1762166820.458130:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00010000:00010000:0.0:1762166820.458250:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9c9ad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e31 expref: 29 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.458268:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c9b4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e31 expref: 28 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.458277:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.458280:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166820.458283:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686800, rc 0) 00000100:00100000:0.0:1762166820.458358:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:45291:x1847765444324352:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 417us (633us total) trans 4294969077 rc 0/0 00000100:00100000:0.0:1762166820.458366:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2629 00000100:00100000:3.0:1762166820.461325:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.461497:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444324480 00000100:00100000:2.0:1762166820.461510:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444324480 00000100:00100000:2.0:1762166820.461597:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 270 00000100:00100000:2.0:1762166820.461609:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:45291:x1847765444324480:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:2.0:1762166820.461625:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166820.461648:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c9b4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e31 expref: 28 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.461703:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:2.0:1762166820.461707:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166820.461833:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:45291:x1847765444324480:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 225us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166820.461844:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 270 00000100:00100000:2.0:1762166820.463340:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.463412:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444324736 00000100:00100000:0.0:1762166820.463440:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444324736 00000100:00100000:0.0:1762166820.463533:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 805 00000100:00100000:0.0:1762166820.463545:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3719b6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:45291:x1847765444324736:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166820.463909:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3719b6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:45291:x1847765444324736:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 365us (572us total) trans 4294969078 rc 0/0 00000100:00100000:0.0:1762166820.463918:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 805 00000100:00100000:1.0:1762166820.466366:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.466474:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444324992 00000100:00100000:0.0:1762166820.466484:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444324992 00000100:00100000:0.0:1762166820.466558:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2630 00000100:00100000:0.0:1762166820.466576:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:45291:x1847765444324992:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.466604:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.466633:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c9c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e38 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.466831:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c9c9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.466850:0:5756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c8bf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90df2 expref: 29 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.466859:0:5756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c9c9 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.466918:0:5756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c8bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90df2 expref: 29 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.466936:0:5756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c8bf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90df2 expref: 29 pid: 5756 timeout: 541 lvb_type: 0 00000100:00100000:0.0:1762166820.466990:0:5756:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1847765451931008:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166820.467113:0:5756:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166820.468222:0:5756:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1847765451931008:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166820.468250:0:5756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c9c9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:1.0:1762166820.468544:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.468628:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444325120 00000100:00100000:2.0:1762166820.468636:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444325120 00010000:00010000:2.0:1762166820.468672:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c8bf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90df2 expref: 30 pid: 5756 timeout: 541 lvb_type: 0 00000100:00100000:2.0:1762166820.468719:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 583 00000100:00100000:2.0:1762166820.468731:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765444325120:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166820.468745:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166820.468752:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c8bf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90df2 expref: 30 pid: 5756 timeout: 541 lvb_type: 0 00010000:00010000:2.0:1762166820.468812:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c8bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90df2 expref: 30 pid: 5756 timeout: 541 lvb_type: 0 00010000:00010000:2.0:1762166820.468837:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687200/0xf915a5bdf3c9c8bf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90df2 expref: 30 pid: 5756 timeout: 541 lvb_type: 0 00010000:00010000:2.0:1762166820.468861:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:2.0:1762166820.468865:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c9c9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.468892:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c9c9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.468900:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c9c9 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.468926:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166820.468944:0:5756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c9c9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.468955:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c9c9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:0.0:1762166820.468976:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00000100:00100000:2.0:1762166820.469003:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444325120:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 274us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166820.469012:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 583 00010000:00010000:0.0:1762166820.469149:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9c9c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e38 expref: 30 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.469167:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c9c9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e38 expref: 29 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.469176:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.469179:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166820.469183:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687a00, rc 0) 00000100:00100000:0.0:1762166820.469236:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:45291:x1847765444324992:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2668us (2883us total) trans 4294969079 rc 0/0 00000100:00100000:0.0:1762166820.469243:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2630 00000100:00100000:1.0:1762166820.471126:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.471193:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444325248 00000100:00100000:0.0:1762166820.471204:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444325248 00000100:00100000:0.0:1762166820.471301:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2631 00000100:00100000:0.0:1762166820.471314:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:45291:x1847765444325248:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.471357:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.471387:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c9d7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e3f expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.471509:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c9de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.471526:0:5756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c9c9 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e38 expref: 30 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.471537:0:5756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c9de lrc: 4/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.471576:0:5756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c9c9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e38 expref: 30 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.471592:0:5756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c9c9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e38 expref: 30 pid: 5756 timeout: 541 lvb_type: 0 00000100:00100000:0.0:1762166820.471611:0:5756:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1847765451931136:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166820.471717:0:5756:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166820.473457:0:5756:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1847765451931136:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166820.473458:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762166820.473492:0:5756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c9de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:2.0:1762166820.473563:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444325376 00000100:00100000:2.0:1762166820.473572:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444325376 00010000:00010000:2.0:1762166820.473610:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c9c9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e38 expref: 31 pid: 5756 timeout: 541 lvb_type: 0 00000100:00100000:2.0:1762166820.473653:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 584 00000100:00100000:2.0:1762166820.473664:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765444325376:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166820.473691:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166820.473700:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c9c9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e38 expref: 31 pid: 5756 timeout: 541 lvb_type: 0 00010000:00010000:2.0:1762166820.473714:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c9c9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e38 expref: 31 pid: 5756 timeout: 541 lvb_type: 0 00010000:00010000:2.0:1762166820.473738:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9c9c9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e38 expref: 31 pid: 5756 timeout: 541 lvb_type: 0 00010000:00010000:2.0:1762166820.473757:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:2.0:1762166820.473812:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c9de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.473823:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c9de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.473831:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c9de lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 00010000:00010000:2.0:1762166820.473859:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166820.473877:0:5756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c9de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.473898:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c9de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:2.0:1762166820.473925:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765444325376:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 261us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166820.473934:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 584 00000004:00200000:0.0:1762166820.473948:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00000004:00200000:0.0:1762166820.473955:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166820.473979:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c9de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.474016:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9c9d7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e3f expref: 30 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.474030:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c9de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e3f expref: 29 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.474036:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.474039:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166820.474042:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158000, rc 0) 00000100:00100000:0.0:1762166820.474086:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:45291:x1847765444325248:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2775us (2971us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.474093:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2631 00000100:00100000:1.0:1762166820.476141:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.476202:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444325632 00000100:00100000:0.0:1762166820.476216:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444325632 00000100:00100000:0.0:1762166820.476281:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 806 00000100:00100000:0.0:1762166820.476292:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:45291:x1847765444325632:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166820.476551:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:45291:x1847765444325632:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 261us (423us total) trans 4294969080 rc 0/0 00000100:00100000:0.0:1762166820.476557:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 806 00000100:00100000:2.0:1762166820.478085:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.478145:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444325888 00000100:00100000:0.0:1762166820.478168:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444325888 00000100:00100000:0.0:1762166820.478216:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2632 00000100:00100000:0.0:1762166820.478226:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:45291:x1847765444325888:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.478247:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.478251:0:5756:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762166820.478277:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9c967 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e1c expref: 30 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.478295:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.478298:0:5756:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166820.478309:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9c9e5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e46 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.478400:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9c9ec lrc: 3/0,1 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.478413:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9c9ec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.478423:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9c9ec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:0.0:1762166820.478435:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00010000:00010000:0.0:1762166820.478556:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9c9e5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e46 expref: 32 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.478569:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9c9ec lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e46 expref: 31 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.478575:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.478585:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166820.478588:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159800, rc 0) 00000100:00100000:0.0:1762166820.478641:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:45291:x1847765444325888:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 418us (566us total) trans 4294969081 rc 0/0 00000100:00100000:0.0:1762166820.478646:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2632 00000100:00100000:1.0:1762166820.480166:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.480214:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444326016 00000100:00100000:1.0:1762166820.480222:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.480223:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444326016 00000100:00100000:0.0:1762166820.480276:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444326144 00000100:00100000:0.0:1762166820.480281:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444326144 00000100:00100000:0.0:1762166820.480327:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 942 00000100:00100000:0.0:1762166820.480338:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444326016:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:2.0:1762166820.480342:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 943 00000100:00100000:2.0:1762166820.480362:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444326144:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762166820.480387:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9c9fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.480391:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9ca01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.480413:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c959 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e15 expref: 26 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166820.480414:0:6535:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c952 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e0e expref: 26 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166820.480429:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.480432:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.480433:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.480436:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.480439:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9ca01 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.480442:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9c9fa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.480484:0:6535:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c952 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e0e expref: 26 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166820.480485:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c959 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e15 expref: 26 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166820.480512:0:6535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c952 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e0e expref: 26 pid: 6535 timeout: 541 lvb_type: 1 00010000:00010000:2.0:1762166820.480540:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c959 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e15 expref: 26 pid: 6535 timeout: 541 lvb_type: 1 00000100:00100000:0.0:1762166820.480543:0:6535:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765451931264:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166820.480555:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451931392:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166820.480622:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e39dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166820.480622:0:6535:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166820.481721:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451931392:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166820.481741:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9ca01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166820.481974:0:6535:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765451931264:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166820.481987:0:6535:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9c9fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166820.481998:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.482045:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444326272 00000100:00100000:2.0:1762166820.482050:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444326272 00010000:00010000:2.0:1762166820.482075:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c959 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e15 expref: 27 pid: 6535 timeout: 541 lvb_type: 1 00000100:00100000:2.0:1762166820.482112:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 585 00000100:00100000:2.0:1762166820.482120:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444326272:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166820.482133:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166820.482152:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c959 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e15 expref: 27 pid: 6535 timeout: 541 lvb_type: 1 00010000:00010000:2.0:1762166820.482163:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c959 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e15 expref: 27 pid: 6535 timeout: 541 lvb_type: 1 00010000:00010000:2.0:1762166820.482181:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9c959 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e15 expref: 27 pid: 6535 timeout: 541 lvb_type: 1 00010000:00010000:2.0:1762166820.482203:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.482205:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.482209:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9ca01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.482218:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9ca01 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.482244:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166820.482274:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762166820.482275:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9ca01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.482284:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444326272:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 162us (284us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166820.482289:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9ca01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.482298:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 585 00000100:00100000:2.0:1762166820.482317:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444326400 00010000:00010000:0.0:1762166820.482317:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9ca01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.482321:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444326400 00010000:00010000:0.0:1762166820.482330:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9ca01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.482338:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c952 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e0e expref: 26 pid: 6535 timeout: 541 lvb_type: 1 00010000:00010000:0.0:1762166820.482341:0:6533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9ca01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.482358:0:6533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166820.482363:0:6533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9ca01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.482370:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 586 00010000:00010000:0.0:1762166820.482374:0:6533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9ca01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.482382:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3456e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765444326400:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166820.482394:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166820.482411:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c952 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e0e expref: 26 pid: 6535 timeout: 541 lvb_type: 1 00010000:00010000:0.0:1762166820.482411:0:6533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9ca01 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.482433:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15600/0xf915a5bdf3c9ca01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.482438:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c952 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e0e expref: 26 pid: 6535 timeout: 541 lvb_type: 1 00010000:00010000:2.0:1762166820.482469:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9c952 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e0e expref: 26 pid: 6535 timeout: 541 lvb_type: 1 00010000:00010000:2.0:1762166820.482480:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.482482:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.482486:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9c9fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.482492:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9c9fa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166820.482499:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444326144:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2144us (2279us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.482509:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 943 00010000:00010000:2.0:1762166820.482527:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166820.482553:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3456e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2359:x1847765444326400:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 174us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166820.482560:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 586 00010000:00010000:3.0:1762166820.482589:0:6535:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9c9fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.482599:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9c9fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.482616:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9c9fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.482623:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9c9fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.482630:0:6535:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9c9fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.482636:0:6535:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166820.482639:0:6535:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9c9fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.482646:0:6535:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9c9fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.482748:0:6535:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9c9fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.482757:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9c9fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166820.482832:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444326016:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2496us (2677us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166820.482840:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 942 00000100:00100000:3.0:1762166820.484150:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.484246:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444326656 00000100:00100000:0.0:1762166820.484254:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444326656 00000100:00100000:0.0:1762166820.484293:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2633 00000100:00100000:0.0:1762166820.484299:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:45291:x1847765444326656:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166820.484340:0:5756:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762166820.484360:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9c9de lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e3f expref: 31 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.484394:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9c864 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90dc8 expref: 30 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.484405:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.484410:0:5756:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166820.484443:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca08 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.484454:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca08 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.484469:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca08 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000040:00080000:0.0:1762166820.485009:0:5756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].129, 88 off18600 00000004:00080000:0.0:1762166820.485018:0:5756:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 441277255252ns, next at 431048225210ns, rc = 0 00000040:00080000:0.0:1762166820.485053:0:5756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].130, 88 off18688 00000004:00080000:0.0:1762166820.485058:0:5756:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 441277295436ns, next at 431048225210ns, rc = 0 00000040:00080000:0.0:1762166820.485149:0:5756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].125, 88 off18232 00000004:00080000:0.0:1762166820.485154:0:5756:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 441277391107ns, next at 435656221086ns, rc = 0 00000040:00080000:0.0:1762166820.485188:0:5756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].126, 88 off18320 00000004:00080000:0.0:1762166820.485193:0:5756:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 441277430013ns, next at 435656221086ns, rc = 0 00000004:00010000:0.0:1762166820.496953:0:5756:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001b6f284f reply state 0000000027feb75a transno 4294969082 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca08 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000001:00080000:1.0:1762166820.496954:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969082 is committed 00000004:00080000:1.0:1762166820.496967:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 112 committed 00000100:00100000:0.0:1762166820.496970:0:5756:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00080000:1.0:1762166820.496989:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 111 committed 00000004:00080000:1.0:1762166820.496993:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 115 committed 00000004:00080000:1.0:1762166820.497008:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 114 committed 00010000:00080000:0.0:1762166820.497065:0:5756:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1762166820.497082:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45291:x1847765444326656:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 12780us (12935us total) trans 4294969082 rc 0/0 00000100:00100000:0.0:1762166820.497091:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2633 00000100:00100000:1.0:1762166820.497099:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451931520:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166820.497117:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451931648:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1762166820.497126:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca08 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.497132:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca08 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.497137:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca08 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.497142:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.497146:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca08 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00000100:00100000:1.0:1762166820.497159:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166820.497164:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451931776:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1762166820.497166:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca08 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.497182:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.497185:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166820.497188:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca08 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.497192:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca08 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000100:00100000:2.0:1762166820.497209:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166820.497211:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451931520 00000100:00100000:3.0:1762166820.497219:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451931520 00000100:00100000:0.0:1762166820.497236:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451931776 00000100:00100000:0.0:1762166820.497241:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451931776 00000100:00100000:1.0:1762166820.497248:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166820.497255:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1762166820.497265:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451931904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166820.497269:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451931648 00000100:00100000:3.0:1762166820.497276:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451931648 00000100:00100000:0.0:1762166820.497285:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:0.0:1762166820.497294:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765451931520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166820.497301:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166820.497308:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:1.0:1762166820.497321:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765451931776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166820.497322:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451931904 00000100:00100000:3.0:1762166820.497328:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451931904 00000100:00100000:3.0:1762166820.497350:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:3.0:1762166820.497357:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765451931648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762166820.497511:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1762166820.497516:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00002000:00010000:0.0:1762166820.497516:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1762166820.497521:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00002000:00010000:0.0:1762166820.497527:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166820.497529:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166820.497532:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb ctime from disk: 1762166820 -> 1762166820 00002000:00010000:1.0:1762166820.497534:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb ctime from disk: 1762166820 -> 1762166820 00000100:00100000:3.0:1762166820.497535:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3296:x1847765451931648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 178us (288us total) trans 21474836742 rc 0/0 00002000:00010000:0.0:1762166820.497537:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb blocks from disk: 2051 -> 2051 00002000:00010000:1.0:1762166820.497542:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb blocks from disk: 4181 -> 4181 00000100:00100000:3.0:1762166820.497557:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000100:00100000:3.0:1762166820.497579:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000004:00080000:2.0:1762166820.497580:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242523800/2, rc 0, transno 21474836742 00000100:00100000:2.0:1762166820.497589:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451931648:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166820.497593:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765451931904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166820.497595:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765451931520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 297us (432us total) trans 17179869411 rc 0/0 00000100:00100000:1.0:1762166820.497598:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765451931776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 279us (388us total) trans 17179869410 rc 0/0 00000100:00100000:0.0:1762166820.497614:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:1.0:1762166820.497626:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000004:00080000:1.0:1762166820.497672:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccc000/2, rc 0, transno 17179869411 00000100:00100000:1.0:1762166820.497697:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451931520:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166820.497707:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3293:x1847765451931904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (407us total) trans 21474836743 rc 0/0 00000100:00100000:3.0:1762166820.497714:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000004:00080000:1.0:1762166820.497726:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242521f80/2, rc 0, transno 21474836743 00000100:00100000:1.0:1762166820.497732:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451931904:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762166820.497744:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccf480/2, rc 0, transno 17179869410 00000100:00100000:1.0:1762166820.497747:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451931776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166820.498902:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.498950:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444326784 00000100:00100000:0.0:1762166820.498957:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444326784 00000100:00100000:0.0:1762166820.499003:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2634 00000100:00100000:0.0:1762166820.499012:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:45291:x1847765444326784:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.499028:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.499050:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ca0f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e4d expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.499097:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ca0f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e4d expref: 19 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.499110:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ca0f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e4d expref: 19 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.499126:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.499130:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166820.499133:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158000, rc 0) 00000100:00100000:0.0:1762166820.499170:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45291:x1847765444326784:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 160us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.499174:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2634 00000100:00100000:1.0:1762166820.500419:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.500473:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444326912 00000100:00100000:0.0:1762166820.500479:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444326912 00000100:00100000:0.0:1762166820.500517:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2635 00000100:00100000:0.0:1762166820.500524:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45291:x1847765444326912:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.500534:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.500543:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca16 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e54 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.500607:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca1d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.500617:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca1d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.500623:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca1d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:0.0:1762166820.500651:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00000004:00200000:0.0:1762166820.500654:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166820.500665:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca1d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.500697:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca16 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e54 expref: 21 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.500709:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca1d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e54 expref: 20 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.500714:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.500716:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166820.500718:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159c00, rc 0) 00000100:00100000:0.0:1762166820.500751:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:45291:x1847765444326912:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 228us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.500755:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2635 00000100:00100000:1.0:1762166820.502056:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.502120:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444327040 00000100:00100000:2.0:1762166820.502126:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444327040 00000100:00100000:1.0:1762166820.502165:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.502192:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444327168 00000100:00100000:2.0:1762166820.502197:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444327168 00000100:00100000:3.0:1762166820.502204:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 948 00000100:00100000:3.0:1762166820.502214:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765444327040:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166820.502225:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1762166820.502229:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 949 00010000:00010000:3.0:1762166820.502239:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ca24 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e5b expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.502248:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765444327168:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166820.502258:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1762166820.502261:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x64:0x0] initial LVB size: 2097152, mtime: 0x69088824, atime: 0x69088824, ctime: 0x69088824, blocks: 0x1 00010000:00010000:2.0:1762166820.502271:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9ca2b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e62 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.502274:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.502278:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.502286:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ca24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e5b expref: 25 pid: 12400 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1762166820.502291:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x65:0x0] initial LVB size: 3145728, mtime: 0x69088824, atime: 0x69088824, ctime: 0x69088824, blocks: 0x1 00010000:00010000:3.0:1762166820.502297:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ca24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e5b expref: 26 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166820.502302:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.502306:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3a00, rc 0) 00010000:00010000:2.0:1762166820.502311:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.502318:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9ca2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e62 expref: 26 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166820.502331:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9ca2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e62 expref: 26 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166820.502341:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14000, rc 0) 00000100:00100000:3.0:1762166820.502360:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444327040:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 146us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166820.502369:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444327168:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 130us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166820.502371:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 948 00000100:00100000:2.0:1762166820.502382:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 949 00000100:00100000:1.0:1762166820.529825:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166820.529885:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166820.529940:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.529982:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444327296 00000100:00100000:2.0:1762166820.529993:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444327296 00000100:00100000:3.0:1762166820.530035:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444327424 00000100:00100000:0.0:1762166820.530041:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444327552 00000100:00100000:3.0:1762166820.530043:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444327424 00000100:00100000:0.0:1762166820.530049:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444327552 00000100:00100000:2.0:1762166820.530075:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 957 00000100:00100000:2.0:1762166820.530088:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444327296:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:3.0:1762166820.530094:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 958 00000100:00100000:0.0:1762166820.530105:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 959 00000100:00100000:3.0:1762166820.530109:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444327424:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762166820.530117:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444327552:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762166820.530127:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca32 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.530135:0:26247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca39 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.530136:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca40 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.530158:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.530162:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.530166:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.530169:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca40 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.530171:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.530177:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.530198:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.530199:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.530202:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.530209:0:26247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca39 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.530228:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca40 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.530231:0:26247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca39 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.535359:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.535378:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.535388:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.535396:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166820.535402:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.535411:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.535431:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.535438:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.535539:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444327296:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 5450us (5722us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1762166820.535552:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 957 00010000:00010000:3.0:1762166820.536810:0:26247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca39 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.536834:0:26247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca39 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.536844:0:26247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.536854:0:26247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166820.536860:0:26247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.536872:0:26247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.536892:0:26247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca39 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.536901:0:26247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca39 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166820.537019:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444327424:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 6911us (7129us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1762166820.537030:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 958 00010000:00010000:0.0:1762166820.538193:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca40 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.538217:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca40 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.538225:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.538233:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166820.538236:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.538245:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.538259:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca40 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.538264:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca40 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166820.538337:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765444327552:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 8221us (8394us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1762166820.538356:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 959 00000100:00100000:1.0:1762166820.543091:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.543163:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444327680 00000100:00100000:0.0:1762166820.543179:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444327680 00000100:00100000:0.0:1762166820.543293:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 960 00000100:00100000:0.0:1762166820.543305:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2361:x1847765444327680:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:0.0:1762166820.543358:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.543385:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c98a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e23 expref: 9 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166820.543394:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.543397:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.543401:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca47 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.543447:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c98a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e23 expref: 9 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166820.543461:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c98a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e23 expref: 9 pid: 6535 timeout: 541 lvb_type: 1 00000100:00100000:0.0:1762166820.543477:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765451932032:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166820.543592:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166820.544926:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765451932032:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166820.544957:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166820.544987:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.545069:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444327808 00000100:00100000:2.0:1762166820.545077:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444327808 00010000:00010000:2.0:1762166820.545131:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c98a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e23 expref: 10 pid: 6535 timeout: 541 lvb_type: 1 00000100:00100000:2.0:1762166820.545172:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 587 00000100:00100000:2.0:1762166820.545184:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f279500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2360:x1847765444327808:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166820.545199:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166820.545228:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c98a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e23 expref: 10 pid: 6535 timeout: 541 lvb_type: 1 00010000:00010000:2.0:1762166820.545253:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c98a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e23 expref: 10 pid: 6535 timeout: 541 lvb_type: 1 00010000:00010000:2.0:1762166820.545283:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9c98a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e23 expref: 10 pid: 6535 timeout: 541 lvb_type: 1 00010000:00010000:2.0:1762166820.545300:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.545303:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.545308:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.545317:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca47 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.545349:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166820.545380:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.545390:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.545411:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f279500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444327808:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 228us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166820.545420:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 587 00010000:00010000:2.0:1762166820.562392:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762166820.562397:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869412 is committed 00010000:00010000:2.0:1762166820.562411:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762166820.562418:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869411 is committed 00010000:00010000:2.0:1762166820.562420:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.562429:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166820.562433:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.562442:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.562460:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca47 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.562467:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158600/0xf915a5bdf3c9ca47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.562562:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2361:x1847765444327680:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 19254us (19490us total) trans 17179869412 rc 0/0 00000100:00100000:2.0:1762166820.562586:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 960 00000100:00100000:1.0:1762166820.566559:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.566636:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444327936 00000100:00100000:2.0:1762166820.566646:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444327936 00000100:00100000:2.0:1762166820.566728:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 961 00000100:00100000:2.0:1762166820.566738:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2360:x1847765444327936:12345-192.168.203.35@tcp:4:lfs.0 00000100:00100000:1.0:1762166820.566801:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166820.566810:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.566833:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c991 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e2a expref: 7 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166820.566842:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.566844:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.566848:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca4e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166820.566861:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444328064 00000100:00100000:3.0:1762166820.566868:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444328064 00010000:00010000:2.0:1762166820.566884:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c991 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e2a expref: 8 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166820.566899:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c991 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e2a expref: 8 pid: 6535 timeout: 541 lvb_type: 1 00000100:00100000:2.0:1762166820.566914:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765451932160:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166820.566919:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 962 00000100:00100000:3.0:1762166820.566930:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2361:x1847765444328064:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:3.0:1762166820.566948:0:26247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.566958:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.566960:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.566963:0:26247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.566973:0:26247:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.567025:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f939c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166820.567898:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765451932160:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166820.567920:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166820.568147:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.568216:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444328192 00000100:00100000:2.0:1762166820.568221:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444328192 00010000:00010000:2.0:1762166820.568254:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c991 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e2a expref: 9 pid: 6535 timeout: 541 lvb_type: 1 00000100:00100000:2.0:1762166820.568287:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 588 00000100:00100000:2.0:1762166820.568297:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2361:x1847765444328192:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166820.568310:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166820.568331:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c991 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e2a expref: 9 pid: 6535 timeout: 541 lvb_type: 1 00010000:00010000:2.0:1762166820.568343:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c991 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e2a expref: 9 pid: 6535 timeout: 541 lvb_type: 1 00010000:00010000:2.0:1762166820.568360:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9c991 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e2a expref: 9 pid: 6535 timeout: 541 lvb_type: 1 00010000:00010000:2.0:1762166820.568369:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.568371:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.568374:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.568380:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca4e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.568385:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.568391:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.568394:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.568398:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca55 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.568423:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166820.568443:0:26247:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.568452:0:26247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.568461:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2361:x1847765444328192:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 166us (315us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166820.568468:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.568475:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 588 00010000:00010000:0.0:1762166820.568485:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762166820.627749:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869414 is committed 00010000:00010000:0.0:1762166820.627869:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.627884:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.627894:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.627899:0:26247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.627911:0:26247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.627918:0:26247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.627919:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166820.627928:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.627929:0:26247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166820.627935:0:26247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.627946:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.627949:0:26247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.627978:0:26247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca55 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.627978:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca4e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.627998:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14800/0xf915a5bdf3c9ca4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.627999:0:26247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ca55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166820.628140:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2361:x1847765444328064:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 61204us (61333us total) trans 17179869413 rc 0/0 00000100:00100000:0.0:1762166820.628140:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2360:x1847765444327936:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 61399us (61584us total) trans 17179869414 rc 0/0 00000100:00100000:1.0:1762166820.628160:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 962 00000100:00100000:0.0:1762166820.628168:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 961 00000100:00100000:3.0:1762166820.640437:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.640552:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444328448 00000100:00100000:0.0:1762166820.640562:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444328448 00000100:00100000:0.0:1762166820.640619:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2636 00000100:00100000:0.0:1762166820.640630:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:45291:x1847765444328448:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166820.640696:0:5756:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166820.640724:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca1d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e54 expref: 20 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.640742:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.640747:0:5756:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166820.641063:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca5c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.641076:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca5c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.641086:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca5c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000001:00080000:0.0:1762166820.641187:0:5756:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294969083 00000004:00010000:0.0:1762166820.641213:0:5756:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c3add3b9 reply state 000000005d0d63d4 transno 4294969084 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca5c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:0.0:1762166820.641223:0:5756:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166820.641313:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45291:x1847765444328448:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 685us (890us total) trans 4294969084 rc 0/0 00000100:00100000:0.0:1762166820.641321:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2636 00000020:00080000:0.0:1762166820.641326:0:5756:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762166820.642470:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca5c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.642482:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca5c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.642490:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca5c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.642496:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.642500:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca5c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.642509:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca5c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.642519:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.642522:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.642526:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca5c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.642532:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca5c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000100:00100000:3.0:1762166820.643032:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.643115:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444328576 00000100:00100000:2.0:1762166820.643122:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444328576 00000100:00100000:2.0:1762166820.643167:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 950 00000100:00100000:2.0:1762166820.643177:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:45291:x1847765444328576:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166820.643189:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166820.643204:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9ca63 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e69 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166820.643223:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x5e:0x0] initial LVB size: 1048576, mtime: 0x69088824, atime: 0x0, ctime: 0x69088824, blocks: 0x803 00010000:00010000:2.0:1762166820.643237:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.643239:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.643244:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9ca63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e69 expref: 7 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.643254:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9ca63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e69 expref: 7 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.643261:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14600, rc 0) 00000100:00100000:2.0:1762166820.643312:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:45291:x1847765444328576:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 136us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166820.643319:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 950 00000100:00100000:2.0:1762166820.645061:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166820.645109:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444328704 00000100:00100000:1.0:1762166820.645116:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444328704 00000100:00100000:1.0:1762166820.645149:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 951 00000100:00100000:1.0:1762166820.645155:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:45291:x1847765444328704:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166820.645174:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166820.645185:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9ca6a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e70 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166820.645200:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x5f:0x0] initial LVB size: 3145728, mtime: 0x69088824, atime: 0x0, ctime: 0x0, blocks: 0x1055 00010000:00010000:1.0:1762166820.645210:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166820.645211:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166820.645215:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9ca6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e70 expref: 8 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.645225:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9ca6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e70 expref: 8 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.645231:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7dc00, rc 0) 00000100:00100000:1.0:1762166820.645274:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:45291:x1847765444328704:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 118us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166820.645280:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 951 00000100:00100000:1.0:1762166820.646848:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.646919:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444328832 00000100:00100000:0.0:1762166820.646926:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444328832 00002000:00010000:0.0:1762166820.646957:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/95 (3145728->18446744073709551615) 00002000:00100000:0.0:1762166820.646961:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f278380 with x1847765444328832 ext(3145728->18446744073709551615) 00002000:00010000:0.0:1762166820.646970:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37f278380. 00000100:00100000:0.0:1762166820.647002:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 963 00000100:00100000:0.0:1762166820.647015:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2361:x1847765444328832:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762166820.647284:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1762166820.647288:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00002000:00010000:0.0:1762166820.647289:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166820.647291:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb ctime from disk: 0 -> 1762166820 00002000:00010000:0.0:1762166820.647292:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb blocks from disk: 4181 -> 4181 00000100:00100000:0.0:1762166820.647337:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2361:x1847765444328832:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 324us (495us total) trans 17179869415 rc 0/0 00000100:00100000:0.0:1762166820.647341:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 963 00002000:00010000:0.0:1762166820.647344:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/95 (3145728->18446744073709551615) 00002000:00100000:0.0:1762166820.647346:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f278380 with x1847765444328832 ext(3145728->18446744073709551615) 00002000:00010000:0.0:1762166820.647349:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37f278380. 00000100:00100000:3.0:1762166820.649176:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.649261:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444329088 00000100:00100000:0.0:1762166820.649273:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444329088 00000100:00100000:0.0:1762166820.649339:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2637 00000100:00100000:0.0:1762166820.649349:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:45291:x1847765444329088:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166820.649457:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca71 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.649495:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca71 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.649506:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca71 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00010000:0.0:1762166820.649635:0:5756:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000995f8934 reply state 000000006ae5046f transno 4294969085 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca71 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000100:00100000:0.0:1762166820.649645:0:5756:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166820.649749:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:45291:x1847765444329088:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 401us (584us total) trans 4294969085 rc 0/0 00000100:00100000:0.0:1762166820.649757:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2637 00010000:00010000:0.0:1762166820.650683:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca71 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.650692:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca71 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.650698:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca71 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.650702:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.650705:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca71 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.650710:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca71 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.650722:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.650724:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.650728:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca71 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.650741:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca71 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000100:00100000:3.0:1762166820.651586:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.651623:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.651710:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444329216 00000100:00100000:0.0:1762166820.651718:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444329216 00000100:00100000:1.0:1762166820.651721:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444329344 00000100:00100000:1.0:1762166820.651727:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444329344 00000100:00100000:0.0:1762166820.651787:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 952 00000100:00100000:0.0:1762166820.651797:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444329216:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762166820.651802:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 953 00000100:00100000:1.0:1762166820.651814:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444329344:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166820.652034:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1762166820.652038:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00002000:00010000:0.0:1762166820.652041:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb atime from disk: 1762166820 -> 1762166820 00002000:00010000:0.0:1762166820.652043:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb ctime from disk: 1762166820 -> 1762166820 00002000:00010000:0.0:1762166820.652046:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1762166820.652095:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb size from disk: 3145728 -> 3145728 00000100:00100000:0.0:1762166820.652113:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444329216:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 310us (524us total) trans 21474836744 rc 0/0 00000100:00100000:0.0:1762166820.652125:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 952 00002000:00010000:1.0:1762166820.652177:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00002000:00010000:1.0:1762166820.652180:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb atime from disk: 1762166820 -> 1762166820 00002000:00010000:1.0:1762166820.652182:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb ctime from disk: 1762166820 -> 1762166820 00002000:00010000:1.0:1762166820.652193:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762166820.652217:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444329344:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 407us (593us total) trans 21474836745 rc 0/0 00000100:00100000:1.0:1762166820.652225:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 953 00000100:00100000:2.0:1762166820.653740:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.653847:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444329600 00000100:00100000:0.0:1762166820.653859:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444329600 00000100:00100000:0.0:1762166820.653899:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 807 00000100:00100000:0.0:1762166820.653909:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45291:x1847765444329600:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166820.653972:0:5759:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x11:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9c9ec lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e46 expref: 22 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.654014:0:5759:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca78 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5759 initiator: MDT0 00010000:00010000:0.0:1762166820.654026:0:5759:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ca0f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e4d expref: 22 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.654049:0:5759:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca78 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5759 initiator: MDT0 00010000:00010000:0.0:1762166820.654079:0:5759:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ca0f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e4d expref: 22 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.654110:0:5759:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ca0f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e4d expref: 22 pid: 5756 timeout: 541 lvb_type: 0 00000100:00100000:0.0:1762166820.654129:0:5759:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5759:1847765451932288:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166820.654197:0:5759:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166820.655852:0:5759:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5759:1847765451932288:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166820.655875:0:5759:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca78 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00000100:00100000:2.0:1762166820.656118:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.656199:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444329728 00000100:00100000:3.0:1762166820.656207:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444329728 00010000:00010000:3.0:1762166820.656233:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ca0f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e4d expref: 23 pid: 5756 timeout: 541 lvb_type: 0 00000100:00100000:3.0:1762166820.656271:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 589 00000100:00100000:3.0:1762166820.656280:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444329728:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166820.656294:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166820.656302:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ca0f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e4d expref: 23 pid: 5756 timeout: 541 lvb_type: 0 00010000:00010000:3.0:1762166820.656314:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ca0f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e4d expref: 23 pid: 5756 timeout: 541 lvb_type: 0 00010000:00010000:3.0:1762166820.656332:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ca0f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e4d expref: 23 pid: 5756 timeout: 541 lvb_type: 0 00010000:00010000:3.0:1762166820.656348:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:3.0:1762166820.656354:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca78 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166820.656362:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca78 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166820.656369:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca78 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5759 initiator: MDT0 00010000:00010000:3.0:1762166820.656399:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166820.656417:0:5759:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca78 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00010000:00010000:0.0:1762166820.656427:0:5759:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca78 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00000100:00100000:3.0:1762166820.656468:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765444329728:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 187us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166820.656476:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 589 00000040:00080000:0.0:1762166820.656854:0:5759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].131, 88 off18776 00000004:00080000:0.0:1762166820.656863:0:5759:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 441449099483ns, next at 431048225210ns, rc = 0 00000040:00080000:0.0:1762166820.656895:0:5759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].132, 88 off18864 00000004:00080000:0.0:1762166820.656900:0:5759:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 441449136928ns, next at 431048225210ns, rc = 0 00000040:00080000:0.0:1762166820.656947:0:5759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].127, 88 off18408 00000004:00080000:0.0:1762166820.656953:0:5759:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 441449189926ns, next at 435656221086ns, rc = 0 00000040:00080000:0.0:1762166820.656991:0:5759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].128, 88 off18496 00000004:00080000:0.0:1762166820.657003:0:5759:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 441449240115ns, next at 435656221086ns, rc = 0 00000001:00080000:1.0:1762166820.669402:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969086 is committed 00000004:00080000:1.0:1762166820.669418:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 114 committed 00000004:00010000:2.0:1762166820.669430:0:5759:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009b585ae0 reply state 000000009df142d8 transno 4294969086 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca78 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 00000004:00080000:1.0:1762166820.669436:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 113 committed 00000004:00080000:1.0:1762166820.669442:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 117 committed 00000100:00100000:2.0:1762166820.669448:0:5759:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166820.669461:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:2.0:1762166820.669466:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:1.0:1762166820.669470:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 116 committed 00010000:00010000:2.0:1762166820.669476:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9c9ec lrc: 0/0,0 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e46 expref: 21 pid: 5756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166820.669539:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451932416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166820.669565:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451932800:0@lo:2:osp-syn-0-0.0 00010000:00080000:2.0:1762166820.669613:0:5759:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1762166820.669624:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166820.669631:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:45291:x1847765444329600:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 15718us (15891us total) trans 4294969086 rc 0/0 00010000:00010000:0.0:1762166820.669634:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca78 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5759 initiator: MDT0 00010000:00010000:0.0:1762166820.669644:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca78 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5759 initiator: MDT0 00000100:00100000:2.0:1762166820.669645:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 807 00010000:00010000:0.0:1762166820.669656:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca78 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5759 initiator: MDT0 00010000:00010000:0.0:1762166820.669664:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.669669:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca78 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5759 initiator: MDT0 00000100:00100000:1.0:1762166820.669688:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1762166820.669688:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca78 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5759 initiator: MDT0 00000100:00100000:1.0:1762166820.669700:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451932544:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1762166820.669706:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.669710:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166820.669714:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca78 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5759 initiator: MDT0 00010000:00010000:0.0:1762166820.669720:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca78 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5759 initiator: MDT0 00000100:00100000:1.0:1762166820.669730:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166820.669808:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166820.669837:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1762166820.669844:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451932672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166820.669852:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451932416 00000100:00100000:0.0:1762166820.669860:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451932416 00000100:00100000:1.0:1762166820.669868:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166820.669901:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451932544 00000100:00100000:1.0:1762166820.669903:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451932800 00000100:00100000:0.0:1762166820.669906:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451932544 00000100:00100000:1.0:1762166820.669909:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451932800 00000100:00100000:0.0:1762166820.669931:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451932672 00000100:00100000:0.0:1762166820.669935:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451932672 00000100:00100000:1.0:1762166820.669958:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:1.0:1762166820.669970:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765451932416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166820.669971:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:0.0:1762166820.669985:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3295:x1847765451932544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166820.670044:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:3.0:1762166820.670056:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3294:x1847765451932800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762166820.670213:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1762166820.670218:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00002000:00010000:3.0:1762166820.670221:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb atime from disk: 1762166820 -> 1762166820 00002000:00010000:3.0:1762166820.670224:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb ctime from disk: 1762166820 -> 1762166820 00002000:00010000:3.0:1762166820.670226:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:0.0:1762166820.670231:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1762166820.670237:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00002000:00010000:0.0:1762166820.670240:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb atime from disk: 1762166820 -> 1762166820 00002000:00010000:0.0:1762166820.670242:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb ctime from disk: 1762166820 -> 1762166820 00002000:00010000:0.0:1762166820.670245:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166820.670253:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:2.0:1762166820.670265:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3294:x1847765451932672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166820.670272:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765451932800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 217us (460us total) trans 21474836746 rc 0/0 00000100:00100000:3.0:1762166820.670281:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:0.0:1762166820.670294:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3295:x1847765451932544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 311us (563us total) trans 21474836747 rc 0/0 00000100:00100000:0.0:1762166820.670303:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00002000:00010000:1.0:1762166820.670403:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1762166820.670406:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00002000:00010000:1.0:1762166820.670409:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166820.670411:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb ctime from disk: 1762166820 -> 1762166820 00002000:00010000:1.0:1762166820.670413:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb blocks from disk: 2051 -> 2051 00000100:00100000:1.0:1762166820.670445:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765451932416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 480us (824us total) trans 17179869416 rc 0/0 00000100:00100000:1.0:1762166820.670452:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00002000:00010000:2.0:1762166820.670463:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1762166820.670466:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb mtime from disk: 1762166820 -> 1762166820 00002000:00010000:2.0:1762166820.670468:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166820.670470:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb ctime from disk: 1762166820 -> 1762166820 00002000:00010000:2.0:1762166820.670472:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb blocks from disk: 4181 -> 4181 00000100:00100000:2.0:1762166820.670497:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3294:x1847765451932672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 236us (629us total) trans 17179869417 rc 0/0 00000004:00080000:1.0:1762166820.670497:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce5180/2, rc 0, transno 21474836746 00000100:00100000:1.0:1762166820.670502:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451932800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166820.670511:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:1.0:1762166820.670513:0:3294:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869411 gen 2 00000004:00080000:1.0:1762166820.670517:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f622d80, transno 17179869406 00000004:00080000:1.0:1762166820.670528:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f622a00, transno 17179869407 00000004:00080000:1.0:1762166820.670531:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb4a80, transno 17179869408 00000004:00080000:1.0:1762166820.670534:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f2d3480, transno 17179869409 00000004:00080000:1.0:1762166820.670536:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccf480, transno 17179869410 00000004:00080000:1.0:1762166820.670539:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccc000, transno 17179869411 00000100:00100000:1.0:1762166820.670545:0:3294:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee36f284700 x1847765451932672/t17179869417(17179869417) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166836 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762166820.670554:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f284700/2, rc 0, transno 17179869417 00000100:00100000:1.0:1762166820.670558:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451932672:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762166820.670576:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce7800/2, rc 0, transno 21474836747 00000100:00100000:1.0:1762166820.670578:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451932544:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762166820.670584:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242522300/2, rc 0, transno 17179869416 00000100:00100000:1.0:1762166820.670586:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451932416:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762166820.670847:0:7836:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 2 in progress, 0 in flight, 6 done 00000100:00100000:1.0:1762166820.671269:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.671314:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444329856 00000100:00100000:0.0:1762166820.671320:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444329856 00000100:00100000:0.0:1762166820.671363:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2638 00000100:00100000:0.0:1762166820.671370:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:45291:x1847765444329856:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.671385:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.671403:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca7f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e77 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.671450:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca7f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e77 expref: 18 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.671462:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca7f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e77 expref: 18 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.671476:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b400) 00010000:00010000:0.0:1762166820.671479:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166820.671481:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159c00, rc 0) 00000100:00100000:0.0:1762166820.671523:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:45291:x1847765444329856:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 153us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.671539:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2638 00000100:00100000:2.0:1762166820.673608:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.673728:0:5759:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444330112 00000100:00100000:0.0:1762166820.673735:0:5759:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444330112 00000100:00100000:0.0:1762166820.673818:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 808 00000100:00100000:0.0:1762166820.673829:0:5759:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:45291:x1847765444330112:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166820.674040:0:5759:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45291:x1847765444330112:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 212us (435us total) trans 4294969087 rc 0/0 00000100:00100000:0.0:1762166820.674048:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 808 00000100:00100000:3.0:1762166820.687959:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.688036:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444330368 00000100:00100000:0.0:1762166820.688047:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444330368 00000100:00100000:0.0:1762166820.688113:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2639 00000100:00100000:0.0:1762166820.688125:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45293:x1847765444330368:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.688151:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.688171:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e7e expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.688252:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688265:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688277:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688290:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ca94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688297:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ca94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688320:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ca94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688427:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688435:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688442:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688449:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.688453:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688460:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688471:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:0.0:1762166820.688474:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.688478:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688484:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ca8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688496:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ca94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688501:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ca94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688507:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ca94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688517:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.688520:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ca94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688527:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ca94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688534:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.688537:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.688539:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ca94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688545:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ca94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.688580:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca86 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e7e expref: 20 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.688590:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:0.0:1762166820.688592:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166820.688596:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ca86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e7e expref: 20 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.688604:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159a00, rc 0) 00000100:00100000:0.0:1762166820.688662:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45293:x1847765444330368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 540us (713us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166820.688670:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2639 00000100:00100000:3.0:1762166820.691687:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.691826:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444330496 00000100:00100000:0.0:1762166820.691842:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444330496 00000100:00100000:0.0:1762166820.691949:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2640 00000100:00100000:0.0:1762166820.691961:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45293:x1847765444330496:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166820.692062:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ca9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692082:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ca9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692096:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ca9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692114:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9caa2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692121:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9caa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692127:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9caa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692255:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9caa9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692263:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9caa9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692270:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9caa9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:0.0:1762166820.692311:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00000004:00200000:0.0:1762166820.692316:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166820.692329:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9caa9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692342:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ca9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692355:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ca9b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692363:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ca9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692369:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.692373:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ca9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692381:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ca9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692394:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:0.0:1762166820.692398:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.692403:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ca9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692409:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ca9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692423:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9caa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692429:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9caa2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692434:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9caa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692440:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.692442:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9caa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692458:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9caa2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692466:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee36062b200) 00010000:00010000:0.0:1762166820.692469:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.692472:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9caa2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692483:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9caa2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692510:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9caa9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692516:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9caa9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692521:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9caa9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692526:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.692529:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9caa9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692535:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9caa9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692541:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b400) 00010000:00010000:0.0:1762166820.692543:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.692546:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9caa9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.692551:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9caa9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000100:00100000:0.0:1762166820.692657:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45293:x1847765444330496:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 698us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.692666:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2640 00000100:00100000:2.0:1762166820.707729:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.708094:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444330752 00000100:00100000:0.0:1762166820.708108:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444330752 00000100:00100000:0.0:1762166820.708185:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2641 00000100:00100000:0.0:1762166820.708198:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45296:x1847765444330752:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.708228:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.708253:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9cab0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e85 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.708352:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cab7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708369:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708382:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708400:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cabe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708407:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cabe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708413:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cabe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708565:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708590:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cab7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708597:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cab7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708603:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.708608:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cab7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708616:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cab7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708630:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:0.0:1762166820.708634:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.708639:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cab7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708645:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cab7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708660:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cabe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708667:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cabe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708686:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cabe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708691:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.708694:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cabe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708710:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cabe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708718:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee36062b200) 00010000:00010000:0.0:1762166820.708721:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.708724:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cabe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708730:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cabe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.708820:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9cab0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e85 expref: 20 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.708834:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:0.0:1762166820.708837:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166820.708842:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9cab0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e85 expref: 20 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.708853:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158e00, rc 0) 00000100:00100000:0.0:1762166820.708934:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45296:x1847765444330752:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 739us (1221us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166820.708942:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2641 00000100:00100000:3.0:1762166820.710719:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.710834:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444330880 00000100:00100000:0.0:1762166820.710841:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444330880 00000100:00100000:0.0:1762166820.710905:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2642 00000100:00100000:0.0:1762166820.710915:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45296:x1847765444330880:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166820.711001:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cac5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711033:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cac5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711044:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cac5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711060:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cacc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711067:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cacc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711072:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cacc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711190:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cad3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711199:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cad3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711206:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cad3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:0.0:1762166820.711250:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00000004:00200000:0.0:1762166820.711255:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166820.711269:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cad3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711281:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cac5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711287:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cac5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711305:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cac5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711311:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.711314:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cac5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711323:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cac5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711335:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:0.0:1762166820.711338:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.711343:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cac5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711349:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cac5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711364:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cacc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711370:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cacc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711376:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cacc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711381:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.711384:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cacc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711390:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cacc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711408:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.711411:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.711414:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cacc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711419:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cacc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711440:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cad3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711446:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cad3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711452:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cad3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711458:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.711460:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cad3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711466:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cad3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711473:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b400) 00010000:00010000:0.0:1762166820.711476:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.711479:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cad3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.711484:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cad3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000100:00100000:0.0:1762166820.711566:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45296:x1847765444330880:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 651us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.711583:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2642 00000100:00100000:3.0:1762166820.757977:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.758110:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444331136 00000100:00100000:0.0:1762166820.758124:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444331136 00000100:00100000:0.0:1762166820.758200:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2643 00000100:00100000:0.0:1762166820.758209:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:45311:x1847765444331136:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.758228:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.758249:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cada lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e8c expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.758335:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cae1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758348:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cae1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758359:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cae1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758373:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cae8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758385:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758391:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758528:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9caef lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758537:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9caef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758574:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9caef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:0.0:1762166820.758585:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00010000:00010000:0.0:1762166820.758703:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cae1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758710:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cae1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758716:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cae1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758722:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.758726:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cae1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758733:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cae1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758744:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:0.0:1762166820.758748:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.758752:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cae1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758758:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cae1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758810:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758816:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cae8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758831:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cae8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758836:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.758839:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cae8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758844:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cae8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758853:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.758855:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.758858:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cae8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758863:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cae8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.758905:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cada lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e8c expref: 22 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.758913:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9caef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e8c expref: 21 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.758918:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b400) 00010000:00010000:0.0:1762166820.758920:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166820.758922:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158e00, rc 0) 00000100:00100000:0.0:1762166820.758984:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:45311:x1847765444331136:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 777us (1026us total) trans 4294969088 rc 0/0 00000100:00100000:0.0:1762166820.758989:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2643 00000100:00100000:2.0:1762166820.785385:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.785448:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.785493:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444331264 00000100:00100000:2.0:1762166820.785502:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.785512:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444331264 00000100:00100000:3.0:1762166820.785566:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444331392 00000100:00100000:3.0:1762166820.785572:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444331392 00000100:00100000:0.0:1762166820.785597:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444331520 00000100:00100000:0.0:1762166820.785602:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444331520 00000100:00100000:3.0:1762166820.785624:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 964 00000100:00100000:3.0:1762166820.785638:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765444331264:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:2.0:1762166820.785652:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 965 00000100:00100000:0.0:1762166820.785666:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 966 00010000:00010000:3.0:1762166820.785687:0:26247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cafd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.785692:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765444331392:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762166820.785696:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765444331520:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762166820.785721:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.785724:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.785735:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb04 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.785745:0:26247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cafd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.785748:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cb0b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.785749:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.785757:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.785792:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.785807:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.785824:0:26247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cafd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.785828:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.785833:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.785844:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cb0b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.785863:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cb0b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.791255:0:26247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cafd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.791274:0:26247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cafd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.791298:0:26247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cafd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.791306:0:26247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166820.791311:0:26247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cafd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.791319:0:26247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cafd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.791338:0:26247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cafd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.791344:0:26247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cafd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166820.791455:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2358:x1847765444331264:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 5810us (6075us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1762166820.791469:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 964 00010000:00010000:3.0:1762166820.792010:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cb0b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.792022:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cb0b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.792028:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cb0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.792034:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166820.792038:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cb0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.792045:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cb0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.792057:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cb0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.792063:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cb0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166820.792246:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765444331392:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 6582us (6798us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1762166820.792261:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 965 00010000:00010000:0.0:1762166820.792946:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.792958:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb04 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.792965:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.792971:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166820.792975:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.792994:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.793006:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb04 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.793013:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166820.793058:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765444331520:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 7383us (7560us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1762166820.793065:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 966 00000100:00100000:1.0:1762166820.811607:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.811683:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444331776 00000100:00100000:3.0:1762166820.811694:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444331776 00000100:00100000:3.0:1762166820.811747:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 809 00000100:00100000:3.0:1762166820.811758:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:45311:x1847765444331776:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166820.812003:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45311:x1847765444331776:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 248us (403us total) trans 4294969089 rc 0/0 00000100:00100000:3.0:1762166820.812008:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 809 00000100:00100000:2.0:1762166820.822338:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.822443:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444332032 00000100:00100000:0.0:1762166820.822458:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444332032 00000100:00100000:0.0:1762166820.822528:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2644 00000100:00100000:0.0:1762166820.822546:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:45314:x1847765444332032:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166820.822575:0:5756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166820.822594:0:5756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e93 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.822709:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cb19 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.822724:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cb19 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.822735:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cb19 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:0.0:1762166820.822807:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00010000:00010000:0.0:1762166820.822938:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e93 expref: 25 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.822957:0:5756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cb19 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e93 expref: 24 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.822967:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b400) 00010000:00010000:0.0:1762166820.822970:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166820.822974:0:5756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159a00, rc 0) 00000100:00100000:0.0:1762166820.823038:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:45314:x1847765444332032:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 499us (712us total) trans 4294969090 rc 0/0 00000100:00100000:0.0:1762166820.823045:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2644 00000100:00100000:1.0:1762166820.848662:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.848866:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444332160 00000100:00100000:0.0:1762166820.848887:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444332160 00000100:00100000:0.0:1762166820.849004:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 967 00000100:00100000:0.0:1762166820.849017:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f279880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2359:x1847765444332160:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762166820.849067:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb27 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.849091:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9ca63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e69 expref: 9 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.849099:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166820.849102:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166820.849105:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb27 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.849171:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9ca63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e69 expref: 9 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.849187:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9ca63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e69 expref: 9 pid: 12402 timeout: 541 lvb_type: 0 00000100:00100000:0.0:1762166820.849206:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765451932928:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166820.849339:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.849340:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166820.849388:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444332288 00000100:00100000:3.0:1762166820.849393:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444332288 00000100:00100000:2.0:1762166820.849487:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.849521:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444332416 00000100:00100000:3.0:1762166820.849525:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444332416 00000100:00100000:3.0:1762166820.849576:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 968 00000100:00100000:3.0:1762166820.849590:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2359:x1847765444332288:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762166820.849600:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 969 00010000:00010000:3.0:1762166820.849619:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cb2e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166820.849640:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2358:x1847765444332416:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762166820.849643:0:14122:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9ca6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e70 expref: 11 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.849658:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166820.849659:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166820.849662:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cb2e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.849702:0:26247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb35 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.849704:0:14122:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9ca6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e70 expref: 11 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.849795:0:14122:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9ca6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e70 expref: 11 pid: 12402 timeout: 541 lvb_type: 0 00000100:00100000:3.0:1762166820.849810:0:14122:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:14122:1847765451933056:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166820.849811:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166820.849818:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166820.849822:0:26247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb35 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.849834:0:26247:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb35 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166820.849866:0:14122:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34718b240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166820.850703:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765451932928:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166820.850729:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb27 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.851035:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.851049:0:14122:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:14122:1847765451933056:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166820.851062:0:14122:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cb2e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166820.851104:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444332544 00000100:00100000:0.0:1762166820.851120:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444332544 00010000:00010000:0.0:1762166820.851151:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9ca63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e69 expref: 12 pid: 12402 timeout: 541 lvb_type: 0 00000100:00100000:0.0:1762166820.851197:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 590 00000100:00100000:0.0:1762166820.851207:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444332544:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166820.851221:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166820.851250:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9ca63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e69 expref: 12 pid: 12402 timeout: 541 lvb_type: 0 00010000:00010000:0.0:1762166820.851263:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9ca63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e69 expref: 12 pid: 12402 timeout: 541 lvb_type: 0 00010000:00010000:0.0:1762166820.851292:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14600/0xf915a5bdf3c9ca63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e69 expref: 12 pid: 12402 timeout: 541 lvb_type: 0 00010000:00010000:0.0:1762166820.851313:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.851315:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166820.851320:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.851331:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb27 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166820.851358:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762166820.851364:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166820.851403:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166820.851411:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444332672 00010000:00010000:2.0:1762166820.851415:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166820.851417:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444332672 00000100:00100000:0.0:1762166820.851430:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444332544:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 222us (395us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166820.851438:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9ca6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e70 expref: 12 pid: 12402 timeout: 541 lvb_type: 0 00000100:00100000:0.0:1762166820.851450:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 590 00000100:00100000:3.0:1762166820.851492:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 591 00000100:00100000:3.0:1762166820.851507:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444332672:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166820.851518:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166820.851534:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9ca6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e70 expref: 11 pid: 12402 timeout: 541 lvb_type: 0 00010000:00010000:3.0:1762166820.851550:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9ca6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e70 expref: 11 pid: 12402 timeout: 541 lvb_type: 0 00010000:00010000:3.0:1762166820.851569:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9ca6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e70 expref: 12 pid: 12402 timeout: 541 lvb_type: 0 00010000:00010000:3.0:1762166820.851588:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.851590:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.851594:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cb2e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.851602:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cb2e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.851611:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.851613:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166820.851616:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb35 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.851625:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb35 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166820.851658:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166820.851687:0:26247:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb35 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166820.851699:0:26247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb35 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.851713:0:14122:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cb2e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.851729:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cb2e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166820.851759:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444332672:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 254us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166820.851835:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 591 00010000:00010000:2.0:1762166820.856000:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.856025:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb27 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.856034:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.856041:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166820.856046:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.856055:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.856080:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.856089:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166820.856216:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f279880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2359:x1847765444332160:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 7196us (7559us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1762166820.856230:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 967 00010000:00010000:1.0:1762166820.860342:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cb2e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.860371:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cb2e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.860381:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cb2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.860389:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166820.860394:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cb2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.860405:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cb2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.860433:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cb2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.860442:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cb2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166820.860563:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2359:x1847765444332288:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 10970us (11217us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1762166820.860577:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 968 00010000:00010000:1.0:1762166820.861994:0:26247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb35 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.862028:0:26247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb35 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.862037:0:26247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.862045:0:26247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166820.862049:0:26247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.862058:0:26247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.862075:0:26247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.862084:0:26247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb35 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166820.862174:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2358:x1847765444332416:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 12556us (12683us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1762166820.862185:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 969 00000100:00100000:3.0:1762166820.865566:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166820.865612:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166820.865650:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444332800 00000100:00100000:2.0:1762166820.865663:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444332800 00000100:00100000:1.0:1762166820.865699:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444332928 00000100:00100000:1.0:1762166820.865705:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444332928 00000100:00100000:2.0:1762166820.865780:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 958 00000100:00100000:1.0:1762166820.865788:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 959 00000100:00100000:2.0:1762166820.865795:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f548c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2359:x1847765444332800:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:1.0:1762166820.865801:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2359:x1847765444332928:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166820.865818:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166820.865819:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166820.865840:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee244473200/0xf915a5bdf3c9cb43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ea1 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166820.865841:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9cb3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90e9a expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166820.865874:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x5e:0x0] initial LVB size: 1048576, mtime: 0x69088824, atime: 0x0, ctime: 0x69088824, blocks: 0x803 00002000:00010000:1.0:1762166820.865874:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x5f:0x0] initial LVB size: 3145728, mtime: 0x69088824, atime: 0x0, ctime: 0x69088824, blocks: 0x1055 00010000:00010000:2.0:1762166820.865898:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.865900:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166820.865902:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166820.865906:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166820.865910:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9cb3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e9a expref: 10 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166820.865915:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244473200/0xf915a5bdf3c9cb43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ea1 expref: 10 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166820.865937:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9cb3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e9a expref: 10 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166820.865938:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee244473200/0xf915a5bdf3c9cb43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ea1 expref: 10 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166820.865963:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14e00, rc 0) 00010000:00010000:1.0:1762166820.865963:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473200, rc 0) 00000100:00100000:1.0:1762166820.866050:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2359:x1847765444332928:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 253us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166820.866052:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f548c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2359:x1847765444332800:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 261us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166820.866066:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 959 00000100:00100000:2.0:1762166820.866074:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 958 00000100:00100000:3.0:1762166820.896110:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166820.896245:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444333056 00000100:00100000:0.0:1762166820.896255:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444333056 00000100:00100000:0.0:1762166820.896315:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2645 00000100:00100000:0.0:1762166820.896326:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:45316:x1847765444333056:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166820.896425:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cb4a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896441:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cb4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896452:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cb4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896466:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896473:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896478:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896584:0:5756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb58 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896593:0:5756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb58 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896616:0:5756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb58 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00000004:00200000:0.0:1762166820.896650:0:5756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x11:0x0]: returning size 3145728 00000004:00200000:0.0:1762166820.896654:0:5756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166820.896665:0:5756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb58 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896689:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cb4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896695:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cb4a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896701:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cb4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896706:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.896711:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cb4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896717:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cb4a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896728:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:0.0:1762166820.896731:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.896736:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cb4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896741:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cb4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896753:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896820:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb51 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896825:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896831:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.896835:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896840:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896850:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee36062b500) 00010000:00010000:0.0:1762166820.896853:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.896855:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb51 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896861:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cb51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896879:0:5756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb58 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896885:0:5756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb58 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896891:0:5756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb58 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896895:0:5756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166820.896897:0:5756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb58 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896912:0:5756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb58 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896920:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b400) 00010000:00010000:0.0:1762166820.896922:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166820.896925:0:5756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb58 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00010000:00010000:0.0:1762166820.896930:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cb58 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 00000100:00100000:0.0:1762166820.897001:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:45316:x1847765444333056:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 676us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.897013:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2645 00010000:00010000:0.0:1762166821.223920:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1762166821.591637:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836747 is committed 00000001:00080000:1.0:1762166821.591664:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836744 is committed 00000001:00080000:1.0:1762166821.591713:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836745 is committed 00000100:00100000:3.0:1762166821.988300:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166821.988360:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166821.988362:0:5749:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444333184 00000100:00100000:2.0:1762166821.988375:0:5749:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444333184 00000100:00100000:3.0:1762166821.988403:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166821.988441:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 505 00000100:00100000:0.0:1762166821.988445:0:5756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444333312 00000100:00100000:0.0:1762166821.988452:0:5756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444333312 00000100:00100000:3.0:1762166821.988456:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166821.988459:0:5749:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2360:x1847765444333184:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762166821.988509:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444333568 00000100:00100000:1.0:1762166821.988509:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444333440 00000100:00100000:1.0:1762166821.988517:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444333440 00000100:00100000:3.0:1762166821.988518:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444333568 00000100:00100000:0.0:1762166821.988518:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 232 00000100:00100000:0.0:1762166821.988532:0:5756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765444333312:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:2.0:1762166821.988540:0:5749:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2360:x1847765444333184:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 82us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166821.988550:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 505 00000100:00100000:3.0:1762166821.988570:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 184 00000100:00100000:1.0:1762166821.988582:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 185 00000100:00100000:3.0:1762166821.988584:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2361:x1847765444333568:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:0.0:1762166821.988597:0:5756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765444333312:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 65us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166821.988598:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444333440:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:0.0:1762166821.988613:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 232 00000100:00100000:3.0:1762166821.988624:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2361:x1847765444333568:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 44us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166821.988633:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 184 00000100:00080000:0.0:1762166821.988641:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166821.988647:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444333440:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 53us (241us total) trans 0 rc 0/0 00000100:00080000:0.0:1762166821.988649:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1762166821.988655:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166821.988660:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 185 00000100:00100000:3.0:1762166822.056646:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451933440:0@lo:400:kworker.0 00000100:00100000:2.0:1762166822.056655:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1847765451933312:0@lo:400:kworker.0 00000100:00100000:0.0:1762166822.056735:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451933184:0@lo:400:kworker.0 00000100:00100000:3.0:1762166822.056742:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166822.056744:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166822.056815:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166822.056845:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1847765451933824:0@lo:400:kworker.0 00000100:00100000:3.0:1762166822.056855:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1762166822.056865:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451933568:0@lo:400:kworker.0 00000100:00100000:0.0:1762166822.056868:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765451933696:0@lo:400:kworker.0 00000100:00100000:2.0:1762166822.056882:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166822.056912:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166822.056920:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166822.056949:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451933440 00000100:00100000:3.0:1762166822.056955:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451933568 00000100:00100000:2.0:1762166822.056958:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451933440 00000100:00100000:3.0:1762166822.056961:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451933568 00000100:00100000:0.0:1762166822.056965:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451933312 00000100:00100000:0.0:1762166822.056971:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451933312 00000100:00100000:0.0:1762166822.057019:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451933824 00000100:00100000:0.0:1762166822.057022:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451933824 00000100:00100000:2.0:1762166822.057026:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1762166822.057034:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1762166822.057042:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451933440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166822.057048:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3293:x1847765451933568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166822.057052:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451933696 00000100:00100000:0.0:1762166822.057056:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451933696 00000100:00100000:0.0:1762166822.057089:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1762166822.057098:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1847765451933312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166822.057112:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3293:x1847765451933568:12345-0@lo:400:kworker.0 Request processed in 69us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166822.057114:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451933440:12345-0@lo:400:kworker.0 Request processed in 78us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166822.057128:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1762166822.057135:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1762166822.057148:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1847765451933312:12345-0@lo:400:kworker.0 Request processed in 51us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166822.057156:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1762166822.057179:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1762166822.057188:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1847765451933824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166822.057192:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451933568:0@lo:400:kworker.0 00000100:00100000:2.0:1762166822.057192:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1847765451933312:0@lo:400:kworker.0 00000100:00100000:3.0:1762166822.057215:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836747 gen 2 00000100:00100000:0.0:1762166822.057220:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1847765451933824:12345-0@lo:400:kworker.0 Request processed in 34us (341us total) trans 0 rc 0/0 00000004:00080000:3.0:1762166822.057221:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b0000, transno 21474836722 00000100:00100000:1.0:1762166822.057232:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000004:00080000:3.0:1762166822.057235:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce4000, transno 21474836726 00000004:00080000:3.0:1762166822.057239:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce6d80, transno 21474836727 00000004:00080000:3.0:1762166822.057243:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34371b100, transno 21474836729 00000100:00100000:1.0:1762166822.057247:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765451933696:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1762166822.057249:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee343718a80, transno 21474836730 00000004:00080000:3.0:1762166822.057259:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317c700, transno 21474836733 00000004:00080000:3.0:1762166822.057263:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317ea00, transno 21474836734 00000004:00080000:3.0:1762166822.057265:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a9880, transno 21474836735 00000004:00080000:3.0:1762166822.057268:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435aa680, transno 21474836736 00000004:00080000:3.0:1762166822.057272:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242523800, transno 21474836742 00000004:00080000:3.0:1762166822.057275:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242521f80, transno 21474836743 00000004:00080000:3.0:1762166822.057279:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce5180, transno 21474836746 00000004:00080000:3.0:1762166822.057282:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce7800, transno 21474836747 00000100:00100000:3.0:1762166822.057288:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451933440:0@lo:400:kworker.0 00000100:00100000:1.0:1762166822.057296:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765451933696:12345-0@lo:400:kworker.0 Request processed in 55us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166822.057538:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1847765451933824:0@lo:400:kworker.0 00000004:00080000:3.0:1762166822.057559:0:6728:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 13 done 00000100:00080000:2.0:1762166822.057585:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1762166822.057592:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1762166822.057594:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166822.057607:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765451933696:0@lo:400:kworker.0 00000100:00100000:2.0:1762166822.057619:0:5751:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451933184 00000100:00100000:2.0:1762166822.057624:0:5751:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451933184 00000100:00100000:2.0:1762166822.057652:0:5751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1762166822.057660:0:5751:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765451933184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166822.057707:0:5751:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765451933184:12345-0@lo:400:kworker.0 Request processed in 48us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166822.057715:0:5751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1762166822.057838:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451933184:0@lo:400:kworker.0 00000100:00100000:0.0:1762166822.058436:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1762166822.058467:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00010000:00010000:0.0:1762166822.248378:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166822.795251:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166822.795304:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444333824 00000100:00100000:0.0:1762166822.795321:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444333824 00000100:00100000:0.0:1762166822.795381:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 810 00000100:00100000:0.0:1762166822.795390:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3719b6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:45732:x1847765444333824:12345-192.168.203.35@tcp:35:rm.0 00000100:00100000:0.0:1762166822.795590:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3719b6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:45732:x1847765444333824:12345-192.168.203.35@tcp:35:rm.0 Request processed in 200us (348us total) trans 4294969091 rc 0/0 00000100:00100000:0.0:1762166822.795601:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 810 00000100:00100000:2.0:1762166822.799093:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166822.799652:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444334080 00000100:00100000:3.0:1762166822.799673:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444334080 00000100:00100000:3.0:1762166822.799737:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2646 00000100:00100000:3.0:1762166822.799747:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:45732:x1847765444334080:12345-192.168.203.35@tcp:36:rm.0 00010000:00010000:3.0:1762166822.799869:0:5755:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1762166822.799897:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9caef lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e8c expref: 25 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.799916:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cb19 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e93 expref: 24 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.799941:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159c00/0xf915a5bdf3c9ca7f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e77 expref: 23 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.799953:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee36062b400) 00010000:00010000:3.0:1762166822.799987:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686200/0xf915a5bdf3c9c880 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ddd expref: 22 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.800001:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166822.800011:0:5755:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166822.800037:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cb5f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.800049:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cb5f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.800059:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cb5f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.800072:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cb66 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.800084:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cb66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.800091:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cb66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.800217:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4a00/0xf915a5bdf3c9cb6d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.800224:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4a00/0xf915a5bdf3c9cb6d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.800232:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4a00/0xf915a5bdf3c9cb6d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000040:00080000:3.0:1762166822.801196:0:5755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].133, 64 off18928 00000004:00080000:3.0:1762166822.801207:0:5755:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 443593443398ns, next at 444593441298ns, rc = 0 00000040:00080000:3.0:1762166822.801252:0:5755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].134, 64 off18992 00000040:00080000:3.0:1762166822.801339:0:5755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].129, 64 off18560 00000004:00080000:3.0:1762166822.801347:0:5755:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 443593584320ns, next at 444593582730ns, rc = 0 00000040:00080000:3.0:1762166822.801385:0:5755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].130, 64 off18624 00010000:00010000:3.0:1762166822.801474:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cb74 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.801485:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cb74 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.801493:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cb74 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.801501:0:5755:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cb74 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.801506:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cb74 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.801513:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cb74 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.801541:0:5755:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166822.801559:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4a00/0xf915a5bdf3c9cb6d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.801565:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4a00/0xf915a5bdf3c9cb6d lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.801571:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4a00/0xf915a5bdf3c9cb6d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.801578:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f4a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166822.801583:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4a00/0xf915a5bdf3c9cb6d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.801596:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4a00/0xf915a5bdf3c9cb6d lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.801607:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee343a13e00) 00010000:00010000:3.0:1762166822.801609:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1762166822.801613:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4a00/0xf915a5bdf3c9cb6d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.801619:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4a00/0xf915a5bdf3c9cb6d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166822.801669:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.801683:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cb74 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166822.801690:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f5c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166822.801694:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cb74 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166822.801703:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cb74 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.801706:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cb5f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.801716:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cb5f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166822.801716:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11:0x0].0x0 (ffff9ee343a13e00) 00010000:00010000:2.0:1762166822.801723:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166822.801730:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cb5f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166822.801730:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cb74 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166822.801745:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cb74 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.801750:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f4e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166822.801755:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cb5f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.801782:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cb5f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166822.801792:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.801793:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13500) 00010000:00010000:2.0:1762166822.801798:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.801799:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166822.801803:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.801804:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cb5f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166822.801810:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cb5f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00000004:00010000:3.0:1762166822.801833:0:5755:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a743816e reply state 000000001c37625f transno 4294969092 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cb66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000100:00100000:3.0:1762166822.801840:0:5755:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166822.801930:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:45732:x1847765444334080:12345-192.168.203.35@tcp:36:rm.0 Request processed in 2182us (2839us total) trans 4294969092 rc 0/0 00000100:00100000:3.0:1762166822.801938:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2646 00010000:00010000:0.0:1762166822.803587:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cb66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166822.803613:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cb66 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166822.803620:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cb66 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166822.803626:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f4600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166822.803630:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cb66 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166822.803637:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cb66 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166822.803651:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff9ee343a13000) 00010000:00010000:0.0:1762166822.803655:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166822.803669:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cb66 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166822.803676:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cb66 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166823.271994:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1762166823.462739:0:30276:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-flr test_49a skipping ALWAYS excluded test 49a 00000004:00080000:1.0:1762166824.103976:0:7838:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 444896211355ns, next at 445896209411ns, rc = 0 00000100:00100000:3.0:1762166824.103980:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451933952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166824.104046:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166824.104153:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451933952 00000100:00100000:1.0:1762166824.104161:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451933952 00000100:00100000:1.0:1762166824.104316:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1762166824.104325:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1847765451933952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1762166824.104357:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 57737216 pending 0 free 3854565376 avail 3852468224 00000100:00100000:1.0:1762166824.104401:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1847765451933952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166824.104408:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1762166824.104461:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166824.104521:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451933952:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1762166824.279608:0:30324:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 50A: mirror split update layout generation ========================================================== 05:47:03 (1762166823) 00010000:00010000:3.0:1762166824.296161:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166824.301364:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166824.301491:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444334208 00000100:00100000:3.0:1762166824.301501:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444334208 00000100:00080000:2.0:1762166824.301566:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166824.301578:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2647 00000100:00100000:3.0:1762166824.301594:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:46017:x1847765444334208:12345-192.168.203.35@tcp:101:mkdir.0 00010000:00010000:3.0:1762166824.301618:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166824.301639:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4a00/0xf915a5bdf3c9cb7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ea8 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.301711:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cb82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.301721:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cb82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.301729:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cb82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000004:00200000:3.0:1762166824.301822:0:5755:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:3.0:1762166824.301826:0:5755:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166824.301938:0:5755:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cb82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.301965:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4a00/0xf915a5bdf3c9cb7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ea8 expref: 24 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.301981:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cb82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ea8 expref: 23 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.301990:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166824.301993:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166824.301997:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2425f4e00, rc 0) 00000100:00100000:3.0:1762166824.302052:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:46017:x1847765444334208:12345-192.168.203.35@tcp:101:mkdir.0 Request processed in 465us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166824.302058:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2647 00000100:00100000:3.0:1762166824.304292:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166824.304321:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444334464 00000100:00100000:3.0:1762166824.304328:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444334464 00000100:00100000:3.0:1762166824.304367:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2648 00000100:00100000:3.0:1762166824.304376:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:46017:x1847765444334464:12345-192.168.203.35@tcp:36:mkdir.0 00010000:00010000:3.0:1762166824.304420:0:5755:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166824.304444:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cb82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ea8 expref: 23 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.304460:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13f00) 00010000:00010000:3.0:1762166824.304470:0:5755:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166824.304542:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cb89 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.304554:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cb89 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.304574:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cb89 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.304616:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cb90 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.304624:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cb90 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.304631:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cb90 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000004:00200000:3.0:1762166824.305248:0:5755:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x14:0x0]: returning size 512 00010000:00010000:3.0:1762166824.305259:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cb89 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.305266:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cb89 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.305272:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cb89 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.305278:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f4200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166824.305282:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cb89 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.305290:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cb89 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.305300:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13300) 00010000:00010000:3.0:1762166824.305303:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166824.305306:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cb89 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.305323:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cb89 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00000004:00010000:3.0:1762166824.305336:0:5755:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f6eb04af reply state 00000000529971c2 transno 4294969093 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cb90 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000100:00100000:3.0:1762166824.305344:0:5755:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166824.305417:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:46017:x1847765444334464:12345-192.168.203.35@tcp:36:mkdir.0 Request processed in 1041us (1131us total) trans 4294969093 rc 0/0 00000100:00100000:3.0:1762166824.305425:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2648 00010000:00010000:3.0:1762166824.308039:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cb90 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.308053:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cb90 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.308060:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cb90 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.308066:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f5000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166824.308070:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cb90 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.308077:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cb90 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.308092:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe7a1a38 (ffff9ee343a13400) 00010000:00010000:3.0:1762166824.308095:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166824.308099:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cb90 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.308105:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cb90 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00000100:00100000:3.0:1762166824.314211:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166824.314514:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444334592 00000100:00100000:0.0:1762166824.314524:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444334592 00000100:00100000:0.0:1762166824.314585:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2649 00000100:00100000:0.0:1762166824.314596:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:46020:x1847765444334592:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166824.314620:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166824.314642:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cb97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90eaf expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.314730:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9cb9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166824.314744:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9cb9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166824.314755:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9cb9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000004:00200000:0.0:1762166824.314845:0:5755:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:0.0:1762166824.314849:0:5755:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166824.314872:0:5755:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9cb9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:0.0:1762166824.314907:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cb97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90eaf expref: 25 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.314924:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9cb9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90eaf expref: 24 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.314933:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:0.0:1762166824.314936:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166824.314940:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158e00, rc 0) 00000100:00100000:0.0:1762166824.315014:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:46020:x1847765444334592:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 419us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166824.315021:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2649 00000100:00100000:2.0:1762166824.317409:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166824.317453:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444334720 00000100:00100000:3.0:1762166824.317461:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444334720 00000100:00100000:3.0:1762166824.317509:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2650 00000100:00100000:3.0:1762166824.317519:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:46020:x1847765444334720:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166824.317533:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166824.317548:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cba5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90eb6 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.317601:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cbac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317614:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cbac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317624:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cbac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317636:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cbb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317643:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317661:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317804:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4a00/0xf915a5bdf3c9cbba lrc: 3/1,0 mode: --/PR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317813:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4a00/0xf915a5bdf3c9cbba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317828:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4a00/0xf915a5bdf3c9cbba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166824.317864:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x14:0x0]: returning size 512 00000004:00200000:3.0:1762166824.317878:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166824.317898:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4a00/0xf915a5bdf3c9cbba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317907:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cbac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317913:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cbac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317919:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cbac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317927:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f5000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166824.317931:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cbac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317937:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cbac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317947:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:3.0:1762166824.317951:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166824.317954:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cbac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317960:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cbac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317970:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317982:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cbb3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317988:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cbb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.317993:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f4e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166824.317996:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cbb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.318002:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cbb3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.318012:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe7a1a38 (ffff9ee343a13400) 00010000:00010000:3.0:1762166824.318015:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166824.318018:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cbb3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.318024:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cbb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.318057:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cba5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90eb6 expref: 26 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.318070:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4a00/0xf915a5bdf3c9cbba lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90eb6 expref: 25 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.318083:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee343a13300) 00010000:00010000:3.0:1762166824.318085:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1762166824.318087:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2425f4a00, rc 0) 00000100:00100000:3.0:1762166824.318151:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:46020:x1847765444334720:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 633us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166824.318165:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2650 00000100:00100000:3.0:1762166824.319656:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166824.319705:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444334976 00000100:00100000:0.0:1762166824.319712:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444334976 00000100:00100000:0.0:1762166824.319758:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2651 00000100:00100000:0.0:1762166824.319939:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:46020:x1847765444334976:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166824.319958:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166824.319972:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cbc1 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ebd expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.320079:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cbc8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166824.320092:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cbc8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166824.320101:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cbc8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166824.320113:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cbcf lrc: 3/0,1 mode: --/PW res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166824.320120:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cbcf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166824.320126:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cbcf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166824.320537:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cbd6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166824.320546:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166824.320552:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:0.0:1762166824.320562:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x15:0x0]: returning size 0 00010000:00010000:0.0:1762166824.320585:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cbc8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166824.320600:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cbc8 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166824.320606:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cbc8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166824.320611:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166824.320615:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cbc8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166824.320622:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cbc8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166824.320632:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee343a13300) 00010000:00010000:0.0:1762166824.320635:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166824.320639:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cbc8 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:0.0:1762166824.320645:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cbc8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000004:00010000:0.0:1762166824.320668:0:6558:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a8c459fa reply state 0000000033b0bb8c transno 4294969094 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cbcf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:0.0:1762166824.320676:0:6558:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762166824.320698:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cbc1 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ebd expref: 28 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.320710:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cbd6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ebd expref: 27 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.320717:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee36062b800) 00010000:00010000:0.0:1762166824.320724:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166824.320727:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159600, rc 0) 00000100:00100000:0.0:1762166824.320793:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:46020:x1847765444334976:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 858us (1149us total) trans 4294969094 rc 0/0 00000100:00100000:0.0:1762166824.320800:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2651 00010000:00010000:1.0:1762166824.323231:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cbcf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.323245:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cbcf lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.323252:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cbcf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.323257:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166824.323262:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cbcf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.323268:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cbcf lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.323293:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0xaf1e71b4 (ffff9ee36062ba00) 00010000:00010000:1.0:1762166824.323296:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166824.323300:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cbcf lrc: 2/0,0 mode: --/PW res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.323306:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cbcf lrc: 0/0,0 mode: --/PW res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166824.324031:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166824.324152:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444335232 00000100:00100000:1.0:1762166824.324161:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444335232 00000100:00100000:1.0:1762166824.324216:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2652 00000100:00100000:1.0:1762166824.324226:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:46020:x1847765444335232:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166824.324248:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166824.324264:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9cbe4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ec4 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.324420:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9cbeb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.324430:0:6558:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cbd6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ebd expref: 28 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.324436:0:6558:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9cbeb lrc: 4/0,1 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.324461:0:6558:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cbd6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ebd expref: 28 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.324470:0:6558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cbd6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ebd expref: 28 pid: 6558 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1762166824.324489:0:6558:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451934080:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166824.324568:0:6558:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166824.325722:0:6558:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451934080:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166824.325744:0:6558:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9cbeb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166824.326057:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166824.326355:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444335360 00000100:00100000:2.0:1762166824.326361:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444335360 00010000:00010000:2.0:1762166824.326390:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cbd6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ebd expref: 29 pid: 6558 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1762166824.326423:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 592 00000100:00100000:2.0:1762166824.326439:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444335360:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166824.326451:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166824.326457:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cbd6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ebd expref: 29 pid: 6558 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1762166824.326469:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cbd6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ebd expref: 29 pid: 6558 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1762166824.326487:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cbd6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ebd expref: 29 pid: 6558 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1762166824.326505:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee36062b800) 00010000:00010000:2.0:1762166824.326509:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9cbeb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166824.326517:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9cbeb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166824.326523:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9cbeb lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166824.326552:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166824.326581:0:6558:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9cbeb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.326590:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9cbeb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000100:00100000:2.0:1762166824.326602:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444335360:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 163us (544us total) trans 0 rc 0/0 00000004:00200000:1.0:1762166824.326605:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x15:0x0]: returning size 0 00000100:00100000:2.0:1762166824.326613:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 592 00000004:00080000:1.0:1762166824.326930:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x66:0x0], index 0: 0 00010000:00010000:1.0:1762166824.327071:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9cbeb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.327078:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9cbeb lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.327085:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9cbeb lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.327091:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166824.327095:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9cbeb lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.327101:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9cbeb lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.327112:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee36062b800) 00010000:00010000:1.0:1762166824.327122:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166824.327126:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9cbeb lrc: 2/0,0 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.327131:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9cbeb lrc: 0/0,0 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.327183:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9cbe4 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ec4 expref: 28 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.327193:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee343a13300) 00010000:00010000:1.0:1762166824.327195:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166824.327200:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9cbe4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ec4 expref: 28 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.327209:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472400, rc 0) 00000100:00100000:1.0:1762166824.327247:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:46020:x1847765444335232:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3022us (3217us total) trans 4294969095 rc 301/301 00000100:00100000:1.0:1762166824.327256:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2652 00000100:00100000:3.0:1762166824.329349:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166824.329400:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444335616 00000100:00100000:1.0:1762166824.329410:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444335616 00000100:00100000:1.0:1762166824.329460:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 811 00000100:00100000:1.0:1762166824.329470:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:46020:x1847765444335616:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166824.329778:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:46020:x1847765444335616:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 293us (418us total) trans 4294969096 rc 0/0 00000100:00100000:1.0:1762166824.329785:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 811 00000100:00100000:3.0:1762166824.331578:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166824.331679:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444335744 00000100:00100000:1.0:1762166824.331686:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444335744 00000100:00100000:1.0:1762166824.331731:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2653 00000100:00100000:1.0:1762166824.331748:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:46020:x1847765444335744:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166824.331789:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166824.331810:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9cbf9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ecb expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.331862:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9cbf9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ecb expref: 29 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.331874:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9cbf9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ecb expref: 29 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.331890:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:1.0:1762166824.331893:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166824.331896:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472e00, rc 0) 00000100:00100000:1.0:1762166824.331939:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:46020:x1847765444335744:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 193us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166824.331946:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2653 00000100:00100000:2.0:1762166824.335219:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166824.335266:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444336000 00000100:00100000:1.0:1762166824.335276:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444336000 00000100:00100000:1.0:1762166824.335326:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 812 00000100:00100000:1.0:1762166824.335337:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:46020:x1847765444336000:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166824.335551:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:46020:x1847765444336000:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 215us (340us total) trans 4294969097 rc 0/0 00000100:00100000:1.0:1762166824.335560:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 812 00000100:00100000:1.0:1762166824.345239:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166824.345292:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444336256 00000100:00100000:3.0:1762166824.345303:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444336256 00000100:00100000:3.0:1762166824.345354:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2654 00000100:00100000:3.0:1762166824.345366:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:46025:x1847765444336256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166824.345388:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166824.345405:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cc00 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ed2 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.345472:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc07 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345486:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc07 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345496:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc07 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345509:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cc0e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345517:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cc0e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345524:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cc0e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345679:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5600/0xf915a5bdf3c9cc15 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345688:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5600/0xf915a5bdf3c9cc15 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345696:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5600/0xf915a5bdf3c9cc15 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000004:00200000:3.0:1762166824.345707:0:5755:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x15:0x0]: returning size 0 00010000:00010000:3.0:1762166824.345838:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc07 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345845:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc07 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345852:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc07 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345856:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f5000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166824.345860:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc07 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345866:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc07 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345879:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee343a13300) 00010000:00010000:3.0:1762166824.345882:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166824.345885:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc07 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345891:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc07 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345913:0:5755:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cc0e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345919:0:5755:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cc0e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345925:0:5755:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cc0e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345931:0:5755:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f4000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166824.345935:0:5755:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cc0e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345941:0:5755:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cc0e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345951:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0xaf1e71b4 (ffff9ee343a13400) 00010000:00010000:3.0:1762166824.345954:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166824.345956:0:5755:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cc0e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.345961:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cc0e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.346003:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cc00 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ed2 expref: 33 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.346019:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5600/0xf915a5bdf3c9cc15 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ed2 expref: 32 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.346026:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:3.0:1762166824.346034:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166824.346037:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2425f5600, rc 0) 00000100:00100000:3.0:1762166824.346087:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:46025:x1847765444336256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 724us (857us total) trans 4294969098 rc 0/0 00000100:00100000:3.0:1762166824.346096:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2654 00000100:00100000:2.0:1762166824.349701:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166824.349736:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444336512 00000100:00100000:2.0:1762166824.349745:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444336512 00000100:00100000:2.0:1762166824.349807:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2655 00000100:00100000:2.0:1762166824.349822:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:46025:x1847765444336512:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166824.349845:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166824.349862:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9cc23 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ed9 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.350396:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9cc2a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166824.350409:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9cc2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166824.350420:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9cc2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000004:00200000:2.0:1762166824.350430:0:5755:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x16:0x0]: returning size 0 00010000:00010000:2.0:1762166824.350472:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9cc23 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ed9 expref: 35 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.350487:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9cc2a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ed9 expref: 34 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.350496:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:2.0:1762166824.350499:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166824.350502:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15e00, rc 0) 00000100:00100000:2.0:1762166824.350553:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:46025:x1847765444336512:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 733us (858us total) trans 4294969099 rc 0/0 00000100:00100000:2.0:1762166824.350561:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2655 00000100:00100000:2.0:1762166824.354735:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166824.354780:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444336768 00000100:00100000:2.0:1762166824.354789:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444336768 00000100:00100000:2.0:1762166824.354844:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2656 00000100:00100000:2.0:1762166824.354854:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:46025:x1847765444336768:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166824.354876:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166824.354893:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9cc38 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ee0 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.354981:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cc3f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166824.354996:0:6558:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9cc2a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ed9 expref: 35 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.355004:0:6558:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cc3f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:2.0:1762166824.355035:0:6558:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9cc2a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ed9 expref: 35 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.355048:0:6558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9cc2a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ed9 expref: 35 pid: 5755 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1762166824.355061:0:6558:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451934208:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166824.355125:0:6558:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eef900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166824.359101:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166824.359145:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444336896 00000100:00100000:1.0:1762166824.359159:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444336896 00010000:00010000:1.0:1762166824.359196:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9cc2a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ed9 expref: 36 pid: 5755 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1762166824.359247:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 593 00000100:00100000:1.0:1762166824.359259:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3456e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765444336896:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166824.359273:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166824.359280:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9cc2a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ed9 expref: 36 pid: 5755 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1762166824.359294:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9cc2a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ed9 expref: 36 pid: 5755 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1762166824.359327:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:1.0:1762166824.359333:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cc3f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.359341:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cc3f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.359348:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cc3f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.359366:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166824.359413:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3456e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765444336896:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 156us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166824.359422:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 593 00010000:00010000:1.0:1762166824.359608:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15e00/0xf915a5bdf3c9cc2a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ed9 expref: 35 pid: 5755 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1762166824.359634:0:6558:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6558:1847765451934208:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166824.359670:0:6558:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cc3f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.359686:0:6558:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cc3f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.359692:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cc3f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:1.0:1762166824.359708:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x16:0x0]: returning size 0 00000004:00080000:1.0:1762166824.359890:0:6558:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x60:0x0], index 1: 0 00010000:00010000:1.0:1762166824.360985:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cc3f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.360997:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cc3f lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.361003:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cc3f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.361009:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166824.361013:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cc3f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.361020:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cc3f lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.361032:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:1.0:1762166824.361035:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166824.361038:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cc3f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.361051:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cc3f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.361109:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9cc38 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ee0 expref: 35 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.361120:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee343a13300) 00010000:00010000:1.0:1762166824.361123:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166824.361127:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9cc38 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ee0 expref: 35 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.361137:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15c00, rc 0) 00000100:00100000:1.0:1762166824.361182:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:46025:x1847765444336768:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 6330us (6454us total) trans 4294969100 rc 301/301 00000100:00100000:1.0:1762166824.361191:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2656 00000100:00100000:1.0:1762166824.366840:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166824.366903:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444337152 00000100:00100000:0.0:1762166824.366913:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444337152 00000100:00100000:0.0:1762166824.366972:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 813 00000100:00100000:0.0:1762166824.366983:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:46025:x1847765444337152:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166824.367329:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:46025:x1847765444337152:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 347us (493us total) trans 4294969101 rc 0/0 00000100:00100000:0.0:1762166824.367337:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 813 00000100:00100000:1.0:1762166824.369336:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166824.369392:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444337280 00000100:00100000:0.0:1762166824.369399:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444337280 00000100:00080000:1.0:1762166824.369455:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166824.369469:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 960 00000100:00100000:0.0:1762166824.369478:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444337280:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166824.369492:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166824.369510:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cc4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ee7 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166824.369533:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166824.369641:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166824.369644:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166824.369662:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cc4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ee7 expref: 9 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166824.369689:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cc4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ee7 expref: 9 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166824.369711:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159800, rc 0) 00000100:00100000:0.0:1762166824.369892:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444337280:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 415us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166824.369899:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 960 00000100:00100000:1.0:1762166824.371470:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166824.371669:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444337408 00000100:00100000:3.0:1762166824.371782:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444337408 00000100:00100000:3.0:1762166824.371929:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2657 00000100:00100000:3.0:1762166824.371940:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:46025:x1847765444337408:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166824.371958:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166824.371977:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cc54 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90eee expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.372043:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cc5b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.372060:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cc5b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.372071:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cc5b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166824.372285:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x16:0x0]: returning size 0 00000004:00200000:3.0:1762166824.372290:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166824.372305:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cc5b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.372331:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cc54 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90eee expref: 37 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.372349:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cc5b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90eee expref: 36 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.372370:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:3.0:1762166824.372373:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762166824.372376:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2425f4000, rc 0) 00000100:00100000:3.0:1762166824.372433:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:46025:x1847765444337408:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 494us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166824.372441:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2657 00000100:00100000:1.0:1762166824.375358:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166824.375417:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444337536 00000100:00100000:0.0:1762166824.375425:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444337536 00000100:00100000:0.0:1762166824.375486:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 961 00000100:00100000:0.0:1762166824.375496:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2361:x1847765444337536:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166824.375512:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166824.375529:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cc62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ef5 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166824.375563:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166824.375585:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166824.375587:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166824.375596:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cc62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ef5 expref: 10 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166824.375612:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cc62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ef5 expref: 10 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166824.375629:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159200, rc 0) 00000100:00080000:1.0:1762166824.375661:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166824.375687:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444337536:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 192us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166824.375695:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 961 00000100:00100000:1.0:1762166824.378613:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166824.378673:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444337792 00000100:00100000:3.0:1762166824.378683:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444337792 00000100:00100000:3.0:1762166824.378740:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2658 00000100:00100000:3.0:1762166824.378750:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:46025:x1847765444337792:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166824.378803:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166824.378823:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc69 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90efc expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.378921:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cc70 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.378935:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cc70 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.378945:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cc70 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166824.378956:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x15:0x0]: returning size 0 00010000:00010000:3.0:1762166824.379070:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc69 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x15:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90efc expref: 39 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.379087:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cc70 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90efc expref: 38 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.379109:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:3.0:1762166824.379112:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166824.379116:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2425f4e00, rc 0) 00000100:00100000:3.0:1762166824.379176:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:46025:x1847765444337792:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 427us (570us total) trans 4294969102 rc 0/0 00000100:00100000:3.0:1762166824.379183:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2658 00000100:00100000:1.0:1762166824.381222:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166824.381292:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444337920 00000100:00100000:0.0:1762166824.381300:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444337920 00000100:00100000:0.0:1762166824.381348:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 962 00000100:00100000:0.0:1762166824.381358:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444337920:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762166824.381392:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cc7e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.381466:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166824.381468:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166824.381474:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cc7e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.381486:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cc7e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.381514:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cc7e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.381521:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cc7e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.381529:0:12400:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cc7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.381536:0:12400:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166824.381541:0:12400:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cc7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.381549:0:12400:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cc7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.381572:0:12400:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cc7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.381580:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cc7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166824.381644:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444337920:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 287us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166824.381662:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 962 00000100:00100000:1.0:1762166824.412239:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166824.412324:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444338048 00000100:00100000:0.0:1762166824.412334:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444338048 00000100:00100000:0.0:1762166824.412394:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2659 00000100:00100000:0.0:1762166824.412405:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:46025:x1847765444338048:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:1.0:1762166824.432971:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969101 is committed 00000004:00080000:1.0:1762166824.433009:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 116 committed 00000001:00080000:1.0:1762166824.433037:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969102 is committed 00000004:00080000:1.0:1762166824.433048:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 115 committed 00000004:00080000:1.0:1762166824.433063:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 118 committed 00000100:00100000:2.0:1762166824.433083:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:46025:x1847765444338048:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 20673us (20845us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166824.433095:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2659 00000100:00100000:1.0:1762166824.433201:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762166824.433216:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451934336:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166824.433270:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166824.433299:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451934336 00000100:00100000:0.0:1762166824.433307:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451934336 00000100:00080000:1.0:1762166824.433350:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166824.433371:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451934592:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166824.433372:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451934464:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166824.433396:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:3.0:1762166824.433403:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166824.433411:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451934336:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762166824.433425:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451934464 00000100:00100000:0.0:1762166824.433430:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451934464 00002000:00080000:1.0:1762166824.433434:0:7858:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:100 count 1 00000100:00100000:0.0:1762166824.433458:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00010000:00010000:1.0:1762166824.433460:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9cc85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166824.433468:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765451934464:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1762166824.433485:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ca24 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e5b expref: 8 pid: 12400 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1762166824.433486:0:6532:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:94 count 1 00010000:00010000:1.0:1762166824.433498:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166824.433501:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166824.433504:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cc8c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166824.433505:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166824.433507:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9cc85 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.433529:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9cb3c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e9a expref: 9 pid: 12400 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762166824.433538:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451934592 00010000:00010000:1.0:1762166824.433547:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ca24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e5b expref: 8 pid: 12400 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762166824.433549:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451934592 00010000:00010000:0.0:1762166824.433551:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166824.433554:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166824.433559:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cc8c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.433569:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ca24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e5b expref: 8 pid: 12400 timeout: 545 lvb_type: 1 00000100:00100000:1.0:1762166824.433582:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451934720:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166824.433588:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9cb3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e9a expref: 9 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166824.433600:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9cb3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e9a expref: 9 pid: 12400 timeout: 545 lvb_type: 1 00000100:00100000:0.0:1762166824.433611:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451934848:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166824.433629:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166824.433644:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee345adf900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166824.433657:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1762166824.433665:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765451934592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1762166824.433679:0:6533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:95 count 1 00010000:00010000:3.0:1762166824.433699:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc93 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.433711:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee244473200/0xf915a5bdf3c9cb43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ea1 expref: 9 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166824.433725:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166824.433727:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166824.433737:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc93 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.433808:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee244473200/0xf915a5bdf3c9cb43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ea1 expref: 9 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166824.433842:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee244473200/0xf915a5bdf3c9cb43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ea1 expref: 9 pid: 7858 timeout: 545 lvb_type: 1 00000100:00100000:3.0:1762166824.433852:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765451934976:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166824.433923:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f939180 going to sleep for 11 seconds 00000100:00100000:0.0:1762166824.435293:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166824.435453:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444338176 00000100:00100000:1.0:1762166824.435469:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444338176 00000100:00100000:1.0:1762166824.435520:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 966 00000100:00100000:1.0:1762166824.435530:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2360:x1847765444338176:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:1.0:1762166824.435621:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2360:x1847765444338176:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 91us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166824.435629:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 966 00000100:00100000:1.0:1762166824.440163:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166824.440200:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166824.440239:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166824.440267:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444338304 00000100:00100000:1.0:1762166824.440276:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444338304 00010000:00010000:1.0:1762166824.440311:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ca24 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e5b expref: 9 pid: 12400 timeout: 545 lvb_type: 1 00000100:00100000:1.0:1762166824.440340:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444338432 00000100:00100000:1.0:1762166824.440343:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444338432 00010000:00010000:1.0:1762166824.440356:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9cb3c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e9a expref: 10 pid: 12400 timeout: 545 lvb_type: 1 00000100:00100000:1.0:1762166824.440370:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444338560 00000100:00100000:1.0:1762166824.440372:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444338560 00010000:00010000:1.0:1762166824.440381:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244473200/0xf915a5bdf3c9cb43 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ea1 expref: 11 pid: 7858 timeout: 545 lvb_type: 1 00000100:00100000:1.0:1762166824.440398:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 594 00000100:00100000:1.0:1762166824.440406:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444338304:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166824.440418:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166824.440424:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ca24 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e5b expref: 9 pid: 12400 timeout: 545 lvb_type: 1 00010000:00010000:1.0:1762166824.440447:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ca24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e5b expref: 9 pid: 12400 timeout: 545 lvb_type: 1 00010000:00010000:1.0:1762166824.440470:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166824.440472:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166824.440490:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9cc85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.440500:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9cc85 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.440520:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166824.440562:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444338304:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 156us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166824.440570:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 594 00000100:00100000:1.0:1762166824.440586:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 595 00000100:00100000:1.0:1762166824.440592:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765444338432:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166824.440599:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166824.440603:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9cb3c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e9a expref: 11 pid: 12400 timeout: 545 lvb_type: 1 00010000:00010000:1.0:1762166824.440612:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9cb3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e9a expref: 11 pid: 12400 timeout: 545 lvb_type: 1 00010000:00010000:1.0:1762166824.440630:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166824.440631:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166824.440640:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cc8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.440659:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cc8c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.440671:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166824.440689:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765444338432:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 98us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166824.440696:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 595 00000100:00100000:1.0:1762166824.440711:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 596 00000100:00100000:1.0:1762166824.440717:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2360:x1847765444338560:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166824.440726:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166824.440742:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee244473200/0xf915a5bdf3c9cb43 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ea1 expref: 10 pid: 7858 timeout: 545 lvb_type: 1 00010000:00010000:0.0:1762166824.440745:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc14e00/0xf915a5bdf3c9cb3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e9a expref: 10 pid: 12400 timeout: 545 lvb_type: 1 00010000:00010000:1.0:1762166824.440789:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee244473200/0xf915a5bdf3c9cb43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ea1 expref: 10 pid: 7858 timeout: 545 lvb_type: 1 00010000:00010000:1.0:1762166824.440803:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166824.440805:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166824.440808:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.440816:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc93 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.440827:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166824.440864:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2360:x1847765444338560:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 139us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166824.440870:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 596 00000100:00100000:0.0:1762166824.441033:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451934848:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166824.441053:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cc8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.441128:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cc8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.441137:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cc8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.441147:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cc8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.441155:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cc8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.441180:0:6532:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166824.441572:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee244473200/0xf915a5bdf3c9cb43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ea1 expref: 8 pid: 7858 timeout: 545 lvb_type: 1 00000100:00100000:3.0:1762166824.441586:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765451934976:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166824.441601:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.441609:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.441615:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.441622:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.441629:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.441658:0:6533:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1762166824.441694:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1762166824.441701:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cc8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.441722:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166824.441726:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cc8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.441735:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cc8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.441748:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cc8c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.441755:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cc8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.441800:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166824.441804:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.441811:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f5000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166824.441814:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.441821:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.441833:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc93 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.441850:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cc93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.441868:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166824.441871:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166824.441873:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166824.441903:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166824.441932:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ca24 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e5b expref: 8 pid: 12400 timeout: 545 lvb_type: 1 00000100:00100000:2.0:1762166824.441946:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451934720:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166824.441970:0:7858:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9cc85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.441979:0:7858:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9cc85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.441986:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9cc85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.441995:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9cc85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.442003:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9cc85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.442030:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1762166824.442675:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765451934336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9267us (9403us total) trans 21474836748 rc 0/0 00000100:00100000:2.0:1762166824.442686:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00010000:00010000:2.0:1762166824.442715:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166824.442721:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9cc85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.442728:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166824.442732:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9cc85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.442739:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9cc85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.442752:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9cc85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.442759:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9cc85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.442799:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166824.442802:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166824.442804:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1762166824.443572:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee374ab2300/2, rc 0, transno 21474836748 00000100:00100000:0.0:1762166824.443600:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451934336:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166824.443676:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765451934464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10208us (10270us total) trans 17179869418 rc 0/0 00000100:00100000:1.0:1762166824.443685:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000004:00080000:0.0:1762166824.443796:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37ff80700/2, rc 0, transno 17179869418 00000100:00100000:0.0:1762166824.443803:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451934464:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166824.447076:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765451934592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13403us (13562us total) trans 17179869419 rc 0/0 00000100:00100000:3.0:1762166824.447095:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000004:00080000:0.0:1762166824.447190:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e2bc380/2, rc 0, transno 17179869419 00000100:00100000:0.0:1762166824.447204:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451934592:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762166824.448627:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166824.449078:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444338688 00000100:00100000:3.0:1762166824.449087:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444338688 00000100:00100000:3.0:1762166824.449675:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 967 00000100:00100000:3.0:1762166824.449691:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2361:x1847765444338688:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762166824.449734:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cc9a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.449748:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166824.449750:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166824.449755:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cc9a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.449794:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cc9a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.449824:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cc9a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.449832:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cc9a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.449840:0:6533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cc9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.449847:0:6533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f4200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166824.449851:0:6533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cc9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.449877:0:6533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cc9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.449893:0:6533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cc9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.449899:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cc9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166824.450150:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2361:x1847765444338688:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 460us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166824.450167:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 967 00000100:00100000:1.0:1762166824.452989:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166824.453081:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444338944 00000100:00100000:2.0:1762166824.453091:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444338944 00000100:00100000:2.0:1762166824.453143:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2660 00000100:00100000:2.0:1762166824.453152:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:46025:x1847765444338944:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762166824.453202:0:5755:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166824.453226:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cc5b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90eee expref: 22 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.453244:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:2.0:1762166824.453253:0:5755:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166824.453282:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9cca1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166824.453294:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9cca1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166824.453304:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9cca1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000004:00010000:2.0:1762166824.453672:0:5755:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e78bac87 reply state 00000000b465349f transno 4294969103 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9cca1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000100:00100000:2.0:1762166824.453681:0:5755:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166824.453911:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:46025:x1847765444338944:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 758us (929us total) trans 4294969103 rc 0/0 00000100:00100000:2.0:1762166824.453920:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2660 00000100:00100000:1.0:1762166824.455655:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166824.455723:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444339072 00000100:00100000:2.0:1762166824.455730:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444339072 00010000:00010000:3.0:1762166824.455887:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9cca1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.455898:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9cca1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.455905:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9cca1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.455911:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166824.455915:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9cca1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.455922:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9cca1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.455936:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16:0x0].0x0 (ffff9ee360714500) 00010000:00010000:3.0:1762166824.455939:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166824.455943:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9cca1 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:3.0:1762166824.455949:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9cca1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00000100:00100000:2.0:1762166824.456042:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2661 00000100:00100000:2.0:1762166824.456053:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:46025:x1847765444339072:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166824.456073:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166824.456089:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cca8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f03 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.456142:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cca8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f03 expref: 23 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.456155:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cca8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f03 expref: 23 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.456176:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16:0x0].0x0 (ffff9ee360714f00) 00010000:00010000:2.0:1762166824.456179:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166824.456181:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15800, rc 0) 00000100:00100000:2.0:1762166824.456247:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:46025:x1847765444339072:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 196us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166824.456254:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2661 00000100:00100000:1.0:1762166824.458479:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166824.458565:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444339200 00000100:00100000:2.0:1762166824.458573:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444339200 00000100:00100000:2.0:1762166824.458628:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 968 00000100:00100000:2.0:1762166824.458639:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444339200:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166824.458966:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x60:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166824.458970:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x60:0x0] updating lvb mtime from disk: 0 -> 1762166824 00002000:00010000:2.0:1762166824.458973:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x60:0x0] updating lvb atime from disk: 0 -> 1762166824 00002000:00010000:2.0:1762166824.458976:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x60:0x0] updating lvb ctime from disk: 0 -> 1762166824 00002000:00010000:2.0:1762166824.458978:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x60:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166824.459054:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444339200:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 416us (582us total) trans 17179869420 rc 0/0 00000100:00100000:2.0:1762166824.459062:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 968 00000100:00100000:1.0:1762166824.462039:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166824.462090:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444339456 00000100:00100000:2.0:1762166824.462099:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444339456 00000100:00100000:2.0:1762166824.462155:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2662 00000100:00100000:2.0:1762166824.462165:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:46025:x1847765444339456:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762166824.462213:0:5755:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166824.462248:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5600/0xf915a5bdf3c9cc15 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ed2 expref: 23 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.462265:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:2.0:1762166824.462271:0:5755:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166824.462322:0:5755:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9ccaf lrc: 3/0,1 mode: --/PW res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166824.462335:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9ccaf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166824.462344:0:5755:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9ccaf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000004:00010000:2.0:1762166824.462463:0:5755:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000991be6cb reply state 0000000085e3697a transno 4294969104 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9ccaf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 00000100:00100000:2.0:1762166824.462471:0:5755:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166824.462556:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:46025:x1847765444339456:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 392us (524us total) trans 4294969104 rc 0/0 00000100:00100000:2.0:1762166824.462563:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2662 00010000:00010000:2.0:1762166824.463971:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9ccaf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166824.463999:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9ccaf lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166824.464006:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9ccaf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166824.464012:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166824.464016:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9ccaf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166824.464023:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9ccaf lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166824.464043:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:2.0:1762166824.464046:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166824.464054:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9ccaf lrc: 2/0,0 mode: --/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00010000:00010000:2.0:1762166824.464060:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9ccaf lrc: 0/0,0 mode: --/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 00000100:00100000:1.0:1762166824.464443:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166824.464594:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444339584 00000100:00100000:2.0:1762166824.464602:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444339584 00000100:00100000:2.0:1762166824.464659:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 969 00000100:00100000:2.0:1762166824.464668:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444339584:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166824.464889:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x66:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166824.464893:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x66:0x0] updating lvb mtime from disk: 0 -> 1762166824 00002000:00010000:2.0:1762166824.464896:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x66:0x0] updating lvb atime from disk: 0 -> 1762166824 00002000:00010000:2.0:1762166824.464898:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x66:0x0] updating lvb ctime from disk: 0 -> 1762166824 00002000:00010000:2.0:1762166824.464900:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x66:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166824.464959:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444339584:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 292us (518us total) trans 21474836749 rc 0/0 00000100:00100000:2.0:1762166824.464967:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 969 00000100:00100000:1.0:1762166824.467184:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166824.467250:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444339840 00000100:00100000:0.0:1762166824.467259:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444339840 00000100:00100000:0.0:1762166824.467318:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 814 00000100:00100000:0.0:1762166824.467327:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:46025:x1847765444339840:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166824.467393:0:5758:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x15:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cc70 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90efc expref: 23 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.467429:0:5758:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ccb6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166824.467441:0:5758:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9cbf9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ecb expref: 23 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.467448:0:5758:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ccb6 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166824.467480:0:5758:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9cbf9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ecb expref: 23 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166824.467493:0:5758:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9cbf9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ecb expref: 23 pid: 6558 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1762166824.467506:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1847765451935104:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166824.467588:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee345adf900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166824.468830:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1847765451935104:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166824.468854:0:5758:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ccb6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00000100:00100000:1.0:1762166824.469121:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166824.469182:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444339968 00000100:00100000:0.0:1762166824.469187:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444339968 00010000:00010000:0.0:1762166824.469205:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9cbf9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ecb expref: 24 pid: 6558 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1762166824.469231:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 597 00000100:00100000:0.0:1762166824.469237:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444339968:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166824.469247:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166824.469251:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9cbf9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ecb expref: 24 pid: 6558 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1762166824.469258:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9cbf9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ecb expref: 24 pid: 6558 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1762166824.469271:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9cbf9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ecb expref: 24 pid: 6558 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1762166824.469281:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:0.0:1762166824.469284:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ccb6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166824.469289:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ccb6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166824.469294:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ccb6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166824.469312:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166824.469344:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444339968:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 108us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166824.469354:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 597 00010000:00010000:2.0:1762166824.469410:0:5758:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ccb6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.469420:0:5758:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ccb6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.469439:0:5758:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9ccbd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.469450:0:5758:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cca8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f03 expref: 22 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.469457:0:5758:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9ccbd lrc: 4/0,1 mode: --/EX res: [0x200000404:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.469696:0:5758:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cca8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f03 expref: 22 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.469710:0:5758:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cca8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f03 expref: 22 pid: 5755 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1762166824.469722:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1847765451935232:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166824.469814:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c59780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166824.470959:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1847765451935232:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166824.470980:0:5758:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9ccbd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00000100:00100000:3.0:1762166824.471398:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166824.471468:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444340096 00000100:00100000:1.0:1762166824.471474:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444340096 00010000:00010000:1.0:1762166824.471510:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cca8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f03 expref: 23 pid: 5755 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1762166824.471547:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 598 00000100:00100000:1.0:1762166824.471556:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444340096:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166824.471567:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166824.471572:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cca8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f03 expref: 23 pid: 5755 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1762166824.471583:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cca8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f03 expref: 23 pid: 5755 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1762166824.471599:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cca8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f03 expref: 23 pid: 5755 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1762166824.471613:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16:0x0].0x0 (ffff9ee360714f00) 00010000:00010000:1.0:1762166824.471617:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9ccbd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166824.471626:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9ccbd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166824.471632:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9ccbd lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 00010000:00010000:1.0:1762166824.471662:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166824.471708:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444340096:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 153us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166824.471715:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 598 00010000:00010000:2.0:1762166824.471796:0:5758:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9ccbd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.471809:0:5758:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9ccbd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 00000100:00100000:2.0:1762166824.472683:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451935360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166824.472977:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166824.473006:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166824.473016:0:5760:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451935360 00000100:00100000:1.0:1762166824.473030:0:5760:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451935360 00000100:00100000:1.0:1762166824.473081:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1762166824.473089:0:5760:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5758:x1847765451935360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166824.473176:0:5760:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5758:x1847765451935360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166824.473183:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1762166824.473216:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451935360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166824.473287:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451935488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166824.473313:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166824.473338:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eef480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166824.473378:0:5760:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451935488 00000100:00100000:1.0:1762166824.473383:0:5760:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451935488 00000100:00100000:1.0:1762166824.473410:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1762166824.473416:0:5760:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:5758:x1847765451935488:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166824.473468:0:5760:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:5758:x1847765451935488:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 52us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166824.473474:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1762166824.473504:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451935488:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:2.0:1762166824.474118:0:5758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].14, 280 off37408 00000001:00080000:2.0:1762166824.474129:0:5758:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294969105 00000100:00100000:2.0:1762166824.474184:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f620a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451935616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166824.474217:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166824.474238:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eefd80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166824.474255:0:5760:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451935616 00000100:00100000:1.0:1762166824.474261:0:5760:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451935616 00000100:00100000:1.0:1762166824.474298:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1762166824.474306:0:5760:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:5758:x1847765451935616:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166824.474436:0:5760:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:5758:x1847765451935616:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 131us (218us total) trans 17179869421 rc 0/0 00000100:00100000:1.0:1762166824.474443:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1762166824.474473:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f620a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451935616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166824.474498:0:5758:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f623b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451935744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166824.474522:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166824.474548:0:5758:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24375dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166824.475022:0:5760:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451935744 00000100:00100000:1.0:1762166824.475027:0:5760:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451935744 00000100:00100000:1.0:1762166824.475055:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1762166824.475064:0:5760:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5758:x1847765451935744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166824.475183:0:5760:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5758:x1847765451935744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 120us (658us total) trans 21474836750 rc 0/0 00000100:00100000:1.0:1762166824.475190:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1762166824.475259:0:5758:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f623b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1847765451935744:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1762166824.475337:0:5758:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294969106 00010000:00010000:2.0:1762166824.475431:0:5758:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9ccbd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.475452:0:5758:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9ccbd lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.475459:0:5758:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9ccbd lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.475465:0:5758:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc14400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166824.475469:0:5758:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9ccbd lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.475476:0:5758:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9ccbd lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x16:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.475490:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16:0x0].0x0 (ffff9ee360714f00) 00010000:00010000:2.0:1762166824.475492:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166824.475496:0:5758:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9ccbd lrc: 2/0,0 mode: --/EX res: [0x200000404:0x16:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.475502:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14400/0xf915a5bdf3c9ccbd lrc: 0/0,0 mode: --/EX res: [0x200000404:0x16:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.475520:0:5758:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ccb6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.475526:0:5758:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ccb6 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.475532:0:5758:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ccb6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.475537:0:5758:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166824.475539:0:5758:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ccb6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.475554:0:5758:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ccb6 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.475563:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:2.0:1762166824.475565:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166824.475568:0:5758:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ccb6 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.475572:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ccb6 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.475583:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:2.0:1762166824.475586:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166824.475592:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cc70 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x15:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90efc expref: 24 pid: 6558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166824.475695:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:46025:x1847765444339840:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 8368us (8516us total) trans 4294969107 rc 0/0 00000100:00100000:2.0:1762166824.475703:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 814 00000020:00080000:2.0:1762166824.475707:0:5758:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166824.477404:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166824.477532:0:5755:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444340224 00000100:00100000:2.0:1762166824.477538:0:5755:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444340224 00000100:00100000:2.0:1762166824.477589:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2663 00000100:00100000:2.0:1762166824.477597:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:46025:x1847765444340224:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166824.477617:0:5755:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166824.477636:0:5755:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9ccc4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f0a expref: -99 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.477700:0:5755:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9ccc4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f0a expref: 24 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.477724:0:5755:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9ccc4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f0a expref: 24 pid: 5755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166824.477741:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee360714100) 00010000:00010000:2.0:1762166824.477744:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166824.477748:0:5755:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14200, rc 0) 00000100:00100000:2.0:1762166824.477813:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:46025:x1847765444340224:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 216us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166824.477820:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2663 00000100:00100000:1.0:1762166824.479566:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166824.479639:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444340480 00000100:00100000:2.0:1762166824.479658:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444340480 00000100:00100000:2.0:1762166824.479701:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 815 00000100:00100000:2.0:1762166824.479711:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3719b4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:46025:x1847765444340480:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166824.479989:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3719b4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:46025:x1847765444340480:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 279us (428us total) trans 4294969108 rc 0/0 00000100:00100000:2.0:1762166824.480001:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 815 00000100:00100000:1.0:1762166824.481663:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166824.481743:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444340736 00000100:00100000:2.0:1762166824.481750:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444340736 00000100:00100000:2.0:1762166824.481818:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 816 00000100:00100000:2.0:1762166824.481829:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:46025:x1847765444340736:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762166824.482073:0:5758:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x16:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1762166824.482190:0:5758:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9cccb lrc: 3/0,1 mode: --/PW res: [0x200000404:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.482205:0:5758:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9cccb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.482230:0:5758:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9cccb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.482238:0:5758:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9cccb lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.482244:0:5758:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9cccb lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.482249:0:5758:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9cccb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5758 initiator: MDT0 00010000:00010000:2.0:1762166824.482272:0:5758:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166824.482316:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166824.482324:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9cccb lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166824.482332:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166824.482337:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9cccb lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166824.482345:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9cccb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5758 initiator: MDT0 00010000:00010000:0.0:1762166824.482357:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16:0x0].0x0 (ffff9ee360714800) 00010000:00010000:0.0:1762166824.482360:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166824.482366:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9cccb lrc: 1/0,0 mode: --/PW res: [0x200000404:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5758 initiator: MDT0 00000100:00100000:2.0:1762166824.482371:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:46025:x1847765444340736:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 541us (721us total) trans 4294969109 rc 0/0 00010000:00010000:0.0:1762166824.482376:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15400/0xf915a5bdf3c9cccb lrc: 0/0,0 mode: --/PW res: [0x200000404:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5758 initiator: MDT0 00000100:00100000:2.0:1762166824.482385:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 816 00010000:00010000:0.0:1762166824.482407:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166824.482410:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166824.482413:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166824.494564:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166824.494697:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444340992 00000100:00100000:1.0:1762166824.494716:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444340992 00000100:00100000:1.0:1762166824.494856:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2664 00000100:00100000:1.0:1762166824.494869:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:46027:x1847765444340992:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166824.494904:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166824.494934:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9ccd2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f11 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.495043:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9ccd9 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495062:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9ccd9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495075:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9ccd9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495093:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473e00/0xf915a5bdf3c9cce0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495101:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473e00/0xf915a5bdf3c9cce0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495107:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473e00/0xf915a5bdf3c9cce0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495255:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9ccd9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495263:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9ccd9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495291:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9ccd9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495299:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244472000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166824.495304:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9ccd9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495313:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9ccd9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495340:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee343a13300) 00010000:00010000:1.0:1762166824.495344:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166824.495349:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9ccd9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495356:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9ccd9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495372:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473e00/0xf915a5bdf3c9cce0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495389:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473e00/0xf915a5bdf3c9cce0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495395:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473e00/0xf915a5bdf3c9cce0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495400:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166824.495403:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473e00/0xf915a5bdf3c9cce0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495409:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473e00/0xf915a5bdf3c9cce0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495429:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0xaf1e71b4 (ffff9ee34ada3c00) 00010000:00010000:1.0:1762166824.495432:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166824.495436:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473e00/0xf915a5bdf3c9cce0 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495442:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473e00/0xf915a5bdf3c9cce0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:1.0:1762166824.495484:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9ccd2 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f11 expref: 27 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.495497:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee343a13300) 00010000:00010000:1.0:1762166824.495500:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166824.495503:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9ccd2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f11 expref: 27 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166824.495513:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472e00, rc 0) 00000100:00100000:1.0:1762166824.495633:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:46027:x1847765444340992:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 765us (1114us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166824.495644:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2664 00000100:00100000:1.0:1762166824.498099:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166824.498166:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444341248 00000100:00100000:3.0:1762166824.498183:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444341248 00000100:00100000:3.0:1762166824.498242:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2665 00000100:00100000:3.0:1762166824.498255:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:46027:x1847765444341248:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166824.498281:0:6558:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166824.498301:0:6558:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cce7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f18 expref: -99 pid: 6558 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1762166824.498452:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x14:0x0]: returning size 11776 00010000:00010000:3.0:1762166824.498607:0:6558:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cce7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f18 expref: 28 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.498642:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee36062b500) 00010000:00010000:3.0:1762166824.498657:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166824.498667:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4200/0xf915a5bdf3c9cce7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f18 expref: 28 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166824.498685:0:6558:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2425f4200, rc 0) 00000100:00100000:3.0:1762166824.498757:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:46027:x1847765444341248:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 505us (670us total) trans 4294969110 rc 301/301 00000100:00100000:3.0:1762166824.498806:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2665 00000100:00100000:2.0:1762166824.500637:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166824.500942:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444341376 00000100:00100000:3.0:1762166824.500956:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444341376 00000100:00100000:3.0:1762166824.501019:0:6558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2666 00000100:00100000:3.0:1762166824.501043:0:6558:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:46027:x1847765444341376:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:3.0:1762166824.501120:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5200/0xf915a5bdf3c9ccf5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501136:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5200/0xf915a5bdf3c9ccf5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501148:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5200/0xf915a5bdf3c9ccf5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501161:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4800/0xf915a5bdf3c9ccfc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501167:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4800/0xf915a5bdf3c9ccfc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501173:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4800/0xf915a5bdf3c9ccfc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501274:0:6558:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5e00/0xf915a5bdf3c9cd03 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501282:0:6558:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5e00/0xf915a5bdf3c9cd03 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501288:0:6558:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5e00/0xf915a5bdf3c9cd03 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00000004:00200000:3.0:1762166824.501321:0:6558:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x15:0x0]: returning size 0 00000004:00200000:3.0:1762166824.501325:0:6558:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166824.501335:0:6558:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5e00/0xf915a5bdf3c9cd03 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501348:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5200/0xf915a5bdf3c9ccf5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501358:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5200/0xf915a5bdf3c9ccf5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501362:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5200/0xf915a5bdf3c9ccf5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501366:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f5200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166824.501368:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5200/0xf915a5bdf3c9ccf5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501373:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5200/0xf915a5bdf3c9ccf5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501382:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee343a13300) 00010000:00010000:3.0:1762166824.501384:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166824.501387:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5200/0xf915a5bdf3c9ccf5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501390:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5200/0xf915a5bdf3c9ccf5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501399:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4800/0xf915a5bdf3c9ccfc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501403:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4800/0xf915a5bdf3c9ccfc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501406:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4800/0xf915a5bdf3c9ccfc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501409:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f4800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166824.501410:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4800/0xf915a5bdf3c9ccfc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501419:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4800/0xf915a5bdf3c9ccfc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501424:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0xaf1e71b4 (ffff9ee343a13a00) 00010000:00010000:3.0:1762166824.501425:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166824.501427:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4800/0xf915a5bdf3c9ccfc lrc: 2/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501430:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4800/0xf915a5bdf3c9ccfc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501442:0:6558:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5e00/0xf915a5bdf3c9cd03 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501447:0:6558:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5e00/0xf915a5bdf3c9cd03 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501451:0:6558:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5e00/0xf915a5bdf3c9cd03 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501455:0:6558:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f5e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166824.501458:0:6558:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5e00/0xf915a5bdf3c9cd03 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501462:0:6558:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5e00/0xf915a5bdf3c9cd03 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501469:0:6558:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee360714100) 00010000:00010000:3.0:1762166824.501471:0:6558:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166824.501486:0:6558:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5e00/0xf915a5bdf3c9cd03 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00010000:00010000:3.0:1762166824.501492:0:6558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5e00/0xf915a5bdf3c9cd03 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6558 initiator: MDT0 00000100:00100000:3.0:1762166824.501581:0:6558:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:46027:x1847765444341376:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 538us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166824.501589:0:6558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2666 00000100:00100000:1.0:1762166824.503863:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166824.503906:0:5758:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444341632 00000100:00100000:2.0:1762166824.503914:0:5758:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444341632 00000100:00100000:2.0:1762166824.503966:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 817 00000100:00100000:2.0:1762166824.503976:0:5758:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:46027:x1847765444341632:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166824.504224:0:5758:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:46027:x1847765444341632:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 245us (369us total) trans 4294969111 rc 0/0 00000100:00100000:2.0:1762166824.504232:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 817 00000004:00080000:2.0:1762166824.616253:0:6730:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 445408487402ns, next at 446408486257ns, rc = 0 00000100:00100000:0.0:1762166824.616397:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451935872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762166824.616447:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166824.616522:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451935872 00000100:00100000:3.0:1762166824.616527:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451935872 00000100:00100000:3.0:1762166824.616567:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1762166824.616573:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1847765451935872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1762166824.616599:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3853516800 avail 3851419648 00000100:00100000:3.0:1762166824.616630:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1847765451935872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166824.616634:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1762166824.616853:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451935872:0@lo:13:osp-pre-0-0.0 00000020:01000004:1.0:1762166825.226177:0:30421:0:(tgt_mount.c:1906:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1762166825.226220:0:30421:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee341672200/0xf915a5bdf3c8d89d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c8d8a4 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.226234:0:30421:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee341672200/0xf915a5bdf3c8d89d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c8d8a4 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.226253:0:30421:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee341672200/0xf915a5bdf3c8d89d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf915a5bdf3c8d8a4 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.226260:0:30421:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.135@tcp lock: ffff9ee341672200/0xf915a5bdf3c8d89d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf915a5bdf3c8d8a4 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.226285:0:30421:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1762166825.226290:0:30421:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1762166825.226310:0:30421:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1762166825.226313:0:30421:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1762166825.226319:0:30421:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1762166825.226342:0:30421:0:(import.c:65:import_set_state_nolock()) ffff9ee37f010800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1762166825.226403:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166825.226409:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.135@tcp lock: ffff9ee341672200/0xf915a5bdf3c8d89d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf915a5bdf3c8d8a4 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.226425:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee341672200 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:2.0:1762166825.226429:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.135@tcp lock: ffff9ee341672200/0xf915a5bdf3c8d89d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf915a5bdf3c8d8a4 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.226437:0:5743:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.135@tcp lock: ffff9ee341672200/0xf915a5bdf3c8d89d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf915a5bdf3c8d8a4 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1762166825.226443:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.135@tcp lock: ffff9ee341672200/0xf915a5bdf3c8d89d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf915a5bdf3c8d8a4 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166825.226448:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1762166825.226450:0:5743:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1762166825.226453:0:5743:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1762166825.226474:0:5743:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.135@tcp lock: ffff9ee341672200/0xf915a5bdf3c8d89d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf915a5bdf3c8d8a4 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.226479:0:5743:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1762166825.226523:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f1807908-b95d-4027-b65a-753b7d69e554:3294:1847765451936128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1762166825.226589:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166825.226665:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.135@tcp lock: ffff9ee341672200/0xf915a5bdf3c8d89d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf915a5bdf3c8d8a4 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.226672:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.135@tcp lock: ffff9ee341672200/0xf915a5bdf3c8d89d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf915a5bdf3c8d8a4 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.226682:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166825.226684:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166825.226686:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166825.226727:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451936128 00000100:00100000:0.0:1762166825.226738:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451936128 00000100:00100000:3.0:1762166825.227166:0:3292:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1847765451936000:0@lo:39:umount.0 00000100:00100000:3.0:1762166825.227204:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166825.227364:0:6558:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451936000 00000100:00100000:1.0:1762166825.227369:0:6558:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451936000 00000100:00100000:2.0:1762166825.227430:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667 00000100:00100000:2.0:1762166825.227442:0:5755:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1847765451936000:12345-0@lo:39:umount.0 00000020:00000080:2.0:1762166825.227465:0:5755:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c8d63c 00000100:00080000:2.0:1762166825.227473:0:5755:0:(import.c:65:import_set_state_nolock()) ffff9ee343755000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1762166825.227524:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166825.227541:0:5755:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3292:x1847765451936000:12345-0@lo:39:umount.0 Request processed in 101us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166825.227549:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667 00000100:00080000:3.0:1762166825.227557:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9ee37f010800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:2.0:1762166825.227560:0:5755:0:(genops.c:904:class_export_put()) final put ffff9ee343756000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1762166825.227570:0:3292:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1847765451936000:0@lo:39:umount.0 00000020:00000080:2.0:1762166825.227589:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee343756000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1762166825.227628:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee343755000 for lustre-MDT0000 00000100:00080000:1.0:1762166825.227686:0:30421:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1762166825.227689:0:30421:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1762166825.227693:0:30421:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1762166825.227715:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1762166825.227724:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1807908-b95d-4027-b65a-753b7d69e554+18:3294:x1847765451936128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1762166825.227741:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166825.227755:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee340031a00/0xf915a5bdf3c8d8a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf915a5bdf3c8d89d expref: 18 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.227924:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166825.227952:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1807908-b95d-4027-b65a-753b7d69e554+17:3294:x1847765451936128:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166825.227959:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00010000:00010000:1.0:1762166825.228583:0:30421:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee341672c00/0xf915a5bdf3c8d8ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c8d8b2 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.228594:0:30421:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee341672c00/0xf915a5bdf3c8d8ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c8d8b2 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.228601:0:30421:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee341672c00/0xf915a5bdf3c8d8ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf915a5bdf3c8d8b2 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.228607:0:30421:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.135@tcp lock: ffff9ee341672c00/0xf915a5bdf3c8d8ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf915a5bdf3c8d8b2 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.228630:0:30421:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166825.228635:0:30421:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee36dc7d000/0xf915a5bdf3c97a3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c97a45 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.228653:0:30421:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee36dc7d000/0xf915a5bdf3c97a3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c97a45 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.228660:0:30421:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee36dc7d000/0xf915a5bdf3c97a3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf915a5bdf3c97a45 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.228662:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166825.228671:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.135@tcp lock: ffff9ee341672c00/0xf915a5bdf3c8d8ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf915a5bdf3c8d8b2 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.228672:0:30421:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.135@tcp lock: ffff9ee36dc7d000/0xf915a5bdf3c97a3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf915a5bdf3c97a45 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.228689:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee341672c00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1762166825.228694:0:5744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.135@tcp lock: ffff9ee341672c00/0xf915a5bdf3c8d8ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf915a5bdf3c8d8b2 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.228704:0:30421:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166825.228711:0:30421:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee348229200/0xf915a5bdf3c8d930 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c8d937 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.228718:0:30421:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee348229200/0xf915a5bdf3c8d930 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c8d937 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.228721:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166825.228724:0:30421:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee348229200/0xf915a5bdf3c8d930 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf915a5bdf3c8d937 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.228727:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.135@tcp lock: ffff9ee36dc7d000/0xf915a5bdf3c97a3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf915a5bdf3c97a45 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.228734:0:30421:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.135@tcp lock: ffff9ee348229200/0xf915a5bdf3c8d930 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf915a5bdf3c8d937 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.228739:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7d000 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:2.0:1762166825.228744:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.135@tcp lock: ffff9ee36dc7d000/0xf915a5bdf3c97a3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf915a5bdf3c97a45 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.228748:0:30421:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166825.228752:0:5743:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.135@tcp lock: ffff9ee36dc7d000/0xf915a5bdf3c97a3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf915a5bdf3c97a45 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.228754:0:30421:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee340030c00/0xf915a5bdf3c8d594 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c8d59b expref: -99 pid: 5736 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1762166825.228789:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.135@tcp lock: ffff9ee36dc7d000/0xf915a5bdf3c97a3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf915a5bdf3c97a45 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.228793:0:30421:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee340030c00/0xf915a5bdf3c8d594 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c8d59b expref: -99 pid: 5736 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166825.228797:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1762166825.228801:0:5743:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1762166825.228806:0:5743:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1762166825.228813:0:30421:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee340030c00/0xf915a5bdf3c8d594 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf915a5bdf3c8d59b expref: -99 pid: 5736 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.228821:0:30421:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.135@tcp lock: ffff9ee340030c00/0xf915a5bdf3c8d594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf915a5bdf3c8d59b expref: -99 pid: 5736 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.228830:0:5743:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.135@tcp lock: ffff9ee36dc7d000/0xf915a5bdf3c97a3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf915a5bdf3c97a45 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.228831:0:30421:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1762166825.228837:0:30421:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1762166825.228840:0:5743:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1762166825.228860:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.135@tcp lock: ffff9ee36dc7d000/0xf915a5bdf3c97a3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf915a5bdf3c97a45 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000020:01000004:1.0:1762166825.228861:0:30421:0:(tgt_mount.c:1956:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1762166825.228865:0:30421:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00010000:00010000:2.0:1762166825.228870:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.135@tcp lock: ffff9ee36dc7d000/0xf915a5bdf3c97a3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf915a5bdf3c97a45 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000020:00000080:1.0:1762166825.228872:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1762166825.228879:0:30421:0:(obd_config.c:863:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1762166825.228902:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1762166825.228906:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.135@tcp lock: ffff9ee348229200/0xf915a5bdf3c8d930 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf915a5bdf3c8d937 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.228912:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229200 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:2.0:1762166825.228915:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.135@tcp lock: ffff9ee348229200/0xf915a5bdf3c8d930 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf915a5bdf3c8d937 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.228920:0:5743:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.135@tcp lock: ffff9ee348229200/0xf915a5bdf3c8d930 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf915a5bdf3c8d937 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1762166825.228925:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.135@tcp lock: ffff9ee348229200/0xf915a5bdf3c8d930 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf915a5bdf3c8d937 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166825.228930:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1762166825.228932:0:5743:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1762166825.228934:0:5743:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1762166825.228946:0:5743:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.135@tcp lock: ffff9ee348229200/0xf915a5bdf3c8d930 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf915a5bdf3c8d937 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.228951:0:5743:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1762166825.228957:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.135@tcp lock: ffff9ee348229200/0xf915a5bdf3c8d930 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf915a5bdf3c8d937 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.228963:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.135@tcp lock: ffff9ee348229200/0xf915a5bdf3c8d930 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf915a5bdf3c8d937 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.228970:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166825.228973:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.135@tcp lock: ffff9ee340030c00/0xf915a5bdf3c8d594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf915a5bdf3c8d59b expref: -99 pid: 5736 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.228986:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee340030c00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:2.0:1762166825.228989:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.135@tcp lock: ffff9ee340030c00/0xf915a5bdf3c8d594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf915a5bdf3c8d59b expref: -99 pid: 5736 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.228994:0:5743:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.135@tcp lock: ffff9ee340030c00/0xf915a5bdf3c8d594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf915a5bdf3c8d59b expref: -99 pid: 5736 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1762166825.229000:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.135@tcp lock: ffff9ee340030c00/0xf915a5bdf3c8d594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf915a5bdf3c8d59b expref: -99 pid: 5736 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166825.229004:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1762166825.229006:0:5743:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1762166825.229008:0:5743:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1762166825.229017:0:5743:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.135@tcp lock: ffff9ee340030c00/0xf915a5bdf3c8d594 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf915a5bdf3c8d59b expref: -99 pid: 5736 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.229023:0:5743:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1762166825.229030:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.135@tcp lock: ffff9ee340030c00/0xf915a5bdf3c8d594 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf915a5bdf3c8d59b expref: -99 pid: 5736 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.229036:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.135@tcp lock: ffff9ee340030c00/0xf915a5bdf3c8d594 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf915a5bdf3c8d59b expref: -99 pid: 5736 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.229046:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166825.229048:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166825.229050:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166825.229071:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f1807908-b95d-4027-b65a-753b7d69e554:3296:1847765451936384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1762166825.229111:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f1807908-b95d-4027-b65a-753b7d69e554:3293:1847765451936512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1762166825.229111:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166825.229145:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1762166825.229151:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166825.229155:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f1807908-b95d-4027-b65a-753b7d69e554:3296:1847765451936256:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1762166825.229185:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166825.229189:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166825.229211:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f1807908-b95d-4027-b65a-753b7d69e554:3294:1847765451936128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1762166825.229224:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451936384 00000100:00100000:2.0:1762166825.229230:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451936384 00000100:00100000:3.0:1762166825.229239:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451936512 00000100:00100000:3.0:1762166825.229244:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451936512 00000100:00100000:2.0:1762166825.229269:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451936256 00000100:00100000:2.0:1762166825.229274:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451936256 00000100:00100000:3.0:1762166825.229282:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1762166825.229291:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3456e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1807908-b95d-4027-b65a-753b7d69e554+19:3296:x1847765451936384:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1762166825.229303:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1762166825.229313:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1807908-b95d-4027-b65a-753b7d69e554+19:3293:x1847765451936512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1762166825.229314:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166825.229326:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166825.229330:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee37f158400/0xf915a5bdf3c8d937 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf915a5bdf3c8d930 expref: 19 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.229340:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee38216ce00/0xf915a5bdf3c8d59b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf915a5bdf3c8d594 expref: 19 pid: 5750 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.229344:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166825.229357:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166825.229382:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3456e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1807908-b95d-4027-b65a-753b7d69e554+17:3296:x1847765451936384:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166825.229393:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1762166825.229395:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1807908-b95d-4027-b65a-753b7d69e554+17:3293:x1847765451936512:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166825.229403:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1762166825.229425:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1762166825.229432:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1807908-b95d-4027-b65a-753b7d69e554+15:3296:x1847765451936256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166825.229440:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166825.229450:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee359390200/0xf915a5bdf3c97a45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf915a5bdf3c97a3e expref: 15 pid: 5749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.229460:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166825.229472:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f1807908-b95d-4027-b65a-753b7d69e554:3293:1847765451936512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1762166825.229486:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1807908-b95d-4027-b65a-753b7d69e554+14:3296:x1847765451936256:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166825.229492:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1762166825.229499:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f1807908-b95d-4027-b65a-753b7d69e554:3296:1847765451936256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1762166825.229511:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f1807908-b95d-4027-b65a-753b7d69e554:3296:1847765451936384:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1762166825.229883:0:5744:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.135@tcp lock: ffff9ee341672c00/0xf915a5bdf3c8d8ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf915a5bdf3c8d8b2 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1762166825.229893:0:5744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.135@tcp lock: ffff9ee341672c00/0xf915a5bdf3c8d8ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf915a5bdf3c8d8b2 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166825.229899:0:5744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1762166825.229901:0:5744:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1762166825.229903:0:5744:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1762166825.229920:0:5744:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.135@tcp lock: ffff9ee341672c00/0xf915a5bdf3c8d8ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf915a5bdf3c8d8b2 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.229926:0:5744:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1762166825.229950:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.135@tcp lock: ffff9ee341672c00/0xf915a5bdf3c8d8ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf915a5bdf3c8d8b2 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.229967:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.135@tcp lock: ffff9ee341672c00/0xf915a5bdf3c8d8ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf915a5bdf3c8d8b2 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.229978:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166825.229979:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166825.229981:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166825.230191:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1762166825.230201:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f1807908-b95d-4027-b65a-753b7d69e554:3293:1847765451936640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1762166825.230226:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166825.230272:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451936640 00000100:00100000:0.0:1762166825.230278:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451936640 00000100:00100000:0.0:1762166825.230312:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1762166825.230320:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1807908-b95d-4027-b65a-753b7d69e554+14:3293:x1847765451936640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1762166825.230329:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166825.230339:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee340031200/0xf915a5bdf3c8d8b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf915a5bdf3c8d8ab expref: 14 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.230348:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166825.230382:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1807908-b95d-4027-b65a-753b7d69e554+13:3293:x1847765451936640:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166825.230389:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1762166825.230403:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f1807908-b95d-4027-b65a-753b7d69e554:3293:1847765451936640:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1762166825.230557:0:30421:0:(mdt_handler.c:8098:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000004:00080000:1.0:1762166825.245052:0:5777:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 119 committed 00000001:00080000:1.0:1762166825.245088:0:5777:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969111 is committed 00000020:00080000:1.0:1762166825.245106:0:5777:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee36e62fa80 refcount 2 committed 0 result 0 batchid 37 00000020:00080000:1.0:1762166825.245112:0:5777:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2478dc000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee246eef480 00000020:00080000:1.0:1762166825.245116:0:5777:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2478dc700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee36e62f300 00000020:00080000:1.0:1762166825.245119:0:5777:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2478dc600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee245218000 00000020:00080000:1.0:1762166825.245122:0:5777:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].14 00000100:00100000:2.0:1762166825.245183:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451936768:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1762166825.245193:0:5788:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 37 committed batchid 36 00000100:00100000:2.0:1762166825.245246:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166825.245308:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451936768 00000100:00100000:2.0:1762166825.245316:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451936768 00000100:00100000:2.0:1762166825.245383:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:2.0:1762166825.245394:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765451936768:12345-0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1762166825.245408:0:5788:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 36 00002000:00080000:2.0:1762166825.245420:0:6532:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:101 count 1 00010000:00010000:2.0:1762166825.245443:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cd0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.245462:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9ca2b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e62 expref: 8 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166825.245470:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166825.245472:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166825.245475:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cd0a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166825.245502:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9ca2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e62 expref: 8 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166825.245516:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9ca2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e62 expref: 8 pid: 12402 timeout: 546 lvb_type: 1 00000100:00100000:2.0:1762166825.245529:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451936896:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166825.245597:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2435c19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166825.247812:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451936896:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166825.247844:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cd0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166825.248165:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166825.248564:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444341760 00000100:00100000:0.0:1762166825.248572:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444341760 00010000:00010000:0.0:1762166825.248605:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9ca2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e62 expref: 9 pid: 12402 timeout: 546 lvb_type: 1 00000100:00100000:0.0:1762166825.248637:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 599 00000100:00100000:0.0:1762166825.248661:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444341760:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166825.248690:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166825.248696:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9ca2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e62 expref: 9 pid: 12402 timeout: 546 lvb_type: 1 00010000:00010000:0.0:1762166825.248708:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9ca2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e62 expref: 9 pid: 12402 timeout: 546 lvb_type: 1 00010000:00010000:0.0:1762166825.248733:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc14000/0xf915a5bdf3c9ca2b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90e62 expref: 9 pid: 12402 timeout: 546 lvb_type: 1 00010000:00010000:0.0:1762166825.248748:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166825.248750:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166825.248755:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cd0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.248817:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cd0a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.248846:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166825.248869:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cd0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.248880:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cd0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166825.248905:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444341760:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 245us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166825.248919:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 599 00010000:00010000:1.0:1762166825.248935:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cd0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.248951:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cd0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.249205:0:6532:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166825.249619:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166825.249626:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cd0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.249635:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166825.249639:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cd0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.249657:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cd0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.249669:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cd0a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.249687:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc15800/0xf915a5bdf3c9cd0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.249705:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166825.249707:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166825.249709:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166825.251402:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765451936768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6004us (6149us total) trans 21474836751 rc 0/0 00000100:00100000:1.0:1762166825.251414:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000004:00080000:3.0:1762166825.251515:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b0a80/2, rc 0, transno 21474836751 00000100:00100000:3.0:1762166825.251522:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451936768:0@lo:6:osp-syn-0-0.0 00000020:00000080:2.0:1762166825.261462:0:30421:0:(obd_config.c:886:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 3/7 00000020:00080000:2.0:1762166825.261536:0:30421:0:(genops.c:1836:print_export_data()) lustre-MDT0000: ACTIVE ffff9ee37f2fb000 da9d93ea-d728-4b01-a76b-4b4ff9c19538 192.168.203.35@tcp 18 (0 0 14) 0 0 0 0: 0000000000000000 4294969111 stale:0 00000020:00080000:2.0:1762166825.261544:0:30421:0:(genops.c:1836:print_export_data()) lustre-MDT0000: ACTIVE ffff9ee36f1ff800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1762166825.261549:0:30421:0:(genops.c:1836:print_export_data()) lustre-MDT0000: ACTIVE ffff9ee3431b8800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1762166825.261554:0:30421:0:(genops.c:1570:class_disconnect_exports()) OBD device 5 (ffff9ee347dfca88) has exports, disconnecting them 00000020:00080000:2.0:1762166825.261559:0:30421:0:(genops.c:1545:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.35@tcp (ffff9ee37f2fb000), last request at 1762166824 00000020:00000080:2.0:1762166825.261566:0:30421:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c9b86c 00000020:00010000:2.0:1762166825.261574:0:30421:0:(genops.c:1938:obd_stale_export_put()) Put export ffff9ee37f2fb000: total 0 00000100:00080000:2.0:1762166825.261579:0:30421:0:(import.c:65:import_set_state_nolock()) ffff9ee37f2fd000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1762166825.261597:0:5777:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 37 batchid updated 00000020:00010000:3.0:1762166825.261625:0:6548:0:(genops.c:1924:obd_stale_export_get()) Get export ffff9ee37f2fb000: total 0 00010000:00010000:3.0:1762166825.261631:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1762166825.261650:0:5788:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 36 00000020:00080000:2.0:1762166825.261658:0:30421:0:(genops.c:1550:class_disconnect_export_list()) disconnected export at 192.168.203.35@tcp (ffff9ee37f2fb000): rc 0 00000020:00080000:2.0:1762166825.261663:0:30421:0:(genops.c:1545:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ee36f1ff800), last request at 1762166822 00000020:00000080:2.0:1762166825.261666:0:30421:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c97a29 00000100:00080000:2.0:1762166825.261679:0:30421:0:(import.c:65:import_set_state_nolock()) ffff9ee36f1fd000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1762166825.261681:0:6548:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff9ee37f2fb000, canceled 0 locks, left on hash table 14. 00000020:00080000:2.0:1762166825.261702:0:30421:0:(genops.c:1550:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ee36f1ff800): rc 0 00000020:00000080:2.0:1762166825.261706:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee36f1ff800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1762166825.261719:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243444e00/0xf915a5bdf3c9c57e lrc: 0/0,0 mode: --/PR res: [0x200000404:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ce8 expref: 15 pid: 20128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.261741:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159000/0xf915a5bdf3c9c1c6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90bfa expref: 14 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.261787:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f4a00/0xf915a5bdf3c9cbba lrc: 0/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90eb6 expref: 13 pid: 6558 timeout: 0 lvb_type: 0 00000020:00000080:1.0:1762166825.261798:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee36f1ff800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:0.0:1762166825.261801:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166825.261813:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67c00/0xf915a5bdf3c9bddd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ae9 expref: 12 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.261830:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc67400/0xf915a5bdf3c9b953 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909ca expref: 11 pid: 5756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.261850:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee350452800/0xf915a5bdf3c9bacd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a48 expref: 10 pid: 20128 timeout: 0 lvb_type: 0 00000020:00080000:2.0:1762166825.261855:0:30421:0:(genops.c:1545:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ee3431b8800), last request at 1762166822 00000020:00000080:2.0:1762166825.261863:0:30421:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c9797a 00000020:00000080:1.0:1762166825.261864:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee36f1fd000 for lustre-MDT0000 00000100:00080000:2.0:1762166825.261873:0:30421:0:(import.c:65:import_set_state_nolock()) ffff9ee3431bf000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1762166825.261894:0:30421:0:(genops.c:1550:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ee3431b8800): rc 0 00000020:00000080:2.0:1762166825.261897:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee3431b8800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1762166825.261902:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158e00/0xf915a5bdf3c9cb9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90eaf expref: 9 pid: 5755 timeout: 0 lvb_type: 0 00000004:00000080:2.0:1762166825.261914:0:30421:0:(mdd_device.c:2257:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffafd902367b28 00010000:00010000:3.0:1762166825.261923:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159400/0xf915a5bdf3c9ba56 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a25 expref: 8 pid: 20128 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1762166825.261936:0:30421:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00010000:00010000:3.0:1762166825.261939:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445400/0xf915a5bdf3c9c52a lrc: 0/0,0 mode: --/CR res: [0x200000404:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cd3 expref: 7 pid: 20128 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166825.261947:0:30421:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836747 gen 3 00000020:00000080:1.0:1762166825.261950:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee3431b8800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1762166825.261959:0:30421:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9ee374ab2300 x1847765451934336/t21474836748(21474836748) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166840 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1762166825.261963:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee243445600/0xf915a5bdf3c9c58c lrc: 0/0,0 mode: --/CR res: [0x200000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cef expref: 6 pid: 20128 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166825.261981:0:30421:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee374ab2300, transno 21474836748 00000020:00000080:1.0:1762166825.261993:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee3431bf000 for lustre-MDT0000 00010000:00010000:3.0:1762166825.261994:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158c00/0xf915a5bdf3c9b8a4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f909a0 expref: 5 pid: 20128 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166825.261999:0:30421:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9ee37f623b80 x1847765451935744/t21474836750(21474836750) o1000->lustre-OST0000-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1762166840 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt_rdpg00_000.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1762166825.262010:0:30421:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836750 committed transno 21474836747 00010000:00010000:3.0:1762166825.262012:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66e00/0xf915a5bdf3c9bc7f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ab1 expref: 4 pid: 6558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.262026:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9c22f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c1d expref: 3 pid: 6558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166825.262037:0:30421:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9ee36e3b0a80 x1847765451936768/t21474836751(21474836751) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166841 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1762166825.262040:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9ccc4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f0a expref: 2 pid: 5755 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166825.262057:0:30421:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b0a80, transno 21474836751 00010000:00010000:3.0:1762166825.262061:0:6548:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff9ee37f2fb000, canceled 14 locks, left on hash table 0. 00000004:00080000:2.0:1762166825.262077:0:30421:0:(osp_dev.c:1621:osp_import_event()) got inactive 00010000:00010000:0.0:1762166825.262101:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1762166825.262701:0:30421:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1762166825.262723:0:30421:0:(import.c:65:import_set_state_nolock()) ffff9ee347db7800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1762166825.262846:0:30421:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1762166825.262849:0:30421:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869411 gen 3 00000100:00100000:2.0:1762166825.262855:0:30421:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9ee242522300 x1847765451932416/t17179869416(17179869416) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166836 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1762166825.262863:0:30421:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242522300, transno 17179869416 00000100:00100000:0.0:1762166825.262872:0:3292:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1847765451937024:0@lo:9:umount.0 00000100:00100000:2.0:1762166825.262877:0:30421:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9ee36f284700 x1847765451932672/t17179869417(17179869417) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166836 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1762166825.262886:0:30421:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f284700, transno 17179869417 00000100:00100000:2.0:1762166825.262891:0:30421:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9ee37ff80700 x1847765451934464/t17179869418(17179869418) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166840 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1762166825.262897:0:30421:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37ff80700, transno 17179869418 00000100:00100000:2.0:1762166825.262902:0:30421:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9ee36e2bc380 x1847765451934592/t17179869419(17179869419) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166840 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1762166825.262921:0:30421:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e2bc380, transno 17179869419 00000100:00100000:2.0:1762166825.262928:0:30421:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9ee37f620a80 x1847765451935616/t17179869421(17179869421) o1000->lustre-OST0001-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1762166840 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt_rdpg00_000.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1762166825.262935:0:30421:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869421 committed transno 17179869411 00000100:00100000:0.0:1762166825.262940:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1762166825.262960:0:30421:0:(osp_dev.c:1621:osp_import_event()) got inactive 00000004:00080000:1.0:1762166825.263031:0:7836:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 4 done 00000100:00100000:1.0:1762166825.263053:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451937024 00000100:00100000:1.0:1762166825.263060:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451937024 00000100:00100000:1.0:1762166825.263109:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:1.0:1762166825.263119:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3292:x1847765451937024:12345-0@lo:9:umount.0 00000020:00000080:1.0:1762166825.263141:0:6532:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c97942 00000100:00080000:1.0:1762166825.263147:0:6532:0:(import.c:65:import_set_state_nolock()) ffff9ee37fc10800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1762166825.263179:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1762166825.263183:0:6532:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836751 00000100:00100000:1.0:1762166825.263429:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1847765451937024:12345-0@lo:9:umount.0 Request processed in 310us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166825.263436:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00080000:0.0:1762166825.263495:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9ee347db7800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1762166825.263511:0:3292:0:(osp_dev.c:1605:osp_import_event()) got disconnected 00000004:00080000:0.0:1762166825.263513:0:3292:0:(osp_dev.c:1621:osp_import_event()) got inactive 00000100:00100000:0.0:1762166825.263520:0:3292:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1847765451937024:0@lo:9:umount.0 00000100:00080000:2.0:1762166825.263698:0:30421:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1762166825.263709:0:30421:0:(import.c:65:import_set_state_nolock()) ffff9ee243bc1800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1762166825.263788:0:30421:0:(genops.c:1575:class_disconnect_exports()) OBD device 5 (ffff9ee347dfca88) has no exports 00000020:00080000:1.0:1762166825.263837:0:5788:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee36e62fa80 refcount 1 committed 1 result 0 batchid 37 00000020:00080000:1.0:1762166825.263843:0:5788:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2478dc000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee246eef480 00000020:00080000:1.0:1762166825.263856:0:5788:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2478dc700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee36e62f300 00000020:00080000:1.0:1762166825.263860:0:5788:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2478dc600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee245218000 00000020:00080000:1.0:1762166825.263863:0:5788:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].14 00000100:00100000:0.0:1762166825.263945:0:3292:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1847765451937152:0@lo:9:umount.0 00000100:00100000:0.0:1762166825.263972:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166825.264005:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451937152 00000100:00100000:1.0:1762166825.264009:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451937152 00000100:00100000:1.0:1762166825.264044:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:1.0:1762166825.264052:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3292:x1847765451937152:12345-0@lo:9:umount.0 00000020:00000080:1.0:1762166825.264068:0:6532:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c979f1 00000100:00080000:1.0:1762166825.264074:0:6532:0:(import.c:65:import_set_state_nolock()) ffff9ee374a05800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1762166825.264099:0:6532:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869421 00000100:00100000:1.0:1762166825.264224:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3292:x1847765451937152:12345-0@lo:9:umount.0 Request processed in 173us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166825.264231:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00010000:00010000:1.0:1762166825.264247:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1762166825.264319:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9ee243bc1800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1762166825.264330:0:3292:0:(osp_dev.c:1605:osp_import_event()) got disconnected 00000004:00080000:0.0:1762166825.264332:0:3292:0:(osp_dev.c:1621:osp_import_event()) got inactive 00000100:00100000:0.0:1762166825.264335:0:3292:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1847765451937152:0@lo:9:umount.0 00000020:00080000:2.0:1762166825.267927:0:30421:0:(genops.c:1575:class_disconnect_exports()) OBD device 5 (ffff9ee347dfca88) has no exports 00000020:00000080:3.0:1762166825.387324:0:6548:0:(genops.c:904:class_export_put()) final put ffff9ee37f2fb000/da9d93ea-d728-4b01-a76b-4b4ff9c19538 00000020:00000080:1.0:1762166825.387395:0:38:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee37f2fb000/da9d93ea-d728-4b01-a76b-4b4ff9c19538 for lustre-MDT0000 00010000:00010000:3.0:1762166825.387416:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166825.387420:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166825.387438:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166825.387456:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1762166825.387458:0:38:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee37f2fd000 for lustre-MDT0000 00000020:00000080:2.0:1762166825.405222:0:30421:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c8d5ef 00000020:00000080:2.0:1762166825.405236:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee381bfe000/lustre-QMT0000_UUID 00000020:01000000:2.0:1762166825.405257:0:30421:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1762166825.405299:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee381bfe000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1762166825.405320:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1762166825.405332:0:30421:0:(obd_config.c:886:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1762166825.405336:0:30421:0:(genops.c:1575:class_disconnect_exports()) OBD device 7 (ffff9ee38184e360) has no exports 00000020:00000080:0.0:1762166825.405602:0:30421:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c8d5e8 00000020:00000080:0.0:1762166825.405607:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee381bfd800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1762166825.405699:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1762166825.405711:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee381bfd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1762166825.405714:0:30421:0:(obd_config.c:814:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1762166825.405716:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee37f4c4800/lustre-QMT0000_UUID 00000020:00000080:0.0:1762166825.405719:0:30421:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee37f4c4800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1762166825.405728:0:30421:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1762166825.405946:0:30421:0:(lprocfs_status_server.c:299:lprocfs_free_client_stats()) stat ffff9ee3482ca7e0 - data ffff9ee365888ca8/ffff9ee242a3f000 00000020:01000000:0.0:1762166825.406032:0:30421:0:(lprocfs_status_server.c:299:lprocfs_free_client_stats()) stat ffff9ee34aaba240 - data ffff9ee36abfbaf8/ffff9ee36f1dc400 00000100:00080000:1.0:1762166825.436864:0:30421:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1762166825.436873:0:30421:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836747 gen 4 00000004:00080000:1.0:1762166825.436891:0:30421:0:(osp_dev.c:1621:osp_import_event()) got inactive 00000100:00100000:1.0:1762166825.436895:0:30421:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1762166825.437155:0:6728:0:(osp_sync.c:1253:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1762166825.437160:0:6728:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 134 count 3 00000040:00080000:3.0:1762166825.437172:0:6728:0:(llog.c:854:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1762166825.437342:0:30421:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1762166825.437345:0:30421:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869411 gen 4 00000004:00080000:1.0:1762166825.437361:0:30421:0:(osp_dev.c:1621:osp_import_event()) got inactive 00000100:00100000:1.0:1762166825.437363:0:30421:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1762166825.437532:0:7836:0:(osp_sync.c:1253:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1762166825.437536:0:7836:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 130 count 5 00000040:00080000:3.0:1762166825.437542:0:7836:0:(llog.c:854:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1762166825.446499:0:30421:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c8d5b7 00000020:00000080:1.0:1762166825.446511:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee3471c1800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1762166825.446547:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee3471c1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1762166825.447817:0:30421:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c8d5cc 00000020:00000080:1.0:1762166825.447823:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee3471c5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1762166825.447830:0:30421:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1762166825.447834:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1762166825.447842:0:30421:0:(obd_config.c:886:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1762166825.447846:0:30421:0:(genops.c:1575:class_disconnect_exports()) OBD device 4 (ffff9ee347dfb1b0) has no exports 00000020:00000080:2.0:1762166825.447929:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee3471c5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1762166825.448049:0:30421:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1762166825.448059:0:30421:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c8d7fc 00000020:00000080:1.0:1762166825.448063:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee37f2fd800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1762166825.448081:0:30421:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1762166825.448085:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1762166825.448094:0:30421:0:(obd_config.c:886:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1762166825.448096:0:30421:0:(genops.c:1575:class_disconnect_exports()) OBD device 17 (ffff9ee37ff3ca88) has no exports 00000020:00000080:1.0:1762166825.448107:0:30421:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c8d7f5 00000020:00000080:1.0:1762166825.448112:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee243bc3800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1762166825.448137:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee37f2fd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1762166825.448148:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee243bc3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1762166825.448530:0:30421:0:(obd_class.h:663:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1762166825.448534:0:30421:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1762166825.448539:0:30421:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869411 gen 5 00000100:00020000:1.0:1762166825.448544:0:30421:0:(obd_class.h:479:obd_check_dev()) Device 17 not setup 00000100:00100000:1.0:1762166825.454725:0:30421:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00020000:1.0:1762166825.454736:0:30421:0:(obd_class.h:479:obd_check_dev()) Device 17 not setup 00000020:00000080:1.0:1762166825.454817:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1762166825.454835:0:30421:0:(obd_config.c:814:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1762166825.454846:0:30421:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c8d707 00000020:00000080:1.0:1762166825.454856:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee347db6000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1762166825.454863:0:30421:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1762166825.454871:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1762166825.454876:0:30421:0:(obd_config.c:886:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1762166825.454880:0:30421:0:(genops.c:1575:class_disconnect_exports()) OBD device 13 (ffff9ee3818498d8) has no exports 00000020:00000080:1.0:1762166825.454887:0:30421:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c8d700 00000020:00000080:1.0:1762166825.454892:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee242738000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1762166825.455112:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee243bc1800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1762166825.455121:0:36:0:(genops.c:904:class_export_put()) final put ffff9ee243bc2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1762166825.455124:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee243bc2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1762166825.455130:0:36:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1762166825.455216:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee347db6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1762166825.455221:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee242738000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1762166825.455332:0:30421:0:(obd_class.h:663:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1762166825.455336:0:30421:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1762166825.455348:0:30421:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836747 gen 5 00000100:00020000:1.0:1762166825.455352:0:30421:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup 00000100:00100000:1.0:1762166825.455354:0:30421:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00020000:1.0:1762166825.455355:0:30421:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup 00000020:00000080:2.0:1762166825.455377:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee347db7800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1762166825.455396:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1762166825.455402:0:30421:0:(obd_config.c:814:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1762166825.455405:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee24273e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1762166825.455408:0:30421:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee24273e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1762166825.455413:0:30421:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1762166825.455589:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1762166825.455595:0:30421:0:(obd_config.c:814:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1762166825.455598:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee348a77000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1762166825.455601:0:30421:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee348a77000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1762166825.455606:0:30421:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1762166825.455813:0:30421:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c8d5d3 00000020:00000080:1.0:1762166825.455818:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee3471c6000/lustre-MDD0000_UUID 00000020:01000000:1.0:1762166825.455827:0:30421:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1762166825.455831:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1762166825.455835:0:30421:0:(obd_config.c:886:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1762166825.455838:0:30421:0:(genops.c:1575:class_disconnect_exports()) OBD device 6 (ffff9ee347df8000) has no exports 00000020:00000080:1.0:1762166825.455979:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1762166825.455985:0:30421:0:(obd_config.c:814:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1762166825.455989:0:30421:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c8d5da 00000020:00000080:1.0:1762166825.455994:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee3471c7000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1762166825.456003:0:30421:0:(tgt_mount.c:188:server_put_mount()) put mount ffff9ee3606fc000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1762166825.456006:0:30421:0:(obd_mount.c:705:lustre_put_lsi()) put ffff9ee3606fc000 3 00000020:01000004:1.0:1762166825.456009:0:30421:0:(tgt_mount.c:121:server_deregister_mount()) deregister mount ffff9ee3606fc000 from lustre-MDT0000 00000020:00000080:1.0:1762166825.456037:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1762166825.456041:0:30421:0:(obd_config.c:814:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1762166825.456044:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee3471c7800/lustre-MDT0000_UUID 00000020:00000080:1.0:1762166825.456046:0:30421:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee3471c7800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1762166825.456052:0:30421:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1762166825.456087:0:30421:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1762166825.456092:0:30421:0:(tgt_mount.c:256:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1762166825.456095:0:30421:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1762166825.456098:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1762166825.456101:0:30421:0:(obd_config.c:886:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1762166825.456109:0:30421:0:(genops.c:1836:print_export_data()) MGS: ACTIVE ffff9ee34a536000 1d2907fd-ec36-418b-9892-2b7af8c34cb2 192.168.203.35@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1762166825.456116:0:30421:0:(genops.c:1836:print_export_data()) MGS: ACTIVE ffff9ee3606fe000 f1807908-b95d-4027-b65a-753b7d69e554 0@lo 12 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1762166825.456121:0:30421:0:(genops.c:1570:class_disconnect_exports()) OBD device 1 (ffff9ee347166360) has exports, disconnecting them 00000020:00080000:1.0:1762166825.456126:0:30421:0:(genops.c:1545:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.35@tcp (ffff9ee34a536000), last request at 1762166786 00000020:00000080:1.0:1762166825.456137:0:30421:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c9b849 00000020:00010000:1.0:1762166825.456142:0:30421:0:(genops.c:1938:obd_stale_export_put()) Put export ffff9ee34a536000: total 2 00000100:00080000:1.0:1762166825.456146:0:30421:0:(import.c:65:import_set_state_nolock()) ffff9ee34a537800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1762166825.456164:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee3471c6000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1762166825.456169:0:36:0:(genops.c:904:class_export_put()) final put ffff9ee3471c3800/lustre-MDD0000_UUID 00000020:00000080:2.0:1762166825.456171:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee3471c3800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1762166825.456181:0:36:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00080000:1.0:1762166825.456306:0:30421:0:(genops.c:1550:class_disconnect_export_list()) disconnected export at 192.168.203.35@tcp (ffff9ee34a536000): rc 0 00000020:00080000:1.0:1762166825.456311:0:30421:0:(genops.c:1545:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9ee3606fe000), last request at 1762166482 00000020:00010000:1.0:1762166825.456322:0:5743:0:(genops.c:1924:obd_stale_export_get()) Get export ffff9ee34a536000: total 2 00000020:00000080:2.0:1762166825.456328:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee3471c7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1762166825.456344:0:5743:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff9ee34a536000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1762166825.456373:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee37fc67800/0xf915a5bdf3c9b857 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9093e expref: 5 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.456392:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee350453c00/0xf915a5bdf3c9b865 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9096f expref: 4 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.456406:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee37fc66800/0xf915a5bdf3c9b85e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90968 expref: 3 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.456424:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee37fc67200/0xf915a5bdf3c9b850 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90937 expref: 2 pid: 5751 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.456433:0:5743:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff9ee34a536000, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1762166825.456455:0:5743:0:(genops.c:904:class_export_put()) final put ffff9ee34a536000/1d2907fd-ec36-418b-9892-2b7af8c34cb2 00010000:00010000:1.0:1762166825.456485:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166825.456487:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166825.456489:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1762166825.456507:0:30421:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c8d578 00000020:00010000:1.0:1762166825.456510:0:30421:0:(genops.c:1938:obd_stale_export_put()) Put export ffff9ee3606fe000: total 1 00000100:00080000:1.0:1762166825.456513:0:30421:0:(import.c:65:import_set_state_nolock()) ffff9ee348aaa800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1762166825.456520:0:30421:0:(genops.c:1550:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ee3606fe000): rc 0 00000020:00080000:1.0:1762166825.456524:0:30421:0:(genops.c:1575:class_disconnect_exports()) OBD device 1 (ffff9ee347166360) has no exports 00000020:00000080:3.0:1762166825.456571:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee34a536000/1d2907fd-ec36-418b-9892-2b7af8c34cb2 for MGS 00000020:00000080:3.0:1762166825.456604:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee34a537800 for MGS 00000020:00010000:3.0:1762166825.456623:0:6548:0:(genops.c:1924:obd_stale_export_get()) Get export ffff9ee3606fe000: total 0 00000100:00100000:2.0:1762166825.456624:0:5749:0:(service.c:3155:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ee3456b1000:5749] 0 exiting: rc = 1 00000100:00100000:0.0:1762166825.456629:0:5750:0:(service.c:3155:ptlrpc_main()) ll_mgs_0001: service thread [ffff9ee345664400:5750] 1 exiting: rc = 0 00000100:00100000:2.0:1762166825.456744:0:5751:0:(service.c:3155:ptlrpc_main()) ll_mgs_0002: service thread [ffff9ee345665800:5751] 2 exiting: rc = 0 00010000:00010000:3.0:1762166825.456802:0:6548:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff9ee3606fe000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1762166825.456825:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee243445200/0xf915a5bdf3c97957 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf915a5bdf3c97950 expref: 9 pid: 5751 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166825.456836:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1762166825.456847:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee243444200/0xf915a5bdf3c97965 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf915a5bdf3c9795e expref: 8 pid: 5751 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166825.456856:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1762166825.456866:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee37fc67a00/0xf915a5bdf3c97a06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf915a5bdf3c979ff expref: 7 pid: 5749 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166825.456872:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.456886:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1762166825.456889:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee36dc7da00/0xf915a5bdf3c97a14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf915a5bdf3c97a0d expref: 6 pid: 5749 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166825.456898:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1762166825.456902:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee243612400/0xf915a5bdf3c9792d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf915a5bdf3c97926 expref: 5 pid: 5749 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166825.456913:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1762166825.456917:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee340031400/0xf915a5bdf3c8d8c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf915a5bdf3c8d8b9 expref: 4 pid: 5751 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166825.456926:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1762166825.456930:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee382044e00/0xf915a5bdf3c8d674 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf915a5bdf3c8d66d expref: 3 pid: 5750 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166825.456939:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1762166825.456945:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee36dc7d400/0xf915a5bdf3c979dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf915a5bdf3c979d5 expref: 2 pid: 5751 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166825.456958:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1762166825.456969:0:6548:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff9ee3606fe000, canceled 8 locks, left on hash table 0. 00000100:00100000:1.0:1762166825.456976:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.456987:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1762166825.456992:0:6548:0:(genops.c:904:class_export_put()) final put ffff9ee3606fe000/f1807908-b95d-4027-b65a-753b7d69e554 00000100:00100000:1.0:1762166825.456998:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1762166825.457002:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166825.457004:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166825.457008:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1762166825.457009:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166825.457015:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457020:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457024:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457027:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457031:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457034:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457039:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457045:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1762166825.457047:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee3606fe000/f1807908-b95d-4027-b65a-753b7d69e554 for MGS 00000100:00100000:1.0:1762166825.457053:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457059:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457065:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457070:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457074:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457090:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1762166825.457097:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee348aaa800 for MGS 00000100:00100000:1.0:1762166825.457101:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457111:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457119:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457126:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457134:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457141:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457148:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457155:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457161:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457166:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457173:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457178:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457183:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457188:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457192:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457197:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457201:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457206:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457210:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457216:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457227:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457235:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457244:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457250:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457254:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457257:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457266:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457272:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457277:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457282:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457286:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457289:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457293:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457297:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457305:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457309:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.457317:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1762166825.458050:0:30421:0:(mgs_llog.c:91:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1762166825.458054:0:30421:0:(mgs_llog.c:91:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1762166825.458560:0:30421:0:(lprocfs_status_server.c:299:lprocfs_free_client_stats()) stat ffff9ee3482ca6c0 - data ffff9ee365888870/ffff9ee242a3cc00 00000020:01000000:1.0:1762166825.458667:0:30421:0:(lprocfs_status_server.c:299:lprocfs_free_client_stats()) stat ffff9ee349de6a80 - data ffff9ee36abbf6c0/ffff9ee343e01800 00000020:00000080:1.0:1762166825.459158:0:30421:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c8d55c 00000020:00000080:1.0:1762166825.459162:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee349cc2000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1762166825.459176:0:30421:0:(tgt_mount.c:188:server_put_mount()) put mount ffff9ee3606fc000 from MGS, refs=2 00000020:01000004:1.0:1762166825.459179:0:30421:0:(obd_mount.c:705:lustre_put_lsi()) put ffff9ee3606fc000 2 00000020:01000004:1.0:1762166825.459182:0:30421:0:(tgt_mount.c:121:server_deregister_mount()) deregister mount ffff9ee3606fc000 from MGS 00000020:00000080:3.0:1762166825.459188:0:38:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee349cc2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1762166825.459203:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1762166825.459209:0:30421:0:(obd_config.c:814:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1762166825.459211:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee349cc5800/MGS 00000020:00000080:1.0:1762166825.459214:0:30421:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee349cc5800/MGS for MGS 00000020:01000000:1.0:1762166825.459219:0:30421:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1762166825.459262:0:30421:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1762166825.459266:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1762166825.459271:0:30421:0:(obd_config.c:886:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1762166825.459276:0:30421:0:(genops.c:1836:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ee37f017800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1762166825.459281:0:30421:0:(genops.c:1570:class_disconnect_exports()) OBD device 8 (ffff9ee3471618d8) has exports, disconnecting them 00000020:00080000:1.0:1762166825.459285:0:30421:0:(genops.c:1545:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ee37f017800), last request at 1762166482 00000020:00000080:1.0:1762166825.459289:0:30421:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c8d627 00000020:00080000:1.0:1762166825.459299:0:30421:0:(genops.c:1550:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ee37f017800): rc 0 00000020:00000080:1.0:1762166825.459302:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee37f017800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1762166825.459431:0:38:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee37f017800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1762166825.465212:0:30421:0:(obd_class.h:663:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1762166825.465222:0:30421:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1762166825.465227:0:30421:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00020000:1.0:1762166825.465233:0:30421:0:(obd_class.h:479:obd_check_dev()) Device 8 not setup 00000100:00100000:1.0:1762166825.465236:0:30421:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00020000:1.0:1762166825.465249:0:30421:0:(obd_class.h:479:obd_check_dev()) Device 8 not setup 00000020:00000080:3.0:1762166825.465333:0:38:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee37f010800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1762166825.465446:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1762166825.465456:0:30421:0:(obd_config.c:814:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1762166825.465461:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee37f014800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1762166825.465465:0:30421:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee37f014800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1762166825.465473:0:30421:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1762166825.465537:0:30421:0:(obd_mount.c:705:lustre_put_lsi()) put ffff9ee3606fc000 1 00000020:00000080:1.0:1762166825.465543:0:30421:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3c8d54e 00000020:00000080:1.0:1762166825.465550:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee349cc6000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1762166825.465563:0:30421:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1762166825.465567:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1762166825.465572:0:30421:0:(obd_config.c:886:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1762166825.465577:0:30421:0:(genops.c:1575:class_disconnect_exports()) OBD device 0 (ffff9ee347160000) has no exports 00000020:00000080:3.0:1762166825.465582:0:38:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee349cc6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1762166825.474810:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1762166825.474823:0:30421:0:(obd_config.c:814:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1762166825.474828:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee3606f8000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1762166825.474832:0:30421:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee3606f8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1762166825.474839:0:30421:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1762166825.474943:0:30421:0:(obd_mount.c:637:lustre_free_lsi()) Freeing lsi ffff9ee3606ff000 00000020:01000000:1.0:1762166825.474964:0:30421:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1762166825.474968:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1762166825.474972:0:30421:0:(obd_config.c:886:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1762166825.474976:0:30421:0:(genops.c:1575:class_disconnect_exports()) OBD device 3 (ffff9ee348a20000) has no exports 00000100:00100000:3.0:1762166825.475085:0:6558:0:(service.c:3155:ptlrpc_main()) mdt00_003: service thread [ffff9ee242a76800:6558] 3 exiting: rc = 0 00000100:00100000:3.0:1762166825.475216:0:20128:0:(service.c:3155:ptlrpc_main()) mdt00_004: service thread [ffff9ee241f57c00:20128] 4 exiting: rc = 0 00000100:00100000:3.0:1762166825.475971:0:5756:0:(service.c:3155:ptlrpc_main()) mdt00_001: service thread [ffff9ee345ac8c00:5756] 1 exiting: rc = 0 00000100:00100000:3.0:1762166825.476057:0:5755:0:(service.c:3155:ptlrpc_main()) mdt00_000: service thread [ffff9ee348a10400:5755] 0 exiting: rc = 1 00000100:00100000:3.0:1762166825.478897:0:5757:0:(service.c:3155:ptlrpc_main()) mdt00_002: service thread [ffff9ee34a527000:5757] 2 exiting: rc = 0 00000100:00100000:1.0:1762166825.478975:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.478989:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479000:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479010:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479021:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479032:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479042:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479055:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479066:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479077:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479099:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479107:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479118:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479128:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479140:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479150:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479161:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479171:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479181:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479193:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479204:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479215:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479225:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479235:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479245:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479255:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479276:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479286:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479294:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479302:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479311:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479321:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479330:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479339:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479348:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479358:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479369:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479378:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479389:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479398:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479409:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479419:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479428:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479438:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479447:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479465:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479473:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479482:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479493:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479503:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479510:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479516:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479522:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479527:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479533:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479539:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479544:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479549:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479555:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479560:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479565:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479571:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479576:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.479582:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1762166825.482684:0:11804:0:(service.c:3155:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9ee3456ae000:11804] 2 exiting: rc = 0 00000100:00100000:3.0:1762166825.482688:0:5759:0:(service.c:3155:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ee34a527200:5759] 1 exiting: rc = 0 00000100:00100000:2.0:1762166825.482703:0:5758:0:(service.c:3155:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9ee34a51a200:5758] 0 exiting: rc = 1 00000100:00100000:1.0:1762166825.482810:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482821:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482831:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482840:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482846:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482852:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482858:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482864:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482870:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482877:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482883:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482889:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482895:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482901:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482908:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482914:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482931:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482936:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482943:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482949:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482955:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482961:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482968:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482974:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482981:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482987:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482993:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.482999:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483004:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483010:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483016:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483022:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483028:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483034:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483040:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483046:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483051:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483059:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483065:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483071:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483077:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483083:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483089:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483096:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483102:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483108:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483114:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483120:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483126:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483131:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483137:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483150:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483156:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483162:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483168:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483174:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483179:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483186:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483192:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483197:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483203:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483208:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483214:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.483220:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1762166825.483664:0:5760:0:(service.c:3155:ptlrpc_main()) mdt_out00_000: service thread [ffff9ee34a527400:5760] 0 exiting: rc = 1 00000100:00100000:2.0:1762166825.483684:0:5761:0:(service.c:3155:ptlrpc_main()) mdt_out00_001: service thread [ffff9ee34a51a400:5761] 1 exiting: rc = 0 00000100:00100000:0.0:1762166825.483690:0:11810:0:(service.c:3155:ptlrpc_main()) mdt_out00_002: service thread [ffff9ee3470e8a00:11810] 2 exiting: rc = 0 00000100:00100000:2.0:1762166825.484573:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484581:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484587:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484595:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484601:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484608:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484613:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484619:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484625:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484650:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484658:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484664:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484669:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484675:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484680:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484685:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484691:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484697:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484703:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484708:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484713:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484732:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484739:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484745:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484752:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484782:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484789:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484795:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484801:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484806:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484812:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484817:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484823:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484838:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484842:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484846:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484850:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484854:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484857:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484869:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484878:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484884:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484890:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484895:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484902:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484921:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484928:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484933:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484939:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484944:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484949:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484953:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484957:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484961:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484964:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484968:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484971:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484984:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484989:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.484992:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.485000:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.485004:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.485007:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.485011:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1762166825.490285:0:7845:0:(service.c:3155:ptlrpc_main()) mdt_seqs_0002: service thread [ffff9ee36f43f600:7845] 2 exiting: rc = 0 00000100:00100000:3.0:1762166825.490407:0:5763:0:(service.c:3155:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ee34a527c00:5763] 1 exiting: rc = 0 00000100:00100000:1.0:1762166825.490439:0:5762:0:(service.c:3155:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ee34a51a600:5762] 0 exiting: rc = 1 00000100:00100000:2.0:1762166825.490731:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490738:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490744:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490749:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490754:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490759:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490796:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490802:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490808:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490815:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490824:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490830:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490834:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490842:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490851:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490861:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490871:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490890:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490901:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490917:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490925:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490939:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490948:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490956:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490965:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490974:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490984:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.490994:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491004:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491014:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491022:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491045:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491055:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491074:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491084:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491093:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491101:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491108:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491115:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491121:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491125:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491130:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491135:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491140:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491145:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491150:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491155:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491160:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491165:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491170:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491175:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491180:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491185:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491190:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491195:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491199:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491204:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491209:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491215:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491219:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491224:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491228:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491233:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491238:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1762166825.491554:0:5765:0:(service.c:3155:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ee370f45000:5765] 1 exiting: rc = 0 00000100:00100000:1.0:1762166825.491556:0:5764:0:(service.c:3155:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ee370f46a00:5764] 0 exiting: rc = 1 00000100:00100000:2.0:1762166825.491652:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491658:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491671:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491675:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491680:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491685:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491690:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491695:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491700:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491705:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491710:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491714:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491719:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491724:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491729:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491734:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491739:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491743:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491747:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491751:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491755:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491868:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491946:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491956:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491963:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.491998:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492007:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492015:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492021:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492026:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492031:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492035:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492039:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492043:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492047:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492052:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492057:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492070:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492075:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492080:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492085:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492090:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492095:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492099:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492104:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492109:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492114:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492119:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492123:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492128:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492133:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492138:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492142:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492146:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492150:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492154:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492159:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492164:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492168:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492172:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492177:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492181:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492185:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492190:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1762166825.492701:0:5766:0:(service.c:3155:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ee370f46600:5766] 0 exiting: rc = 1 00000100:00100000:1.0:1762166825.492739:0:5767:0:(service.c:3155:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ee370f45200:5767] 1 exiting: rc = 0 00000100:00100000:2.0:1762166825.492852:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492858:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492863:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492868:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492872:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492877:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492881:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492886:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492897:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492902:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492907:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492912:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492917:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492923:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492928:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492933:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492937:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492942:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492947:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492953:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492958:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492963:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492968:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492972:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492978:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492983:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492988:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492993:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.492999:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493004:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493009:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493014:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493019:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493024:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493029:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493034:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493038:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493043:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493048:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493053:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493058:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493062:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493068:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493080:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493085:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493091:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493096:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493101:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493106:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493114:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493120:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493127:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493132:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493138:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493143:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493148:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493153:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493158:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493162:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493167:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493172:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493177:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493182:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493187:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1762166825.493587:0:5770:0:(service.c:3155:ptlrpc_main()) mdt_io00_002: service thread [ffff9ee37ec80800:5770] 2 exiting: rc = 0 00000100:00100000:0.0:1762166825.493668:0:5769:0:(service.c:3155:ptlrpc_main()) mdt_io00_001: service thread [ffff9ee37ec93c00:5769] 1 exiting: rc = 0 00000100:00100000:1.0:1762166825.493848:0:5768:0:(service.c:3155:ptlrpc_main()) mdt_io00_000: service thread [ffff9ee370f46c00:5768] 0 exiting: rc = 1 00000100:00100000:2.0:1762166825.493943:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493950:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493956:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493961:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493967:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493972:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493978:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493983:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493989:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.493994:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494013:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494020:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494025:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494030:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494044:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494049:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494055:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494060:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494066:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494072:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494077:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494082:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494087:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494093:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494099:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494105:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494111:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494117:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494256:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494267:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494274:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494281:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494290:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494300:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494331:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494342:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494351:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494359:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494365:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494371:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494377:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494424:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494435:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494441:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494448:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494454:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494464:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494470:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494477:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494492:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494498:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494504:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494510:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494517:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494523:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494528:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494534:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494540:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494547:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494553:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494559:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494564:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494571:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166825.494576:0:30421:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1762166825.498211:0:30421:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1762166825.498224:0:30421:0:(obd_config.c:814:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1762166825.498229:0:30421:0:(genops.c:904:class_export_put()) final put ffff9ee345a5d800/MDS_uuid 00000020:00000080:3.0:1762166825.498233:0:30421:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee345a5d800/MDS_uuid for MDS 00000020:01000000:3.0:1762166825.498238:0:30421:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1762166825.498375:0:30421:0:(tgt_mount.c:2025:server_put_super()) server umount lustre-MDT0000 complete 00000001:00080000:1.0:1762166825.659311:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869415 is committed 00000001:00100000:1.0:1762166825.659334:0:23749:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1762166825.659343:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869421 is committed 00000001:00080000:1.0:1762166825.659353:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869420 is committed 00000020:00000080:1.0:1762166825.659367:0:23749:0:(genops.c:904:class_export_put()) final put ffff9ee24243c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1762166825.659411:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee24243c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1762166825.659461:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee374a05800 for lustre-OST0001 00010000:00010000:0.0:1762166826.408888:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1762166826.678541:0:22362:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1762166826.678560:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836751 is committed 00000001:00080000:1.0:1762166826.678571:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836749 is committed 00000020:00000080:1.0:1762166826.678577:0:22362:0:(genops.c:904:class_export_put()) final put ffff9ee343757000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1762166826.678661:0:38:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee343757000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1762166826.678716:0:38:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee37fc10800 for lustre-OST0000 00000400:00000100:1.0:1762166827.108482:0:3287:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.203.35@tcp portal 26 match 1847765444341888 offset 0 length 224: 4 00000400:00000100:1.0:1762166827.108500:0:3287:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.203.35@tcp portal 12 match 1847765444342016 offset 0 length 224: 4 00000100:00100000:1.0:1762166827.108519:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166827.108571:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166827.108670:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444342272 00000100:00100000:2.0:1762166827.108681:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444342272 00000100:00100000:0.0:1762166827.108703:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444342144 00000100:00100000:0.0:1762166827.108709:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444342144 00000100:00100000:2.0:1762166827.108801:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 188 00000100:00080000:1.0:1762166827.108803:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1762166827.108810:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166827.108817:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2361:x1847765444342144:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762166827.108820:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 189 00000100:00100000:3.0:1762166827.108837:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2360:x1847765444342272:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762166827.108893:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2360:x1847765444342272:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 62us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.108894:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2361:x1847765444342144:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 84us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.108906:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 188 00000100:00100000:3.0:1762166827.108918:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 189 00000100:00100000:0.0:1762166827.175972:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1762166827.175994:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451937280:0@lo:400:kworker.0 00000100:00100000:3.0:1762166827.175995:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1847765451937536:0@lo:400:kworker.0 00000400:00000100:0.0:1762166827.176052:0:3295:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1847765451937280 offset 0 length 224: 4 00000400:00000100:3.0:1762166827.176055:0:3294:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1847765451937536 offset 0 length 224: 4 00000100:00100000:1.0:1762166827.176067:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765451937408:0@lo:400:kworker.0 00000400:00000100:1.0:1762166827.176098:0:3293:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1847765451937408 offset 0 length 224: 4 00010000:00010000:0.0:1762166827.431914:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166828.455905:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166829.479944:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166830.504025:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166831.527943:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1762166832.228276:0:3288:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.203.35@tcp portal 12 match 1847765444342528 offset 0 length 224: 4 00000100:00100000:0.0:1762166832.228306:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000400:00000100:0.0:1762166832.228335:0:3288:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.203.35@tcp portal 26 match 1847765444342400 offset 0 length 224: 4 00000100:00100000:0.0:1762166832.228376:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166832.228415:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444342784 00000100:00100000:3.0:1762166832.228424:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444342784 00000100:00100000:2.0:1762166832.228463:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444342656 00000100:00100000:2.0:1762166832.228469:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444342656 00000100:00100000:3.0:1762166832.228499:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 190 00000100:00100000:2.0:1762166832.228508:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 191 00000100:00100000:3.0:1762166832.228514:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2360:x1847765444342784:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:2.0:1762166832.228522:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2360:x1847765444342656:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762166832.228586:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2360:x1847765444342784:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 78us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166832.228591:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2360:x1847765444342656:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 71us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166832.228610:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 190 00000100:00100000:2.0:1762166832.228627:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 191 00000100:00080000:1.0:1762166832.228794:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1762166832.228798:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166832.296236:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1847765451937792:0@lo:400:kworker.0 00000100:00100000:2.0:1762166832.296253:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1762166832.296268:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1847765451937920:0@lo:400:kworker.0 00000400:00000100:3.0:1762166832.296291:0:3296:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1847765451937792 offset 0 length 224: 4 00000400:00000100:2.0:1762166832.296298:0:3294:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1847765451937920 offset 0 length 224: 4 00000100:00100000:3.0:1762166832.296345:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1762166832.296353:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f1807908-b95d-4027-b65a-753b7d69e554:3296:1847765451937664:0@lo:400:kworker.0 00000400:00000100:3.0:1762166832.296373:0:3296:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1847765451937664 offset 0 length 224: 4 00010000:00010000:0.0:1762166832.551923:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166833.576352:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166834.599963:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166835.623909:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166836.648203:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1762166837.348047:0:3286:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.203.35@tcp portal 26 match 1847765444342912 offset 0 length 224: 4 00000400:00000100:3.0:1762166837.348070:0:3286:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.203.35@tcp portal 12 match 1847765444343040 offset 0 length 224: 4 00000100:00100000:3.0:1762166837.348093:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166837.348131:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166837.348161:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444343168 00000100:00100000:1.0:1762166837.348179:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444343168 00000100:00080000:2.0:1762166837.348256:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166837.348277:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444343296 00000100:00100000:1.0:1762166837.348281:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444343296 00000100:00100000:3.0:1762166837.348318:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 192 00000100:00080000:2.0:1762166837.348335:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166837.348342:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 193 00000100:00100000:3.0:1762166837.348352:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2359:x1847765444343168:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:1.0:1762166837.348353:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2358:x1847765444343296:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:1.0:1762166837.348456:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2358:x1847765444343296:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 104us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166837.348466:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2359:x1847765444343168:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 116us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166837.348475:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 193 00000100:00100000:3.0:1762166837.348486:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 192 00000100:00100000:3.0:1762166837.416018:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1847765451938304:0@lo:400:kworker.0 00000100:00100000:0.0:1762166837.416018:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1762166837.416046:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f1807908-b95d-4027-b65a-753b7d69e554:3293:1847765451938048:0@lo:400:kworker.0 00000400:00000100:3.0:1762166837.416106:0:3296:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1847765451938304 offset 0 length 224: 4 00000400:00000100:0.0:1762166837.416113:0:3293:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1847765451938048 offset 0 length 224: 4 00000100:00100000:3.0:1762166837.416237:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1762166837.416255:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1847765451938176:0@lo:400:kworker.0 00000400:00000100:3.0:1762166837.416298:0:3296:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1847765451938176 offset 0 length 224: 4 00010000:00010000:3.0:1762166837.671887:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:01200004:0.0:1762166838.118683:0:30810:0:(super25.c:139:lustre_fill_super()) VFS Op: sb ffff9ee2455ce800 00000020:01000004:0.0:1762166838.118733:0:30810:0:(obd_mount.c:901:lmd_print()) mount data: 00000020:01000004:0.0:1762166838.118735:0:30810:0:(obd_mount.c:904:lmd_print()) device: lustre-mdt1/mdt1 00000020:01000004:0.0:1762166838.118746:0:30810:0:(tgt_mount.c:2368:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1762166838.118779:0:30810:0:(obd_mount.c:184:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1762166838.118786:0:30810:0:(obd_config.c:1389:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1762166838.118807:0:30810:0:(genops.c:412:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ee24826ca88) 00000020:00000080:0.0:1762166838.118826:0:30810:0:(obd_config.c:657:class_attach()) OBD: dev 0 attached type osd-zfs with refcount 2 00000020:00000080:0.0:1762166838.118832:0:30810:0:(obd_config.c:1389:class_process_config()) processing cmd: cf003 00100000:10000000:2.0:1762166838.140756:0:30810:0:(osd_scrub.c:905:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1762166838.145485:0:30810:0:(osd_scrub.c:905:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1762166838.146623:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 339: rc = 0 00100000:10000000:0.0:1762166838.146668:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 339: rc = 0 00100000:10000000:0.0:1762166838.147599:0:30810:0:(osd_scrub.c:905:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1762166838.147628:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 339: rc = 0 00100000:10000000:0.0:1762166838.147677:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 339: rc = 0 00100000:10000000:2.0:1762166838.147999:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 339: rc = 0 00100000:10000000:2.0:1762166838.148046:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 339: rc = 0 00100000:10000000:2.0:1762166838.149243:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 341: rc = 0 00100000:10000000:2.0:1762166838.153482:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:2.0:1762166838.153531:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:2.0:1762166838.155534:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 517: rc = 0 00100000:10000000:2.0:1762166838.157881:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 517: rc = 0 00100000:10000000:2.0:1762166838.159352:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 517: rc = 0 00100000:10000000:2.0:1762166838.160940:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 517: rc = 0 00100000:10000000:2.0:1762166838.161983:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 517: rc = 0 00100000:10000000:2.0:1762166838.163674:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 517: rc = 0 00100000:10000000:2.0:1762166838.164880:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 517: rc = 0 00100000:10000000:2.0:1762166838.166269:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 517: rc = 0 00100000:10000000:2.0:1762166838.167605:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 517: rc = 0 00100000:10000000:2.0:1762166838.168630:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 517: rc = 0 00100000:10000000:2.0:1762166838.169638:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 517: rc = 0 00100000:10000000:2.0:1762166838.171344:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 517: rc = 0 00100000:10000000:2.0:1762166838.174452:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 539: rc = 0 00100000:10000000:2.0:1762166838.175992:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 539: rc = 0 00100000:10000000:2.0:1762166838.176986:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 539: rc = 0 00100000:10000000:2.0:1762166838.178065:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 539: rc = 0 00100000:10000000:2.0:1762166838.179088:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 539: rc = 0 00100000:10000000:2.0:1762166838.180603:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 539: rc = 0 00100000:10000000:2.0:1762166838.182609:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 539: rc = 0 00100000:10000000:2.0:1762166838.184978:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 539: rc = 0 00100000:10000000:2.0:1762166838.186723:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 539: rc = 0 00100000:10000000:2.0:1762166838.187726:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 539: rc = 0 00100000:10000000:2.0:1762166838.188643:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 539: rc = 0 00100000:10000000:2.0:1762166838.190205:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 539: rc = 0 00100000:10000000:2.0:1762166838.192152:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 539: rc = 0 00100000:10000000:2.0:1762166838.193777:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 539: rc = 0 00100000:10000000:2.0:1762166838.194879:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 539: rc = 0 00100000:10000000:2.0:1762166838.196726:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 539: rc = 0 00100000:10000000:2.0:1762166838.198118:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 539: rc = 0 00100000:10000000:2.0:1762166838.199090:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 539: rc = 0 00100000:10000000:2.0:1762166838.200837:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 539: rc = 0 00100000:10000000:2.0:1762166838.202093:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 539: rc = 0 00100000:10000000:2.0:1762166838.206915:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 539: rc = 0 00100000:10000000:2.0:1762166838.208686:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 539: rc = 0 00100000:10000000:3.0:1762166838.210255:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 539: rc = 0 00100000:10000000:3.0:1762166838.211469:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 539: rc = 0 00100000:10000000:3.0:1762166838.215082:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 539: rc = 0 00100000:10000000:3.0:1762166838.217092:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 539: rc = 0 00100000:10000000:3.0:1762166838.218943:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 539: rc = 0 00100000:10000000:3.0:1762166838.220662:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 539: rc = 0 00100000:10000000:3.0:1762166838.221794:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 539: rc = 0 00100000:10000000:3.0:1762166838.224165:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 539: rc = 0 00100000:10000000:3.0:1762166838.225417:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 539: rc = 0 00100000:10000000:3.0:1762166838.226561:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 539: rc = 0 00100000:10000000:3.0:1762166838.229260:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 778: rc = 0 00100000:10000000:3.0:1762166838.229346:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x2:0x0] under 778: rc = 0 00100000:10000000:3.0:1762166838.236871:0:30810:0:(osd_scrub.c:905:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1762166838.238479:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:3.0:1762166838.240506:0:30810:0:(osd_scrub.c:905:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1762166838.240570:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:3.0:1762166838.241901:0:30810:0:(osd_scrub.c:905:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1762166838.241931:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:3.0:1762166838.244882:0:30810:0:(osd_scrub.c:905:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1762166838.244929:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 773: rc = 0 00100000:10000000:3.0:1762166838.246519:0:30810:0:(osd_scrub.c:905:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1762166838.246548:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 773: rc = 0 00100000:10000000:3.0:1762166838.247606:0:30810:0:(osd_scrub.c:905:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1762166838.247628:0:30810:0:(osd_scrub.c:1154:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 773: rc = 0 00000020:00000080:3.0:1762166838.247928:0:30810:0:(obd_config.c:761:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1762166838.247938:0:30810:0:(osd_handler.c:1528:osd_obd_connect()) connect #0 00000020:00000080:3.0:1762166838.247947:0:30810:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf915a5bdf3c9cd18 00000020:01000004:3.0:1762166838.247954:0:30810:0:(tgt_mount.c:2453:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1762166838.247963:0:30810:0:(tgt_mount.c:220:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1762166838.247968:0:30810:0:(tgt_mount.c:102:server_register_mount()) register mount ffff9ee2455ce800 from MGS 00000020:01000004:3.0:1762166838.247972:0:30810:0:(obd_mount.c:184:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1762166838.247976:0:30810:0:(obd_config.c:1389:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1762166838.248000:0:30810:0:(genops.c:412:class_newdev()) Allocate new device MGS (ffff9ee242b46360) 00000020:00000080:3.0:1762166838.248015:0:30810:0:(obd_config.c:657:class_attach()) OBD: dev 1 attached type mgs with refcount 2 00000020:00000080:3.0:1762166838.248019:0:30810:0:(obd_config.c:1389:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1762166838.248075:0:30810:0:(tgt_mount.c:154:server_get_mount()) get mount ffff9ee2455ce800 from MGS, refs=2 00080000:01000000:3.0:1762166838.248081:0:30810:0:(osd_handler.c:1528:osd_obd_connect()) connect #1 00000020:00000080:3.0:1762166838.248090:0:30810:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf915a5bdf3c9cd26 00010000:00010000:3.0:1762166838.248204:0:30810:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-2 is initialized 00000040:01000000:3.0:1762166838.262534:0:30810:0:(llog_obd.c:195:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1762166838.262559:0:30810:0:(mgs_llog.c:91:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1762166838.262562:0:30810:0:(mgs_llog.c:91:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1762166838.263582:0:30811:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1762166838.263693:0:30810:0:(mgs_nids.c:657:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1762166838.263756:0:30810:0:(mgs_llog.c:601:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1762166838.267027:0:30810:0:(mgs_llog.c:601:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1762166838.267315:0:30810:0:(service.c:153:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1762166838.267476:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1762166838.267489:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1762166838.269105:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1762166838.269113:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1762166838.269561:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1762166838.269576:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1762166838.270277:0:30810:0:(obd_config.c:761:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1762166838.270301:0:30810:0:(obd_mount.c:381:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1762166838.270303:0:30810:0:(obd_mount.c:392:lustre_start_mgc()) MGC192.168.203.135@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1762166838.270306:0:30810:0:(mgc_request.c:1068:mgc_set_info_async()) InitRecov MGC192.168.203.135@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:2.0:1762166838.270311:0:30810:0:(import.c:65:import_set_state_nolock()) ffff9ee345a5c000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1762166838.270317:0:30810:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.203.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1762166838.276396:0:30810:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.135@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1762166838.276402:0:30810:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1762166838.276411:0:30810:0:(client.c:3549:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ee36e2bea00 x1847765451937280/t0(0) o400->MGC192.168.203.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1762166843 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1762166838.276447:0:30810:0:(client.c:3549:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ee343718700 x1847765451937664/t0(0) o400->MGC192.168.203.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1762166848 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1762166838.276462:0:30810:0:(client.c:3549:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ee34371a680 x1847765451938048/t0(0) o400->MGC192.168.203.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1762166853 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1762166838.276483:0:30810:0:(mgc_request.c:1165:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1762166838.276487:0:30810:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1762166838.276488:0:30810:0:(mgc_request.c:1165:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1762166838.276491:0:30810:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1762166838.276531:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451937280:0@lo:400:kworker.0 00000100:00100000:1.0:1762166838.276581:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f1807908-b95d-4027-b65a-753b7d69e554:3293:1847765451938048:0@lo:400:kworker.0 00000100:00100000:3.0:1762166838.277418:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f1807908-b95d-4027-b65a-753b7d69e554:3296:1847765451937664:0@lo:400:kworker.0 10000000:01000000:2.0:1762166838.277458:0:30810:0:(mgc_request.c:1165:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1762166838.277472:0:30810:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.135@tcp lock: ffff9ee38216c400/0xf915a5bdf3c8d66d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf915a5bdf3c8d674 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1762166838.277481:0:30810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.135@tcp lock: ffff9ee38216c400/0xf915a5bdf3c8d66d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf915a5bdf3c8d674 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166838.277487:0:30810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1762166838.277504:0:30810:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1762166838.277511:0:30810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.135@tcp lock: ffff9ee38216c400/0xf915a5bdf3c8d66d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf915a5bdf3c8d674 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.277546:0:30810:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.135@tcp lock: ffff9ee341673a00/0xf915a5bdf3c8d8b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xf915a5bdf3c8d8c0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1762166838.277564:0:30810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.135@tcp lock: ffff9ee341673a00/0xf915a5bdf3c8d8b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xf915a5bdf3c8d8c0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166838.277569:0:30810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1762166838.277573:0:30810:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1762166838.277577:0:30810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.135@tcp lock: ffff9ee341673a00/0xf915a5bdf3c8d8b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xf915a5bdf3c8d8c0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.277590:0:30810:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.135@tcp lock: ffff9ee245686400/0xf915a5bdf3c97926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xf915a5bdf3c9792d expref: -99 pid: 22179 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1762166838.277596:0:30810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.135@tcp lock: ffff9ee245686400/0xf915a5bdf3c97926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xf915a5bdf3c9792d expref: -99 pid: 22179 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166838.277601:0:30810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1762166838.277610:0:30810:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1762166838.277615:0:30810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.135@tcp lock: ffff9ee245686400/0xf915a5bdf3c97926 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xf915a5bdf3c9792d expref: -99 pid: 22179 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.277624:0:30810:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.135@tcp lock: ffff9ee243613600/0xf915a5bdf3c9795e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xf915a5bdf3c97965 expref: -99 pid: 22179 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1762166838.277630:0:30810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.135@tcp lock: ffff9ee243613600/0xf915a5bdf3c9795e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xf915a5bdf3c97965 expref: -99 pid: 22179 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166838.277635:0:30810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1762166838.277645:0:30810:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1762166838.277649:0:30810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.135@tcp lock: ffff9ee243613600/0xf915a5bdf3c9795e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xf915a5bdf3c97965 expref: -99 pid: 22179 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.277665:0:30810:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.135@tcp lock: ffff9ee37fc67e00/0xf915a5bdf3c979d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xf915a5bdf3c979dc expref: -99 pid: 23467 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1762166838.277671:0:30810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.135@tcp lock: ffff9ee37fc67e00/0xf915a5bdf3c979d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xf915a5bdf3c979dc expref: -99 pid: 23467 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166838.277676:0:30810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1762166838.277691:0:30810:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1762166838.277695:0:30810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.135@tcp lock: ffff9ee37fc67e00/0xf915a5bdf3c979d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xf915a5bdf3c979dc expref: -99 pid: 23467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.277704:0:30810:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.135@tcp lock: ffff9ee37fc66000/0xf915a5bdf3c97a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf915a5bdf3c97a14 expref: -99 pid: 23467 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1762166838.277710:0:30810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.135@tcp lock: ffff9ee37fc66000/0xf915a5bdf3c97a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf915a5bdf3c97a14 expref: -99 pid: 23467 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166838.277715:0:30810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1762166838.277718:0:30810:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1762166838.277721:0:30810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.135@tcp lock: ffff9ee37fc66000/0xf915a5bdf3c97a0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf915a5bdf3c97a14 expref: -99 pid: 23467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.277733:0:30810:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.135@tcp lock: ffff9ee245687600/0xf915a5bdf3c97950 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xf915a5bdf3c97957 expref: -99 pid: 22179 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1762166838.277738:0:30810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.135@tcp lock: ffff9ee245687600/0xf915a5bdf3c97950 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xf915a5bdf3c97957 expref: -99 pid: 22179 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166838.277743:0:30810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1762166838.277746:0:30810:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1762166838.277749:0:30810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.135@tcp lock: ffff9ee245687600/0xf915a5bdf3c97950 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xf915a5bdf3c97957 expref: -99 pid: 22179 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.277809:0:30810:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.135@tcp lock: ffff9ee245686e00/0xf915a5bdf3c979ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf915a5bdf3c97a06 expref: -99 pid: 23467 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1762166838.277817:0:30810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.135@tcp lock: ffff9ee245686e00/0xf915a5bdf3c979ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf915a5bdf3c97a06 expref: -99 pid: 23467 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166838.277822:0:30810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1762166838.277830:0:30810:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1762166838.277833:0:30810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.135@tcp lock: ffff9ee245686e00/0xf915a5bdf3c979ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf915a5bdf3c97a06 expref: -99 pid: 23467 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1762166838.277850:0:30810:0:(import.c:213:ptlrpc_set_import_discon()) mgc: import ffff9ee345a5c000 already not connected (conn 1, was 0): DISCONN 00000100:00080000:2.0:1762166838.277855:0:30810:0:(import.c:65:import_set_state_nolock()) ffff9ee345a5c000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1762166838.277860:0:30810:0:(import.c:509:import_select_connection()) MGC192.168.203.135@tcp: connect to NID 0@lo last attempt 103 00000100:00080000:2.0:1762166838.277867:0:30810:0:(import.c:623:import_select_connection()) MGC192.168.203.135@tcp: import ffff9ee345a5c000 using connection 192.168.203.135@tcp/0@lo 00000100:00100000:2.0:1762166838.277899:0:30810:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ee34371bb80 x1847765451938432/t0(0) o250->MGC192.168.203.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1762166838.277917:0:30810:0:(recover.c:338:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1762166838.277962:0:3292:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f1807908-b95d-4027-b65a-753b7d69e554:3292:1847765451938432:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1762166838.278016:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166838.278062:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451938432 00000100:00100000:3.0:1762166838.278071:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451938432 00000100:00100000:3.0:1762166838.278116:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1762166838.278123:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3292:x1847765451938432:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1762166838.278147:0:30815:0:(ldlm_lib.c:1428:target_handle_connect()) MGS: connection from f1807908-b95d-4027-b65a-753b7d69e554@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:3.0:1762166838.278178:0:30815:0:(genops.c:1402:class_connect()) connect: client f1807908-b95d-4027-b65a-753b7d69e554, cookie 0xf915a5bdf3c9cd2d 00000020:01000000:3.0:1762166838.278185:0:30815:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee34a04d200 00000100:00080000:3.0:1762166838.278299:0:30815:0:(import.c:65:import_set_state_nolock()) ffff9ee35154e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1762166838.278355:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+4:3292:x1847765451938432:12345-0@lo:250:mount.lustre.0 Request processed in 230us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.278364:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1762166838.278394:0:3292:0:(client.c:3071:ptlrpc_free_committed()) MGC192.168.203.135@tcp: committing for last_committed 0 gen 2 00000100:00080000:0.0:1762166838.278403:0:3292:0:(import.c:1123:ptlrpc_connect_interpret()) MGC192.168.203.135@tcp: connect to target with instance 0 00000100:00080000:0.0:1762166838.278409:0:3292:0:(import.c:951:ptlrpc_connect_set_flags()) MGC192.168.203.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1762166838.278412:0:3292:0:(mgc_request.c:1165:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1762166838.278415:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9ee345a5c000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1762166838.278417:0:3292:0:(mgc_request.c:1165:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1762166838.278434:0:3292:0:(pinger.c:185:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1762166838.278447:0:3292:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f1807908-b95d-4027-b65a-753b7d69e554:3292:1847765451938432:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1762166838.278664:0:30810:0:(recover.c:349:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1762166838.278674:0:30810:0:(tgt_mount.c:1653:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1762166838.278681:0:30810:0:(obd_mount.c:184:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1762166838.278686:0:30810:0:(obd_config.c:1389:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1762166838.278699:0:30810:0:(genops.c:412:class_newdev()) Allocate new device MDS (ffff9ee3471631b0) 00000020:00000080:2.0:1762166838.278710:0:30810:0:(obd_config.c:657:class_attach()) OBD: dev 3 attached type mds with refcount 2 00000020:00000080:2.0:1762166838.278717:0:30810:0:(obd_config.c:1389:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1762166838.284508:0:30810:0:(service.c:153:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1762166838.284680:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1762166838.284686:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1762166838.285315:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1762166838.285322:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1762166838.286330:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1762166838.286337:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1762166838.286967:0:30810:0:(service.c:153:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1762166838.287110:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1762166838.287114:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1762166838.288704:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1762166838.288715:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1762166838.309634:0:30810:0:(service.c:153:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1762166838.309839:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1762166838.309847:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1762166838.311151:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1762166838.311173:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1762166838.312577:0:30810:0:(service.c:153:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1762166838.312932:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1762166838.312950:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1762166838.313715:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1762166838.313723:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1762166838.314302:0:30810:0:(service.c:153:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1762166838.314438:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1762166838.314443:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1762166838.315167:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1762166838.315174:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1762166838.315723:0:30810:0:(service.c:153:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1762166838.315870:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1762166838.315875:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1762166838.316407:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1762166838.316414:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1762166838.327455:0:30810:0:(service.c:153:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1762166838.327647:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1762166838.327655:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1762166838.328878:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1762166838.328886:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1762166838.329482:0:30810:0:(service.c:3434:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1762166838.329490:0:30810:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1762166838.330183:0:30810:0:(obd_config.c:761:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1762166838.330211:0:30810:0:(tgt_mount.c:281:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1762166838.330217:0:30810:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1762166838.330341:0:30810:0:(llog_obd.c:195:llog_setup()) obd MGC192.168.203.135@tcp ctxt 0 is initialized 00000020:01000004:2.0:1762166838.330379:0:30810:0:(tgt_mount.c:1370:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.135@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1762166838.330388:0:30810:0:(tgt_mount.c:1147:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1762166838.330390:0:30810:0:(tgt_mount.c:1148:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1762166838.330391:0:30810:0:(tgt_mount.c:1149:server_mti_print()) fs: lustre 00000020:01000004:2.0:1762166838.330392:0:30810:0:(tgt_mount.c:1150:server_mti_print()) uuid: 00000020:01000004:2.0:1762166838.330393:0:30810:0:(tgt_mount.c:1151:server_mti_print()) ver: 0 00000020:01000004:2.0:1762166838.330395:0:30810:0:(tgt_mount.c:1152:server_mti_print()) flags: 00000020:01000004:2.0:1762166838.330396:0:30810:0:(tgt_mount.c:1154:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1762166838.330397:0:30810:0:(tgt_mount.c:1158:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1762166838.330399:0:30810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1762166838.330401:0:30810:0:(tgt_mount.c:1188:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1762166838.330403:0:30810:0:(mgc_request_server.c:415:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1762166838.330405:0:30810:0:(tgt_mount.c:1147:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1762166838.330406:0:30810:0:(tgt_mount.c:1148:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1762166838.330407:0:30810:0:(tgt_mount.c:1149:server_mti_print()) fs: lustre 00000020:01000004:2.0:1762166838.330408:0:30810:0:(tgt_mount.c:1150:server_mti_print()) uuid: 00000020:01000004:2.0:1762166838.330409:0:30810:0:(tgt_mount.c:1151:server_mti_print()) ver: 0 00000020:01000004:2.0:1762166838.330410:0:30810:0:(tgt_mount.c:1152:server_mti_print()) flags: 00000020:01000004:2.0:1762166838.330411:0:30810:0:(tgt_mount.c:1154:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1762166838.330412:0:30810:0:(tgt_mount.c:1158:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1762166838.330413:0:30810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1762166838.330414:0:30810:0:(tgt_mount.c:1188:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1762166838.330441:0:30810:0:(mgc_request_server.c:276:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1762166838.330459:0:30810:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451938560:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1762166838.330519:0:30810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166838.330573:0:30810:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349f003c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166838.330604:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451938560 00000100:00100000:3.0:1762166838.330613:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451938560 00000100:00100000:3.0:1762166838.330659:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1762166838.330670:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+4:30810:x1847765451938560:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1762166838.330716:0:30815:0:(mgs_llog.c:601:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1762166838.330719:0:30815:0:(mgs_handler.c:464:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1762166838.330722:0:30815:0:(mgs_handler.c:491:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1762166838.331175:0:30833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1762166838.331448:0:30815:0:(mgs_nids.c:657:mgs_nidtbl_init_fs()) IR: current version is 12 20000000:01000000:1.0:1762166838.337704:0:30834:0:(mgs_llog.c:280:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1762166838.337725:0:30834:0:(mgs_llog.c:264:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1762166838.337729:0:30834:0:(mgs_llog.c:264:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1762166838.337807:0:30834:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1762166838.337950:0:30815:0:(mgs_llog.c:601:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1762166838.337959:0:30815:0:(mgs_handler.c:599:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1762166838.350805:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+4:30810:x1847765451938560:12345-0@lo:253:mount.lustre.0 Request processed in 20133us (20281us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.350817:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1762166838.350873:0:30810:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451938560:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1762166838.350888:0:30810:0:(mgc_request_server.c:297:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1762166838.350891:0:30810:0:(tgt_mount.c:1147:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1762166838.350893:0:30810:0:(tgt_mount.c:1148:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1762166838.350894:0:30810:0:(tgt_mount.c:1149:server_mti_print()) fs: lustre 00000020:01000004:2.0:1762166838.350895:0:30810:0:(tgt_mount.c:1150:server_mti_print()) uuid: 00000020:01000004:2.0:1762166838.350897:0:30810:0:(tgt_mount.c:1151:server_mti_print()) ver: 0 00000020:01000004:2.0:1762166838.350898:0:30810:0:(tgt_mount.c:1152:server_mti_print()) flags: 00000020:01000004:2.0:1762166838.350900:0:30810:0:(tgt_mount.c:1154:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1762166838.350901:0:30810:0:(tgt_mount.c:1158:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1762166838.350902:0:30810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1762166838.350904:0:30810:0:(tgt_mount.c:1188:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1762166838.350935:0:30810:0:(tgt_mount.c:102:server_register_mount()) register mount ffff9ee2455ce800 from lustre-MDT0000 10000000:01000000:2.0:1762166838.350959:0:30810:0:(mgc_request.c:1952:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1762166838.350962:0:30810:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1762166838.350969:0:30810:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ee2455ce800 10000000:01000000:2.0:1762166838.350974:0:30810:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1762166838.350978:0:30810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ee2455ce800 10000000:01000000:2.0:1762166838.350993:0:30810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1762166838.350997:0:30810:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-barrier-ffff9ee2455ce800 from 1 10000000:01000000:2.0:1762166838.351000:0:30810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1762166838.351036:0:30810:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee36dc14e00/0xf915a5bdf3c9cd3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.351050:0:30810:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.135@tcp lock: ffff9ee36dc14e00/0xf915a5bdf3c9cd3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.351058:0:30810:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.135@tcp lock: ffff9ee36dc14e00/0xf915a5bdf3c9cd3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166838.351078:0:30810:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451938688:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1762166838.351110:0:30810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166838.351147:0:30810:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166838.351168:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451938688 00000100:00100000:3.0:1762166838.351179:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451938688 00000100:00100000:3.0:1762166838.351220:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1762166838.351229:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+4:30810:x1847765451938688:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1762166838.351240:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166838.351251:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee2425f4a00/0xf915a5bdf3c9cd42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf915a5bdf3c9cd3b expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.351274:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee2425f4a00/0xf915a5bdf3c9cd42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf915a5bdf3c9cd3b expref: 5 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.351280:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee2425f4a00/0xf915a5bdf3c9cd42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf915a5bdf3c9cd3b expref: 5 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.351287:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2425f4a00, rc 0) 00000100:00100000:3.0:1762166838.351320:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+5:30810:x1847765451938688:12345-0@lo:101:mount.lustre.0 Request processed in 94us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.351324:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1762166838.351387:0:30810:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451938688:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1762166838.351397:0:30810:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.135@tcp lock: ffff9ee36dc14e00/0xf915a5bdf3c9cd3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9cd42 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.351403:0:30810:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.135@tcp lock: ffff9ee36dc14e00/0xf915a5bdf3c9cd3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c9cd42 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1762166838.351411:0:30810:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.203.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1762166838.351424:0:30810:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee36dc14e00/0xf915a5bdf3c9cd3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9cd42 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.351429:0:30810:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.135@tcp lock: ffff9ee36dc14e00/0xf915a5bdf3c9cd3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9cd42 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1762166838.351433:0:30810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1762166838.351436:0:30810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1762166838.351438:0:30810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ee2455ce800 10000000:01000000:1.0:1762166838.351440:0:30810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1762166838.351442:0:30810:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1762166838.351444:0:30810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1762166838.351454:0:30810:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee244473e00/0xf915a5bdf3c9cd49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.351458:0:30810:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.135@tcp lock: ffff9ee244473e00/0xf915a5bdf3c9cd49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.351462:0:30810:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.135@tcp lock: ffff9ee244473e00/0xf915a5bdf3c9cd49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166838.351478:0:30810:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451938816:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1762166838.351497:0:30810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166838.351513:0:30810:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166838.351572:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451938816 00000100:00100000:0.0:1762166838.351578:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451938816 00000100:00100000:0.0:1762166838.351611:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1762166838.351620:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343f6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+5:30810:x1847765451938816:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1762166838.351628:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166838.351637:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee37f159c00/0xf915a5bdf3c9cd50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf915a5bdf3c9cd49 expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.351652:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee37f159c00/0xf915a5bdf3c9cd50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf915a5bdf3c9cd49 expref: 6 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.351659:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee37f159c00/0xf915a5bdf3c9cd50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf915a5bdf3c9cd49 expref: 6 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.351677:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159c00, rc 0) 00000100:00100000:0.0:1762166838.351719:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343f6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+6:30810:x1847765451938816:12345-0@lo:101:mount.lustre.0 Request processed in 101us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166838.351725:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1762166838.351825:0:30810:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451938816:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1762166838.351851:0:30810:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.135@tcp lock: ffff9ee244473e00/0xf915a5bdf3c9cd49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9cd50 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.351862:0:30810:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.135@tcp lock: ffff9ee244473e00/0xf915a5bdf3c9cd49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c9cd50 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166838.351938:0:30810:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451938944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1762166838.351987:0:30810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166838.352033:0:30810:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166838.352068:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451938944 00000100:00100000:0.0:1762166838.352075:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451938944 00000100:00100000:0.0:1762166838.352119:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1762166838.352127:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343f68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+6:30810:x1847765451938944:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1762166838.352364:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343f68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+7:30810:x1847765451938944:12345-0@lo:501:mount.lustre.0 Request processed in 236us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166838.352372:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1762166838.352390:0:30810:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451938944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1762166838.352422:0:30810:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451939072:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1762166838.352465:0:30810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166838.352484:0:30810:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166838.352510:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451939072 00000100:00100000:0.0:1762166838.352515:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451939072 00000100:00100000:0.0:1762166838.352543:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1762166838.352563:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+7:30810:x1847765451939072:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1762166838.356486:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+7:30810:x1847765451939072:12345-0@lo:503:mount.lustre.0 Request processed in 3929us (4012us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166838.356499:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1762166838.356584:0:30810:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451939072:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1762166838.357183:0:30836:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f1807908-b95d-4027-b65a-753b7d69e554:30836:1847765451939200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1762166838.357268:0:30836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166838.357320:0:30836:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166838.357398:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451939200 00000100:00100000:0.0:1762166838.357407:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451939200 00000100:00100000:0.0:1762166838.357502:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1762166838.357513:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24249b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+7:30836:x1847765451939200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1762166838.359753:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24249b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+7:30836:x1847765451939200:12345-0@lo:502:llog_process_th.0 Request processed in 2235us (2478us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.359804:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1762166838.359928:0:30836:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f1807908-b95d-4027-b65a-753b7d69e554:30836:1847765451939200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1762166838.359972:0:30836:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1762166838.359984:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1762166838.359987:0:30836:0:(obd_config.c:1477:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1762166838.359991:0:30836:0:(obd_config.c:1865:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1762166838.359995:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1762166838.360010:0:30836:0:(genops.c:412:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9ee242b40000) 00000020:00000080:3.0:1762166838.360029:0:30836:0:(obd_config.c:657:class_attach()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1762166838.360035:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1762166838.360119:0:30836:0:(osd_handler.c:1528:osd_obd_connect()) connect #2 00000020:00000080:3.0:1762166838.360126:0:30836:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf915a5bdf3c9cd5e 00000020:00000080:3.0:1762166838.360334:0:30836:0:(obd_config.c:761:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1762166838.360339:0:30836:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1762166838.360343:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1762166838.360345:0:30836:0:(obd_config.c:1477:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1762166838.360347:0:30836:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1762166838.360350:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1762166838.360351:0:30836:0:(obd_config.c:1477:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1762166838.360354:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1762166838.360367:0:30836:0:(genops.c:412:class_newdev()) Allocate new device lustre-MDT0000 (ffff9ee242b44a88) 00000020:00000080:3.0:1762166838.360377:0:30836:0:(obd_config.c:657:class_attach()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1762166838.360381:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1762166838.360382:0:30836:0:(obd_config.c:1430:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1762166838.360385:0:30836:0:(obd_config.c:1074:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1762166838.360390:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1762166838.360428:0:30836:0:(tgt_mount.c:154:server_get_mount()) get mount ffff9ee2455ce800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1762166838.360441:0:30836:0:(genops.c:412:class_newdev()) Allocate new device lustre-MDD0000 (ffff9ee347df8000) 00000020:00000080:3.0:1762166838.360449:0:30836:0:(obd_config.c:657:class_attach()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1762166838.360495:0:30836:0:(lod_dev.c:2266:lod_obd_connect()) connect #0 00000020:00000080:3.0:1762166838.360499:0:30836:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf915a5bdf3c9cd73 00000020:00000080:3.0:1762166838.360594:0:30836:0:(obd_config.c:761:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1762166838.360600:0:30836:0:(mdd_device.c:1570:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1762166838.360603:0:30836:0:(genops.c:1402:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf915a5bdf3c9cd7a 00080000:01000000:3.0:1762166838.360607:0:30836:0:(osd_handler.c:1528:osd_obd_connect()) connect #3 00000020:00000080:3.0:1762166838.360611:0:30836:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf915a5bdf3c9cd81 00010000:00010000:2.0:1762166838.400429:0:30836:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-3 is initialized 00000001:00080000:2.0:1762166838.401785:0:30836:0:(tgt_lastrcvd.c:1718:tgt_clients_data_init()) RCVRNG CLIENT uuid: da9d93ea-d728-4b01-a76b-4b4ff9c19538 idx: 1 lr: 0 srv lr: 4294968907 lx: 0 gen 4 00000001:00000004:2.0:1762166838.401834:0:30836:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294968907 00000001:00080000:2.0:1762166838.402487:0:30836:0:(tgt_lastrcvd.c:187:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1762166838.402573:0:30836:0:(tgt_lastrcvd.c:2242:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9ee3479d1840: xid 1847765444341632, transno 4294969111, client gen 4, slot idx 0 00000001:00080000:2.0:1762166838.402596:0:30836:0:(tgt_lastrcvd.c:2242:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9ee3479d13c0: xid 1847765444341248, transno 4294969110, client gen 4, slot idx 1 00000001:00080000:2.0:1762166838.402607:0:30836:0:(tgt_lastrcvd.c:2242:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9ee3479d1480: xid 1847765444339840, transno 4294969106, client gen 4, slot idx 2 00000001:00080000:2.0:1762166838.402618:0:30836:0:(tgt_lastrcvd.c:2242:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9ee3479d19c0: xid 1847765444261248, transno 4294968928, client gen 4, slot idx 3 00000020:00000080:2.0:1762166838.403080:0:30836:0:(genops.c:412:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ee347160000) 00000020:00000080:2.0:1762166838.403096:0:30836:0:(obd_config.c:657:class_attach()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1762166838.403156:0:30836:0:(osd_handler.c:1528:osd_obd_connect()) connect #4 00000020:00000080:2.0:1762166838.403162:0:30836:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf915a5bdf3c9cd96 00000020:00000080:3.0:1762166838.403715:0:30836:0:(obd_config.c:761:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1762166838.405348:0:30836:0:(genops.c:1402:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf915a5bdf3c9cd9d 00000020:00000080:2.0:1762166838.405743:0:30836:0:(obd_config.c:761:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1762166838.405754:0:30836:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1762166838.405813:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1762166838.405816:0:30836:0:(obd_config.c:1477:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1762166838.405821:0:30836:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1762166838.405825:0:30836:0:(obd_config.c:1797:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1762166838.405827:0:30836:0:(obd_config.c:1823:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1762166838.405828:0:30836:0:(obd_config.c:1823:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1762166838.405830:0:30836:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1762166838.405833:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1762166838.405835:0:30836:0:(obd_config.c:1477:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1762166838.405842:0:30836:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1762166838.405848:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1762166838.405850:0:30836:0:(obd_config.c:1477:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1762166838.405854:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1762166838.405895:0:30836:0:(mdt_lproc.c:315:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1762166838.405916:0:30836:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1762166838.405920:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1762166838.405922:0:30836:0:(obd_config.c:1477:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1762166838.405925:0:30836:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1762166838.405929:0:30836:0:(obd_mount.c:939:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1762166838.405932:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1762166838.405934:0:30836:0:(obd_config.c:1477:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1762166838.405937:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1762166838.405943:0:30836:0:(obd_config.c:1401:class_process_config()) adding mapping from uuid 192.168.203.135@tcp to nid 0x20000c0a8cb87 (192.168.203.135@tcp) 00000020:01000000:2.0:1762166838.405966:0:30836:0:(obd_config.c:1873:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1762166838.405968:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1762166838.405984:0:30836:0:(genops.c:412:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ee3471618d8) 00000020:00000080:2.0:1762166838.406000:0:30836:0:(obd_config.c:657:class_attach()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1762166838.406014:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1762166838.406086:0:30836:0:(osp_dev.c:1191:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1762166838.406091:0:30836:0:(osd_handler.c:1528:osd_obd_connect()) connect #5 00000020:00000080:2.0:1762166838.406098:0:30836:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf915a5bdf3c9cdab 00010000:00080000:2.0:1762166838.406141:0:30836:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ee37ecdc000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.135@tcp at head 00010000:00010000:2.0:1762166838.406349:0:30836:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1762166838.406820:0:30836:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1762166838.406880:0:30836:0:(llog_obd.c:195:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1762166838.409292:0:30836:0:(llog_cat.c:1211:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 0, last_idx 1 00000040:00080000:2.0:1762166838.409695:0:30836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1762166838.410080:0:30836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1762166838.410173:0:30836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1762166838.410648:0:30840:0:(llog.c:797:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:3.0:1762166838.410653:0:30840:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1762166838.411627:0:30836:0:(obd_config.c:761:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1762166838.411639:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1762166838.411670:0:30836:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1762166838.411688:0:30836:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf915a5bdf3c9cdb2 00000100:00080000:2.0:1762166838.411698:0:30836:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1762166838.411704:0:30836:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ee37ecdc000 using connection 192.168.203.135@tcp/0@lo 00000100:00100000:2.0:1762166838.411737:0:30836:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ee343718a80 x1847765451939328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1762166838.411797:0:30836:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1762166838.411893:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1847765451939584:0@lo:400:kworker.0 00000100:00100000:3.0:1762166838.411903:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765451939456:0@lo:400:kworker.0 00000100:00100000:0.0:1762166838.411947:0:3292:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1847765451939328:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1762166838.411961:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166838.412000:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1762166838.412006:0:30836:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1762166838.412012:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1762166838.412014:0:30836:0:(obd_config.c:1477:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1762166838.412020:0:30836:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1762166838.412023:0:30836:0:(obd_config.c:1797:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1762166838.412025:0:30836:0:(obd_config.c:1823:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1762166838.412027:0:30836:0:(obd_config.c:1823:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1762166838.412028:0:30836:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1762166838.412031:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1762166838.412034:0:30836:0:(obd_config.c:1477:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000100:00100000:2.0:1762166838.412034:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451939584 00000100:00100000:2.0:1762166838.412042:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451939584 00000020:01000000:3.0:1762166838.412049:0:30836:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1762166838.412054:0:30836:0:(obd_mount.c:939:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1762166838.412059:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1762166838.412061:0:30836:0:(obd_config.c:1477:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1762166838.412064:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1762166838.412068:0:30836:0:(obd_config.c:1401:class_process_config()) adding mapping from uuid 192.168.203.135@tcp to nid 0x20000c0a8cb87 (192.168.203.135@tcp) 00000100:00100000:2.0:1762166838.412093:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:01000000:3.0:1762166838.412114:0:30836:0:(obd_config.c:1873:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1762166838.412119:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1762166838.412132:0:30836:0:(genops.c:412:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ee347dfca88) 00000020:00000080:3.0:1762166838.412147:0:30836:0:(obd_config.c:657:class_attach()) OBD: dev 13 attached type osp with refcount 2 00000100:00100000:2.0:1762166838.412152:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3294:x1847765451939584:12345-0@lo:400:kworker.0 00000020:00000080:3.0:1762166838.412153:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf003 00000020:00080000:2.0:1762166838.412165:0:30819:0:(tgt_handler.c:788:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1762166838.412207:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3294:x1847765451939584:12345-0@lo:400:kworker.0 Request processed in 105us (246us total) trans 0 rc -107/-107 00000100:00100000:2.0:1762166838.412215:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1762166838.412216:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451939328 00000100:00100000:0.0:1762166838.412228:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451939328 00000004:00080000:3.0:1762166838.412239:0:30836:0:(osp_dev.c:1191:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1762166838.412246:0:30836:0:(osd_handler.c:1528:osd_obd_connect()) connect #6 00000020:00000080:3.0:1762166838.412254:0:30836:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf915a5bdf3c9cdc0 00000100:00080000:2.0:1762166838.412258:0:3294:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1762166838.412263:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9ee37f4c7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1762166838.412268:0:3294:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1762166838.412272:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:0.0:1762166838.412283:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3292:x1847765451939328:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1762166838.412299:0:30836:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ee242a12000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.135@tcp at head 00010000:00080000:0.0:1762166838.412306:0:26444:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:0.0:1762166838.412332:0:26444:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf915a5bdf3c9cdc7 00002000:00100000:0.0:1762166838.412345:0:26444:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ee347d65000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2103b32 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1762166838.412350:0:26444:0:(ofd_obd.c:142:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1762166838.412353:0:26444:0:(ofd_obd.c:230:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:0.0:1762166838.412503:0:26444:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee247a17800 00002000:00080000:0.0:1762166838.412518:0:26444:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1762166838.412539:0:26444:0:(import.c:65:import_set_state_nolock()) ffff9ee347d66800 : changing import state from RECOVER to FULL 00010000:00010000:3.0:1762166838.412562:0:30836:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-4 is initialized 00000100:00100000:0.0:1762166838.412608:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3292:x1847765451939328:12345-0@lo:8:llog_process_th.0 Request processed in 326us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166838.412617:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:0.0:1762166838.412654:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166838.412675:0:3292:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1762166838.412692:0:3292:0:(import.c:1123:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 5 00000100:00080000:1.0:1762166838.412704:0:3292:0:(import.c:951:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1762166838.412711:0:3292:0:(import.c:1204:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1762166838.412715:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9ee37ecdc000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1762166838.412737:0:3292:0:(osp_dev.c:1635:osp_import_event()) got connected 00000040:01000000:3.0:1762166838.412738:0:30836:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1762166838.412747:0:3292:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1847765451939328:0@lo:8:llog_process_th.0 00000040:01000000:3.0:1762166838.412814:0:30836:0:(llog_obd.c:195:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1762166838.412840:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451939712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762166838.412876:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166838.412944:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451939712 00000100:00100000:1.0:1762166838.412955:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451939712 00000100:00100000:0.0:1762166838.412981:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451939456 00000100:00100000:0.0:1762166838.412988:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451939456 00000100:00100000:0.0:1762166838.413033:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1762166838.413039:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166838.413039:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1762166838.413048:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3293:x1847765451939456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166838.413061:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765451939712:12345-0@lo:13:osp-pre-0-0.0 00000020:00080000:0.0:1762166838.413062:0:30819:0:(tgt_handler.c:788:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00002000:00000024:1.0:1762166838.413103:0:8383:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3856662528 avail 3854565376 00000100:00100000:0.0:1762166838.413128:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3293:x1847765451939456:12345-0@lo:400:kworker.0 Request processed in 82us (472us total) trans 0 rc -107/-107 00000100:00100000:0.0:1762166838.413138:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1762166838.413199:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765451939712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166838.413222:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451939712:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1762166838.413245:0:3293:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1762166838.413249:0:3293:0:(import.c:65:import_set_state_nolock()) ffff9ee36f1fd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1762166838.413255:0:3293:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1762166838.413258:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1762166838.413266:0:3293:0:(import.c:65:import_set_state_nolock()) ffff9ee36f1fd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1762166838.413275:0:3293:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 315 00000100:00080000:3.0:1762166838.413283:0:3293:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ee36f1fd800 using connection 192.168.203.135@tcp/0@lo 00000100:00100000:3.0:1762166838.413373:0:3293:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ee36e2bce00 x1847765451939840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1762166838.413400:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765451939456:0@lo:400:kworker.0 00000100:00100000:0.0:1762166838.413443:0:3292:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1847765451939840:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1762166838.413496:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166838.413505:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451939968:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166838.413562:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166838.413564:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451939840 00000100:00100000:0.0:1762166838.413571:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451939840 00000100:00100000:0.0:1762166838.413603:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1762166838.413612:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451939968 00000100:00100000:0.0:1762166838.413613:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3292:x1847765451939840:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1762166838.413619:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451939968 00000100:00100000:0.0:1762166838.413679:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3292:x1847765451939840:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 64us (182us total) trans 0 rc -11/-11 00000100:00100000:3.0:1762166838.413680:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:0.0:1762166838.413691:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1762166838.413694:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765451939968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1762166838.413720:0:26444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:100 count 1 00000100:00080000:0.0:1762166838.413739:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9ee36f1fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1762166838.413749:0:3292:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1762166838.413756:0:3292:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1847765451939840:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1762166838.413808:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451940096:0@lo:6:osp-syn-0-0.0 00000040:00080000:0.0:1762166838.413843:0:30840:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 135 count 3 00000100:00100000:1.0:1762166838.413856:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1762166838.413904:0:30840:0:(llog.c:797:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1762166838.413910:0:30840:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1762166838.413912:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765451939968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 220us (358us total) trans 0 rc -2/-2 00000100:00100000:1.0:1762166838.413917:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451940096 00000100:00100000:3.0:1762166838.413926:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000100:00100000:1.0:1762166838.413926:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451940096 00000100:00100000:3.0:1762166838.413961:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000004:00080000:0.0:1762166838.413968:0:30840:0:(osp_sync.c:973:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1762166838.413973:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765451940096:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1762166838.413998:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee35047ca80, transno 0 00000004:00080000:1.0:1762166838.414005:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee35047ca80/1, rc -2, transno 0 00000100:00100000:1.0:1762166838.414017:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451939968:0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1762166838.414019:0:26444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:101 count 1 00000004:00080000:0.0:1762166838.414079:0:30840:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 459206315529ns, next at 0ns, rc = 0 00000040:00080000:1.0:1762166838.414131:0:30836:0:(llog_cat.c:1211:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1762166838.414210:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765451940096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 239us (356us total) trans 0 rc -2/-2 00000100:00100000:3.0:1762166838.414220:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000004:00080000:1.0:1762166838.414227:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee35047f100, transno 0 00000004:00080000:1.0:1762166838.414234:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee35047f100/1, rc -2, transno 0 00000100:00100000:1.0:1762166838.414255:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451940096:0@lo:6:osp-syn-0-0.0 00000040:00080000:0.0:1762166838.414529:0:30840:0:(llog_cat.c:1211:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 1, last_idx 2 00000040:00080000:0.0:1762166838.414579:0:30840:0:(llog_cat.c:1254:llog_cat_cleanup()) cancel plain log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1762166838.415362:0:30836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1762166838.415790:0:30836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1762166838.415878:0:30836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1762166838.416378:0:30842:0:(llog.c:797:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:3.0:1762166838.416384:0:30842:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1762166838.420382:0:30836:0:(obd_config.c:761:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1762166838.420402:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1762166838.420448:0:30836:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1762166838.420478:0:30836:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf915a5bdf3c9cdce 00000100:00080000:0.0:1762166838.420496:0:30836:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1762166838.420503:0:30836:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ee242a12000 using connection 192.168.203.135@tcp/0@lo 00000100:00100000:0.0:1762166838.420542:0:30836:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ee36dce6300 x1847765451940224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1762166838.420598:0:30836:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1762166838.420658:0:3292:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1847765451940224:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1762166838.420723:0:30836:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1762166838.420731:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1762166838.420733:0:30836:0:(obd_config.c:1477:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1762166838.420739:0:30836:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1762166838.420744:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1762166838.420747:0:30836:0:(obd_config.c:1477:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1762166838.420755:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1762166838.420791:0:30836:0:(obd_config.c:1451:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1762166838.420799:0:30836:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1762166838.420803:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1762166838.420805:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1762166838.420806:0:30836:0:(obd_config.c:1477:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1762166838.420816:0:30836:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1762166838.420821:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1762166838.420823:0:30836:0:(obd_config.c:1477:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1762166838.420832:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1762166838.420876:0:30836:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f1807908-b95d-4027-b65a-753b7d69e554:30836:1847765451940352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1762166838.420883:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451940224 00000100:00100000:3.0:1762166838.420895:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451940224 00000100:00100000:3.0:1762166838.420946:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:3.0:1762166838.420956:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3292:x1847765451940224:12345-0@lo:8:llog_process_th.0 00000100:00100000:0.0:1762166838.420967:0:30836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166838.421003:0:30836:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242cd90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166838.421005:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451940352 00000100:00100000:1.0:1762166838.421013:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451940352 00000100:00100000:1.0:1762166838.421058:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1762166838.421073:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+7:30836:x1847765451940352:12345-0@lo:502:llog_process_th.0 00010000:00080000:3.0:1762166838.421105:0:26444:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:3.0:1762166838.421147:0:26444:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf915a5bdf3c9cdd5 00002000:00100000:3.0:1762166838.421165:0:26444:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ee242a14000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2103b32 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1762166838.421171:0:26444:0:(ofd_obd.c:142:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1762166838.421175:0:26444:0:(ofd_obd.c:230:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:3.0:1762166838.421319:0:26444:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee36f323700 00002000:00080000:3.0:1762166838.421334:0:26444:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1762166838.421369:0:26444:0:(import.c:65:import_set_state_nolock()) ffff9ee242a16800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1762166838.421443:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3292:x1847765451940224:12345-0@lo:8:llog_process_th.0 Request processed in 486us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.421450:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+7:30836:x1847765451940352:12345-0@lo:502:llog_process_th.0 Request processed in 382us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.421457:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:1.0:1762166838.421474:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1762166838.421512:0:3292:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1762166838.421523:0:3292:0:(import.c:1123:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 4 00000100:00100000:1.0:1762166838.421532:0:30836:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f1807908-b95d-4027-b65a-753b7d69e554:30836:1847765451940352:0@lo:502:llog_process_th.0 00000100:00080000:3.0:1762166838.421533:0:3292:0:(import.c:951:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1762166838.421542:0:3292:0:(import.c:1204:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1762166838.421545:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9ee242a12000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1762166838.421568:0:3292:0:(osp_dev.c:1635:osp_import_event()) got connected 00000100:00100000:3.0:1762166838.421578:0:3292:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1847765451940224:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1762166838.421599:0:30836:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1762166838.421606:0:30836:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1762166838.421609:0:30836:0:(obd_config.c:1477:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1762166838.421617:0:30836:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00080000:2.0:1762166838.421648:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9ee37f4c7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1762166838.421657:0:3294:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 330 00000100:00080000:2.0:1762166838.421665:0:3294:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ee37f4c7000 using connection 192.168.203.135@tcp/0@lo 00000020:01000000:2.0:1762166838.422020:0:30810:0:(obd_config.c:2039:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1762166838.422066:0:30810:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.203.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1762166838.422099:0:30810:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee244473e00/0xf915a5bdf3c9cd49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9cd50 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.422112:0:30810:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.135@tcp lock: ffff9ee244473e00/0xf915a5bdf3c9cd49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9cd50 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166838.422120:0:30810:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-mdtir-ffff9ee2455ce800 from 1 10000000:01000000:2.0:1762166838.422123:0:30810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1762166838.422158:0:30810:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15a00/0xf915a5bdf3c9cddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.422168:0:30810:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15a00/0xf915a5bdf3c9cddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166838.422177:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1762166838.422180:0:30810:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15a00/0xf915a5bdf3c9cddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166838.422194:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451940480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1762166838.422209:0:30810:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451940608:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1762166838.422252:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166838.422276:0:30810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166838.422313:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451940480 00000100:00100000:1.0:1762166838.422321:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451940480 00000100:00100000:2.0:1762166838.422322:0:30810:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243359180 going to sleep for 11 seconds 00000100:00080000:3.0:1762166838.422364:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166838.422374:0:30814:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451940608 00000100:00100000:1.0:1762166838.422393:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1762166838.422394:0:30814:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451940608 00000100:00100000:1.0:1762166838.422407:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765451940480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1762166838.422440:0:8383:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 57737216 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1762166838.422464:0:30814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1762166838.422476:0:30814:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1807908-b95d-4027-b65a-753b7d69e554+7:30810:x1847765451940608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1762166838.422490:0:30814:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.422512:0:30814:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee36dc14200/0xf915a5bdf3c9cde3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf915a5bdf3c9cddc expref: -99 pid: 30814 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166838.422519:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765451940480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (266us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166838.422543:0:30814:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee36dc14200/0xf915a5bdf3c9cde3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf915a5bdf3c9cddc expref: 8 pid: 30814 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166838.422545:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00010000:00010000:2.0:1762166838.422574:0:30814:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee36dc14200/0xf915a5bdf3c9cde3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf915a5bdf3c9cddc expref: 8 pid: 30814 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.422586:0:30814:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14200, rc 0) 00000100:00100000:1.0:1762166838.422623:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451940480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166838.422631:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451940736:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166838.422656:0:30814:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1807908-b95d-4027-b65a-753b7d69e554+8:30810:x1847765451940608:12345-0@lo:101:mount.lustre.0 Request processed in 177us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.422664:0:30814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1762166838.422675:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166838.422716:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451940736 00000100:00100000:3.0:1762166838.422719:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1762166838.422723:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451940736 00000100:00100000:3.0:1762166838.422731:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451940864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166838.422744:0:30810:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451940608:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1762166838.422799:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166838.422810:0:30810:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15a00/0xf915a5bdf3c9cddc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9cde3 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.422825:0:30810:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15a00/0xf915a5bdf3c9cddc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c9cde3 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166838.422858:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451940864 00000100:00100000:3.0:1762166838.422865:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451940864 00000100:00100000:1.0:1762166838.422887:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:3.0:1762166838.422897:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:1.0:1762166838.422899:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765451940736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166838.422910:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765451940864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166838.423054:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765451940864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 146us (254us total) trans 0 rc -2/-2 00000100:00100000:1.0:1762166838.423061:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765451940736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 164us (385us total) trans 0 rc -2/-2 00000100:00100000:3.0:1762166838.423067:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:1.0:1762166838.423076:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000004:00080000:3.0:1762166838.423110:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e2bdf80, transno 0 00000004:00080000:3.0:1762166838.423114:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e2bdf80/1, rc -2, transno 0 00000100:00100000:3.0:1762166838.423133:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451940864:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762166838.423149:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e2bea00, transno 0 00000004:00080000:3.0:1762166838.423152:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e2bea00/1, rc -2, transno 0 00000100:00100000:3.0:1762166838.423158:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451940736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166838.423416:0:3294:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ee36dce5f80 x1847765451940992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1762166838.423457:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1847765451939584:0@lo:400:kworker.0 00000100:00100000:3.0:1762166838.423475:0:3292:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1847765451940992:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1762166838.423483:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1762166838.423494:0:30810:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451941120:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1762166838.423499:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451941248:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166838.423513:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166838.423582:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451940992 00000100:00100000:2.0:1762166838.423589:0:30810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166838.423590:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451940992 00000100:00100000:0.0:1762166838.423590:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166838.423644:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1762166838.423655:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3292:x1847765451940992:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1762166838.423662:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451941248 00000100:00100000:2.0:1762166838.423665:0:30810:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243359180 going to sleep for 11 seconds 00000100:00100000:0.0:1762166838.423669:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451941248 00000040:00080000:1.0:1762166838.423681:0:30842:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 131 count 3 00000100:00100000:2.0:1762166838.423696:0:30814:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451941120 00000100:00100000:2.0:1762166838.423703:0:30814:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451941120 00000100:00100000:3.0:1762166838.423739:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3292:x1847765451940992:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 76us (218us total) trans 0 rc -11/-11 00000100:00100000:0.0:1762166838.423739:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000040:00080000:1.0:1762166838.423741:0:30842:0:(llog.c:797:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000100:00100000:2.0:1762166838.423751:0:30814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000040:00080000:1.0:1762166838.423751:0:30842:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1762166838.423827:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1762166838.423832:0:30814:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1807908-b95d-4027-b65a-753b7d69e554+8:30810:x1847765451941120:12345-0@lo:256:mount.lustre.0 00000100:00100000:0.0:1762166838.423841:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765451941248:12345-0@lo:6:osp-syn-1-0.0 20000000:01000000:2.0:1762166838.423857:0:30814:0:(mgs_nids.c:896:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 00002000:00080000:0.0:1762166838.423868:0:7858:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:94 count 1 20000000:01000000:2.0:1762166838.423870:0:30814:0:(mgs_nids.c:315:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00080000:3.0:1762166838.423895:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9ee37f4c7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000004:00080000:1.0:1762166838.423901:0:30842:0:(osp_sync.c:973:osp_sync_process_record()) processed all old entries 00000100:00080000:3.0:1762166838.423905:0:3292:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1762166838.423914:0:3292:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1847765451940992:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1762166838.423991:0:30814:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1807908-b95d-4027-b65a-753b7d69e554+8:30810:x1847765451941120:12345-0@lo:256:mount.lustre.0 Request processed in 161us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.424001:0:30814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1762166838.424083:0:30810:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451941120:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1762166838.424091:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765451941248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 335us (507us total) trans 0 rc -2/-2 00000100:00100000:0.0:1762166838.424104:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000004:00080000:1.0:1762166838.424160:0:30842:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 459216396018ns, next at 0ns, rc = 0 00000100:00100000:1.0:1762166838.424228:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:0.0:1762166838.424233:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee35047ea00, transno 0 00000004:00080000:0.0:1762166838.424243:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee35047ea00/1, rc -2, transno 0 00000100:00100000:1.0:1762166838.424246:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451941376:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762166838.424266:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451941248:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166838.424298:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166838.424547:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451941376 00000100:00100000:0.0:1762166838.424569:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451941376 10000000:01000000:2.0:1762166838.424832:0:30810:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.203.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00100000:0.0:1762166838.424841:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00010000:00010000:2.0:1762166838.424855:0:30810:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15a00/0xf915a5bdf3c9cddc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9cde3 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166838.424855:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765451941376:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1762166838.424869:0:30810:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15a00/0xf915a5bdf3c9cddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9cde3 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1762166838.424873:0:26444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:95 count 1 10000000:01000000:2.0:1762166838.424878:0:30810:0:(mgc_request.c:1812:mgc_process_log()) Process log params-ffff9ee2455ce800 from 1 10000000:01000000:2.0:1762166838.424883:0:30810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1762166838.424914:0:30810:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15800/0xf915a5bdf3c9cdea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.424922:0:30810:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15800/0xf915a5bdf3c9cdea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.424930:0:30810:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15800/0xf915a5bdf3c9cdea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166838.424948:0:30810:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451941504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1762166838.424998:0:30810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166838.425043:0:30810:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243359180 going to sleep for 11 seconds 00000100:00100000:0.0:1762166838.425060:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765451941376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 209us (762us total) trans 0 rc -2/-2 00000100:00100000:0.0:1762166838.425069:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:2.0:1762166838.425087:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451941504 00000100:00100000:2.0:1762166838.425092:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451941504 00000004:00080000:0.0:1762166838.425121:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee35047ce00, transno 0 00000004:00080000:0.0:1762166838.425127:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee35047ce00/1, rc -2, transno 0 00000100:00100000:2.0:1762166838.425131:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1762166838.425136:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451941376:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762166838.425143:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+8:30810:x1847765451941504:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1762166838.425154:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.425165:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee36dc14000/0xf915a5bdf3c9cdf1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf915a5bdf3c9cdea expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.425184:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee36dc14000/0xf915a5bdf3c9cdf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf915a5bdf3c9cdea expref: 9 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.425192:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee36dc14000/0xf915a5bdf3c9cdf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf915a5bdf3c9cdea expref: 9 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.425199:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14000, rc 0) 00000100:00100000:2.0:1762166838.425231:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+9:30810:x1847765451941504:12345-0@lo:101:mount.lustre.0 Request processed in 91us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.425236:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1762166838.425276:0:30810:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451941504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1762166838.425289:0:30810:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15800/0xf915a5bdf3c9cdea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9cdf1 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.425297:0:30810:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15800/0xf915a5bdf3c9cdea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c9cdf1 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166838.425349:0:30810:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451941632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1762166838.425380:0:30810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166838.425393:0:30810:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243359180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166838.425409:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451941632 00000100:00100000:2.0:1762166838.425420:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451941632 00000100:00100000:2.0:1762166838.425455:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1762166838.425465:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+9:30810:x1847765451941632:12345-0@lo:501:mount.lustre.0 00000040:00080000:0.0:1762166838.425484:0:30842:0:(llog_cat.c:1211:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 1, last_idx 2 00000040:00080000:0.0:1762166838.425537:0:30842:0:(llog_cat.c:1254:llog_cat_cleanup()) cancel plain log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1762166838.425643:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+9:30810:x1847765451941632:12345-0@lo:501:mount.lustre.0 Request processed in 181us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.425650:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1762166838.425684:0:30810:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451941632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1762166838.425738:0:30810:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451941760:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1762166838.425812:0:30810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166838.425845:0:30810:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166838.425898:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451941760 00000100:00100000:3.0:1762166838.425903:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451941760 00000100:00100000:3.0:1762166838.425936:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1762166838.425943:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+9:30810:x1847765451941760:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1762166838.426109:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+9:30810:x1847765451941760:12345-0@lo:503:mount.lustre.0 Request processed in 165us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.426117:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1762166838.426136:0:30810:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451941760:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1762166838.426910:0:30844:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f1807908-b95d-4027-b65a-753b7d69e554:30844:1847765451941888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1762166838.426955:0:30844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166838.426988:0:30844:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243359f00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166838.427068:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451941888 00000100:00100000:3.0:1762166838.427073:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451941888 00000100:00100000:3.0:1762166838.427119:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1762166838.427139:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+9:30844:x1847765451941888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1762166838.427874:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+9:30844:x1847765451941888:12345-0@lo:502:llog_process_th.0 Request processed in 737us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.427882:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1762166838.427933:0:30844:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f1807908-b95d-4027-b65a-753b7d69e554:30844:1847765451941888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1762166838.427955:0:30844:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1762166838.427964:0:30844:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1762166838.427966:0:30844:0:(obd_config.c:1477:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1762166838.427974:0:30844:0:(obd_config.c:1903:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ee2455ce800 00000020:00000080:2.0:1762166838.427977:0:30844:0:(obd_config.c:1389:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1762166838.427986:0:30844:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1762166838.427989:0:30844:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1762166838.427991:0:30844:0:(obd_config.c:1477:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1762166838.427994:0:30844:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1762166838.427997:0:30844:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1762166838.427998:0:30844:0:(obd_config.c:1477:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1762166838.428002:0:30844:0:(obd_config.c:1903:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ee2455ce800 00000020:00000080:2.0:1762166838.428005:0:30844:0:(obd_config.c:1389:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1762166838.428091:0:30844:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f1807908-b95d-4027-b65a-753b7d69e554:30844:1847765451942016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1762166838.428130:0:30844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166838.428180:0:30844:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243359f00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166838.428245:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451942016 00000100:00100000:0.0:1762166838.428250:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451942016 00000100:00100000:0.0:1762166838.428296:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1762166838.428306:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+9:30844:x1847765451942016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1762166838.428523:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+9:30844:x1847765451942016:12345-0@lo:502:llog_process_th.0 Request processed in 219us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166838.428531:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1762166838.428625:0:30844:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f1807908-b95d-4027-b65a-753b7d69e554:30844:1847765451942016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1762166838.428648:0:30844:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1762166838.428654:0:30844:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1762166838.428656:0:30844:0:(obd_config.c:1477:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1762166838.428659:0:30844:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1762166838.428716:0:30810:0:(obd_config.c:2039:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1762166838.428737:0:30810:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.203.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1762166838.428787:0:30810:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15800/0xf915a5bdf3c9cdea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9cdf1 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.428798:0:30810:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15800/0xf915a5bdf3c9cdea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9cdf1 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166838.428851:0:30810:0:(mgc_request.c:1952:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1762166838.428854:0:30810:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ee2455ce800 10000000:01000000:2.0:1762166838.428857:0:30810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ee2455ce800 10000000:01000000:2.0:1762166838.428862:0:30810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1762166838.428868:0:30810:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-client-ffff9ee2455ce800 from 1 10000000:01000000:2.0:1762166838.428871:0:30810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1762166838.428894:0:30810:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15400/0xf915a5bdf3c9cdf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.428902:0:30810:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15400/0xf915a5bdf3c9cdf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.428911:0:30810:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15400/0xf915a5bdf3c9cdf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166838.428930:0:30810:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451942144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1762166838.428962:0:30810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166838.428996:0:30810:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243359b40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166838.429012:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451942144 00000100:00100000:2.0:1762166838.429016:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451942144 00000100:00100000:2.0:1762166838.429043:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1762166838.429051:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+9:30810:x1847765451942144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1762166838.429060:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.429072:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee36dc14400/0xf915a5bdf3c9cdff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf915a5bdf3c9cdf8 expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.429094:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee36dc14400/0xf915a5bdf3c9cdff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf915a5bdf3c9cdf8 expref: 10 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.429104:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee36dc14400/0xf915a5bdf3c9cdff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf915a5bdf3c9cdf8 expref: 10 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.429111:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14400, rc 0) 00000100:00100000:2.0:1762166838.429141:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+10:30810:x1847765451942144:12345-0@lo:101:mount.lustre.0 Request processed in 93us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.429148:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1762166838.429192:0:30810:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451942144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1762166838.429204:0:30810:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15400/0xf915a5bdf3c9cdf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9cdff expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.429213:0:30810:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15400/0xf915a5bdf3c9cdf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c9cdff expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166838.429264:0:30810:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451942272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1762166838.429297:0:30810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166838.429313:0:30810:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243359b40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166838.429334:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451942272 00000100:00100000:2.0:1762166838.429338:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451942272 00000100:00100000:2.0:1762166838.429379:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1762166838.429388:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+10:30810:x1847765451942272:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1762166838.429482:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+10:30810:x1847765451942272:12345-0@lo:501:mount.lustre.0 Request processed in 96us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.429490:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1762166838.429521:0:30810:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451942272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1762166838.429548:0:30810:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451942400:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1762166838.429600:0:30810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166838.429615:0:30810:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243359b40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166838.429630:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451942400 00000100:00100000:2.0:1762166838.429633:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451942400 00000100:00100000:2.0:1762166838.429671:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1762166838.429679:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+10:30810:x1847765451942400:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1762166838.429921:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+10:30810:x1847765451942400:12345-0@lo:503:mount.lustre.0 Request processed in 241us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.429929:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1762166838.430535:0:30810:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451942400:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1762166838.432097:0:30846:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f1807908-b95d-4027-b65a-753b7d69e554:30846:1847765451942528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1762166838.432211:0:30846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166838.432283:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451942528 00000100:00100000:2.0:1762166838.432290:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451942528 00000100:00100000:1.0:1762166838.432293:0:30846:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72540 going to sleep for 11 seconds 00000100:00100000:2.0:1762166838.432342:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1762166838.432353:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+10:30846:x1847765451942528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1762166838.432681:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+10:30846:x1847765451942528:12345-0@lo:502:llog_process_th.0 Request processed in 329us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.432699:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1762166838.432841:0:30846:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f1807908-b95d-4027-b65a-753b7d69e554:30846:1847765451942528:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1762166838.432970:0:30846:0:(obd_mount.c:184:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1762166838.432979:0:30846:0:(obd_config.c:1389:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1762166838.433003:0:30846:0:(genops.c:412:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ee37ff3ca88) 00000020:00000080:1.0:1762166838.433035:0:30846:0:(obd_config.c:657:class_attach()) OBD: dev 17 attached type lwp with refcount 2 00000020:00000080:1.0:1762166838.433047:0:30846:0:(obd_config.c:1389:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1762166838.436242:0:30846:0:(tgt_mount.c:154:server_get_mount()) get mount ffff9ee2455ce800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1762166838.436257:0:30846:0:(tgt_mount.c:188:server_put_mount()) put mount ffff9ee2455ce800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1762166838.436261:0:30846:0:(obd_mount.c:705:lustre_put_lsi()) put ffff9ee2455ce800 4 00010000:00080000:1.0:1762166838.436347:0:30846:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ee37f4c6000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.135@tcp at head 00010000:00010000:1.0:1762166838.438928:0:30846:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-5 is initialized 00000020:00000080:1.0:1762166838.439106:0:30846:0:(obd_config.c:761:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1762166838.439179:0:30846:0:(lwp_dev.c:496:lwp_obd_connect()) connect #0 00000004:00080000:0.0:1762166838.439189:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:1.0:1762166838.439200:0:30846:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf915a5bdf3c9ce0d 00000100:00080000:1.0:1762166838.439217:0:30846:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1762166838.439226:0:30846:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ee37f4c6000 using connection 192.168.203.135@tcp/0@lo 00000100:00100000:1.0:1762166838.439280:0:30846:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ee35047d180 x1847765451942656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1762166838.439338:0:3292:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1847765451942656:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1762166838.439436:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166838.439566:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451942656 00000100:00100000:1.0:1762166838.439576:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451942656 00000100:00100000:1.0:1762166838.439630:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1762166838.439641:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3292:x1847765451942656:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1762166838.439711:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3292:x1847765451942656:12345-0@lo:38:llog_process_th.0 Request processed in 72us (280us total) trans 0 rc -11/-11 00000100:00100000:1.0:1762166838.439721:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1762166838.439827:0:3292:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1762166838.439838:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9ee37f4c6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1762166838.439862:0:3292:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1762166838.439868:0:3292:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1847765451942656:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1762166838.439937:0:30846:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1762166838.441143:0:30846:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f1807908-b95d-4027-b65a-753b7d69e554:30846:1847765451942784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1762166838.441229:0:30846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166838.441291:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451942784 00000100:00100000:1.0:1762166838.441298:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451942784 00000100:00100000:1.0:1762166838.441370:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1762166838.441387:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+10:30846:x1847765451942784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1762166838.442131:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+10:30846:x1847765451942784:12345-0@lo:502:llog_process_th.0 Request processed in 745us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.442146:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1762166838.442306:0:30846:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166838.442348:0:30846:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f1807908-b95d-4027-b65a-753b7d69e554:30846:1847765451942784:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1762166838.442398:0:30846:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1762166838.442510:0:30810:0:(obd_config.c:2039:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1762166838.442561:0:30810:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.203.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1762166838.442589:0:30810:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15400/0xf915a5bdf3c9cdf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9cdff expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.442603:0:30810:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15400/0xf915a5bdf3c9cdf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9cdff expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00000020:01000004:1.0:1762166838.442677:0:30810:0:(tgt_mount.c:1147:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1762166838.442680:0:30810:0:(tgt_mount.c:1148:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1762166838.442690:0:30810:0:(tgt_mount.c:1149:server_mti_print()) fs: lustre 00000020:01000004:1.0:1762166838.442693:0:30810:0:(tgt_mount.c:1150:server_mti_print()) uuid: 00000020:01000004:1.0:1762166838.442695:0:30810:0:(tgt_mount.c:1151:server_mti_print()) ver: 0 00000020:01000004:1.0:1762166838.442698:0:30810:0:(tgt_mount.c:1152:server_mti_print()) flags: 00000020:01000004:1.0:1762166838.442701:0:30810:0:(tgt_mount.c:1154:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1762166838.442704:0:30810:0:(tgt_mount.c:1158:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1762166838.442706:0:30810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1762166838.442708:0:30810:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1762166838.442714:0:30810:0:(mgc_request_server.c:415:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1762166838.442718:0:30810:0:(tgt_mount.c:1147:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1762166838.442719:0:30810:0:(tgt_mount.c:1148:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1762166838.442721:0:30810:0:(tgt_mount.c:1149:server_mti_print()) fs: lustre 00000020:01000004:1.0:1762166838.442723:0:30810:0:(tgt_mount.c:1150:server_mti_print()) uuid: 00000020:01000004:1.0:1762166838.442725:0:30810:0:(tgt_mount.c:1151:server_mti_print()) ver: 0 00000020:01000004:1.0:1762166838.442727:0:30810:0:(tgt_mount.c:1152:server_mti_print()) flags: 00000020:01000004:1.0:1762166838.442729:0:30810:0:(tgt_mount.c:1154:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1762166838.442731:0:30810:0:(tgt_mount.c:1158:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1762166838.442733:0:30810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1762166838.442736:0:30810:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1762166838.442810:0:30810:0:(mgc_request_server.c:276:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1762166838.442830:0:30810:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451942912:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1762166838.442885:0:30810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166838.442912:0:30810:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166838.443452:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451942912 00000100:00100000:1.0:1762166838.443461:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451942912 00000100:00100000:1.0:1762166838.443607:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1762166838.443625:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+10:30810:x1847765451942912:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1762166838.443676:0:30815:0:(mgs_handler.c:438:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1762166838.443696:0:30815:0:(mgs_nids.c:460:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000004:00080000:2.0:1762166838.451548:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 20000000:01000000:3.0:1762166838.463280:0:30815:0:(mgs_nids.c:806:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1762166838.463303:0:30815:0:(mgs_handler.c:599:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1762166838.463333:0:30833:0:(mgs_nids.c:703:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1762166838.463345:0:30833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1762166838.463378:0:30833:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ee244472e00/0xf915a5bdf3c9ce14 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.463401:0:30833:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ee36dc14200/0xf915a5bdf3c9cde3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf915a5bdf3c9cddc expref: 10 pid: 30814 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.463428:0:30833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ee244472e00/0xf915a5bdf3c9ce14 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.463480:0:30833:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ee36dc14200/0xf915a5bdf3c9cde3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf915a5bdf3c9cddc expref: 10 pid: 30814 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.463503:0:30833:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ee36dc14200/0xf915a5bdf3c9cde3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf915a5bdf3c9cddc expref: 10 pid: 30814 timeout: 559 lvb_type: 0 00000100:00100000:1.0:1762166838.463522:0:30833:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:30833:1847765451943040:0@lo:104: 00000100:00100000:1.0:1762166838.463637:0:30833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166838.463690:0:30833:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34a004780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166838.463817:0:5739:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451943040 00000100:00100000:3.0:1762166838.463831:0:5739:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451943040 00000100:00100000:3.0:1762166838.463915:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1762166838.463931:0:5739:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f1807908-b95d-4027-b65a-753b7d69e554+3:30833:x1847765451943040:12345-0@lo:104: 00010000:00010000:3.0:1762166838.463949:0:5739:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15a00/0xf915a5bdf3c9cddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf915a5bdf3c9cde3 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.464053:0:5739:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1762166838.464060:0:5739:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f1807908-b95d-4027-b65a-753b7d69e554+3:30833:x1847765451943040:12345-0@lo:104: Request processed in 136us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.464069:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1762166838.464085:0:30833:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:30833:1847765451943040:0@lo:104: 00010000:00010000:0.0:1762166838.464086:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166838.464101:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15a00/0xf915a5bdf3c9cddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf915a5bdf3c9cde3 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.464113:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc15a00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1762166838.464118:0:5744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15a00/0xf915a5bdf3c9cddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf915a5bdf3c9cde3 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.464123:0:30833:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ee244472e00/0xf915a5bdf3c9ce14 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.464125:0:5744:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15a00/0xf915a5bdf3c9cddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf915a5bdf3c9cde3 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1762166838.464159:0:5744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15a00/0xf915a5bdf3c9cddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf915a5bdf3c9cde3 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166838.464165:0:5744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1762166838.464215:0:5744:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15a00/0xf915a5bdf3c9cddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf915a5bdf3c9cde3 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.464222:0:5744:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1762166838.464254:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15a00/0xf915a5bdf3c9cddc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf915a5bdf3c9cde3 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.464262:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15a00/0xf915a5bdf3c9cddc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf915a5bdf3c9cde3 expref: -99 pid: 30810 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166838.464273:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451943168:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1762166838.464294:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166838.464297:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166838.464300:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166838.464316:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166838.464358:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451943168 00000100:00100000:0.0:1762166838.464364:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451943168 00010000:00010000:0.0:1762166838.464391:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ee36dc14200/0xf915a5bdf3c9cde3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf915a5bdf3c9cddc expref: 11 pid: 30814 timeout: 559 lvb_type: 0 00000100:00100000:0.0:1762166838.464443:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:0.0:1762166838.464450:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1807908-b95d-4027-b65a-753b7d69e554+11:3295:x1847765451943168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1762166838.464463:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166838.464469:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ee36dc14200/0xf915a5bdf3c9cde3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf915a5bdf3c9cddc expref: 11 pid: 30814 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1762166838.464484:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ee36dc14200/0xf915a5bdf3c9cde3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf915a5bdf3c9cddc expref: 11 pid: 30814 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1762166838.464502:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee36dc14200/0xf915a5bdf3c9cde3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf915a5bdf3c9cddc expref: 11 pid: 30814 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1762166838.464517:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ee244472e00/0xf915a5bdf3c9ce14 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 30833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.464526:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee244472e00/0xf915a5bdf3c9ce14 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 30833 timeout: 0 lvb_type: 0 20000000:01000000:0.0:1762166838.464542:0:5741:0:(mgs_nids.c:679:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001199228s 00010000:00010000:0.0:1762166838.464547:0:5741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ee244472e00/0xf915a5bdf3c9ce14 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.464567:0:5741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ee244472e00/0xf915a5bdf3c9ce14 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.464574:0:5741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ee244472e00/0xf915a5bdf3c9ce14 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.464581:0:5741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ee244472e00/0xf915a5bdf3c9ce14 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.464587:0:5741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244472e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166838.464599:0:5741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ee244472e00/0xf915a5bdf3c9ce14 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.464607:0:5741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ee244472e00/0xf915a5bdf3c9ce14 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.464633:0:5741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ee244472e00/0xf915a5bdf3c9ce14 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.464649:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166838.464663:0:30833:0:(ldlm_request.c:183:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ee244472e00/0xf915a5bdf3c9ce14 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.464675:0:30833:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ee244472e00/0xf915a5bdf3c9ce14 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.464683:0:30833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee244472e00/0xf915a5bdf3c9ce14 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30833 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166838.464708:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1807908-b95d-4027-b65a-753b7d69e554+10:3295:x1847765451943168:12345-0@lo:103:ldlm_bl.0 Request processed in 256us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166838.464720:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1762166838.464822:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451943168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1762166838.468066:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+9:30810:x1847765451942912:12345-0@lo:253:mount.lustre.0 Request processed in 24443us (25174us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.468077:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1762166838.468186:0:30810:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f1807908-b95d-4027-b65a-753b7d69e554:30810:1847765451942912:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1762166838.468202:0:30810:0:(mgc_request_server.c:297:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1762166838.468205:0:30810:0:(tgt_mount.c:1147:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1762166838.468207:0:30810:0:(tgt_mount.c:1148:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1762166838.468209:0:30810:0:(tgt_mount.c:1149:server_mti_print()) fs: lustre 00000020:01000004:1.0:1762166838.468210:0:30810:0:(tgt_mount.c:1150:server_mti_print()) uuid: 00000020:01000004:1.0:1762166838.468212:0:30810:0:(tgt_mount.c:1151:server_mti_print()) ver: 0 00000020:01000004:1.0:1762166838.468213:0:30810:0:(tgt_mount.c:1152:server_mti_print()) flags: 00000020:01000004:1.0:1762166838.468215:0:30810:0:(tgt_mount.c:1154:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1762166838.468216:0:30810:0:(tgt_mount.c:1158:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1762166838.468218:0:30810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1762166838.468219:0:30810:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1762166838.468235:0:30810:0:(tgt_mount.c:2557:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1762166838.471638:0:30810:0:(osd_index.c:2099:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1762166838.471699:0:30810:0:(osd_index.c:2099:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1762166838.471873:0:30810:0:(osd_index.c:2099:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1762166838.471926:0:30810:0:(osd_index.c:2099:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1762166838.472035:0:30810:0:(osd_index.c:2099:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1762166838.472086:0:30810:0:(osd_index.c:2099:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1762166838.472449:0:30810:0:(osd_index.c:2099:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1762166838.472502:0:30810:0:(osd_index.c:2099:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1762166838.472610:0:30810:0:(osd_index.c:2099:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1762166838.472706:0:30810:0:(osd_index.c:2099:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1762166838.472841:0:30810:0:(osd_index.c:2099:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1762166838.472920:0:30810:0:(osd_index.c:2099:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1762166838.483127:0:30810:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 37 00000040:01000000:2.0:1762166838.483388:0:30810:0:(llog_obd.c:195:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1762166838.483390:0:30853:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 37 00000020:00080000:1.0:1762166838.483395:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 37 00000040:01000000:2.0:1762166838.483605:0:30854:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1762166838.485131:0:30854:0:(llog_cat.c:1211:llog_cat_set_first_idx()) catlog [0x200000400:0x1:0x0] first idx 0, last_idx 1 00000040:00080000:3.0:1762166838.485432:0:30854:0:(llog.c:797:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1762166838.485443:0:30854:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x200000400:0x2:0x0] at index 1 of catalog [0x200000400:0x1:0x0] 00000040:01000000:2.0:1762166838.486171:0:30810:0:(llog_obd.c:195:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1762166838.486247:0:30810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1762166838.486615:0:30810:0:(mdd_device.c:556:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1762166838.486622:0:30810:0:(llog_obd.c:195:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1762166838.486665:0:30810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1762166838.486755:0:30854:0:(lod_dev.c:317:lod_process_recovery_updates()) lustre-MDT0000-mdtlov: process recovery updates [0x200000400:0x2:0x0].14 00000020:00080000:0.0:1762166838.486780:0:30854:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0000: insert record batchid = 37 transno = 0 mdt_index 0 00000040:00080000:0.0:1762166838.486789:0:30854:0:(llog.c:854:llog_process_thread()) stop processing plain [0x200000400:0x2:0x0] index 15 count 2 00000040:00080000:0.0:1762166838.486800:0:30854:0:(llog.c:854:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 2 count 2 00000004:00080000:0.0:1762166838.486829:0:30854:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1762166838.486832:0:30854:0:(lod_dev.c:544:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1762166838.487430:0:30810:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1762166838.487840:0:30810:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1762166838.487857:0:30810:0:(llog_obd.c:195:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1762166838.487912:0:30810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1762166838.488851:0:30810:0:(osd_index.c:2099:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00010000:00080000:2.0:1762166838.490155:0:30810:0:(ldlm_lib.c:3032:target_recovery_init()) RECOVERY: service lustre-MDT0000, 1 recoverable clients, last_transno 4294969111 00010000:00080000:2.0:1762166838.490597:0:30855:0:(ldlm_lib.c:2835:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 30855 00010000:00080000:2.0:1762166838.490611:0:30855:0:(ldlm_lib.c:2527:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:2.0:1762166838.490615:0:30855:0:(ldlm_lib.c:2527:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00000020:01000004:0.0:1762166838.490648:0:30810:0:(tgt_mount.c:299:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1762166838.490660:0:30810:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.135@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1762166838.490673:0:30810:0:(tgt_mount.c:2326:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1762166838.490684:0:30810:0:(super25.c:202:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1762166838.695945:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1762166839.336205:0:5753:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1762166839.336212:0:5753:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-mdtir-ffff9ee2455ce800 from 13 10000000:01000000:0.0:1762166839.336218:0:5753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1762166839.336259:0:5753:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee37f158400/0xf915a5bdf3c9ce1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.336269:0:5753:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.135@tcp lock: ffff9ee37f158400/0xf915a5bdf3c9ce1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.336293:0:5753:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.135@tcp lock: ffff9ee37f158400/0xf915a5bdf3c9ce1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166839.336316:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451943296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.336373:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166839.336433:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166839.336509:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451943296 00000100:00100000:3.0:1762166839.336516:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451943296 00000100:00100000:3.0:1762166839.336577:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1762166839.336586:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+9:5753:x1847765451943296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1762166839.336600:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166839.336612:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee2425f5e00/0xf915a5bdf3c9ce22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf915a5bdf3c9ce1b expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.336633:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee2425f5e00/0xf915a5bdf3c9ce22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf915a5bdf3c9ce1b expref: 10 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.336643:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee2425f5e00/0xf915a5bdf3c9ce22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf915a5bdf3c9ce1b expref: 10 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.336651:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2425f5e00, rc 0) 00000100:00100000:3.0:1762166839.336695:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+10:5753:x1847765451943296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166839.336702:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1762166839.336842:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451943296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1762166839.336866:0:5753:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.135@tcp lock: ffff9ee37f158400/0xf915a5bdf3c9ce1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce22 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.336875:0:5753:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.135@tcp lock: ffff9ee37f158400/0xf915a5bdf3c9ce1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c9ce22 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166839.336920:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451943424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.336948:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166839.336976:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166839.337015:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451943424 00000100:00100000:2.0:1762166839.337021:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451943424 00000100:00100000:2.0:1762166839.337058:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1762166839.337065:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+10:5753:x1847765451943424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1762166839.337088:0:30813:0:(mgs_nids.c:896:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1762166839.337103:0:30813:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1762166839.337106:0:30813:0:(mgs_nids.c:315:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1762166839.337195:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+10:5753:x1847765451943424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166839.337203:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1762166839.337209:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451943424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1762166839.337249:0:5753:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.203.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1762166839.337255:0:5753:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee37f158400/0xf915a5bdf3c9ce1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce22 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.337262:0:5753:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.135@tcp lock: ffff9ee37f158400/0xf915a5bdf3c9ce1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce22 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166839.337271:0:5753:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1762166839.337273:0:5753:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-client-ffff9ee373e88000 from 42 10000000:01000000:0.0:1762166839.337275:0:5753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1762166839.337294:0:5753:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee37f158600/0xf915a5bdf3c9ce29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.337301:0:5753:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.135@tcp lock: ffff9ee37f158600/0xf915a5bdf3c9ce29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.337309:0:5753:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.135@tcp lock: ffff9ee37f158600/0xf915a5bdf3c9ce29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166839.337321:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451943552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.337423:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166839.337445:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166839.337497:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451943552 00000100:00100000:2.0:1762166839.337501:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451943552 00000100:00100000:2.0:1762166839.337530:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1762166839.337536:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+10:5753:x1847765451943552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1762166839.337554:0:30813:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166839.337562:0:30813:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee36dc15e00/0xf915a5bdf3c9ce30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf915a5bdf3c9ce29 expref: -99 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.337576:0:30813:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee36dc15e00/0xf915a5bdf3c9ce30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf915a5bdf3c9ce29 expref: 11 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.337584:0:30813:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee36dc15e00/0xf915a5bdf3c9ce30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf915a5bdf3c9ce29 expref: 11 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.337592:0:30813:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15e00, rc 0) 00000100:00100000:2.0:1762166839.338298:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+11:5753:x1847765451943552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 760us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166839.338306:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1762166839.338332:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451943552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1762166839.338347:0:5753:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.135@tcp lock: ffff9ee37f158600/0xf915a5bdf3c9ce29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce30 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.338356:0:5753:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.135@tcp lock: ffff9ee37f158600/0xf915a5bdf3c9ce29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c9ce30 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166839.338406:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451943680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.338430:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166839.338457:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166839.338488:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451943680 00000100:00100000:2.0:1762166839.338494:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451943680 00000100:00100000:2.0:1762166839.338523:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1762166839.338529:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+11:5753:x1847765451943680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1762166839.338655:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+11:5753:x1847765451943680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166839.338670:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1762166839.338688:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451943680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.338717:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451943808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.338751:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166839.338792:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451943808 00000100:00100000:2.0:1762166839.338797:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451943808 00000100:00100000:0.0:1762166839.338804:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166839.338821:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1762166839.338828:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+11:5753:x1847765451943808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1762166839.338974:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+11:5753:x1847765451943808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166839.338987:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1762166839.339004:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451943808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1762166839.339709:0:30958:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 42 00000020:01000000:0.0:1762166839.339943:0:5753:0:(obd_config.c:2039:class_config_parse_llog()) Processed log lustre-client gen 42-41 (rc=0) 10000000:01000000:0.0:1762166839.339963:0:5753:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.203.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1762166839.339970:0:5753:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee37f158600/0xf915a5bdf3c9ce29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce30 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.339980:0:5753:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.135@tcp lock: ffff9ee37f158600/0xf915a5bdf3c9ce29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce30 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166839.339990:0:5753:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1762166839.339993:0:5753:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1762166839.339996:0:5753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1762166839.340015:0:5753:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee37f159000/0xf915a5bdf3c9ce37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.340023:0:5753:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.135@tcp lock: ffff9ee37f159000/0xf915a5bdf3c9ce37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.340032:0:5753:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.135@tcp lock: ffff9ee37f159000/0xf915a5bdf3c9ce37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166839.340046:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451943936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.340079:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166839.340108:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166839.340137:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451943936 00000100:00100000:2.0:1762166839.340143:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451943936 00000100:00100000:2.0:1762166839.340183:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1762166839.340190:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+11:5753:x1847765451943936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1762166839.340201:0:30813:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166839.340210:0:30813:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee36dc14600/0xf915a5bdf3c9ce3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf915a5bdf3c9ce37 expref: -99 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.340228:0:30813:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee36dc14600/0xf915a5bdf3c9ce3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf915a5bdf3c9ce37 expref: 12 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.340238:0:30813:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee36dc14600/0xf915a5bdf3c9ce3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf915a5bdf3c9ce37 expref: 12 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.340246:0:30813:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14600, rc 0) 00000100:00100000:2.0:1762166839.340287:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+12:5753:x1847765451943936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166839.340294:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1762166839.340326:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451943936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1762166839.340339:0:5753:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.135@tcp lock: ffff9ee37f159000/0xf915a5bdf3c9ce37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce3e expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.340348:0:5753:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.135@tcp lock: ffff9ee37f159000/0xf915a5bdf3c9ce37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c9ce3e expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166839.340384:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451944064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.340413:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166839.340441:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166839.340496:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451944064 00000100:00100000:2.0:1762166839.340500:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451944064 00000100:00100000:2.0:1762166839.340537:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1762166839.340560:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+12:5753:x1847765451944064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1762166839.340740:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+12:5753:x1847765451944064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166839.340748:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1762166839.340836:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451944064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.340859:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451944192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.340891:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166839.340918:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166839.340939:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451944192 00000100:00100000:2.0:1762166839.340943:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451944192 00000100:00100000:2.0:1762166839.340965:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1762166839.340969:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+12:5753:x1847765451944192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1762166839.343869:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+12:5753:x1847765451944192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2887us (2966us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166839.343886:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1762166839.343894:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451944192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1762166839.344453:0:30959:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:2.0:1762166839.344654:0:5753:0:(obd_config.c:2039:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1762166839.344672:0:5753:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.203.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1762166839.344681:0:5753:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee37f159000/0xf915a5bdf3c9ce37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce3e expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.344691:0:5753:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.135@tcp lock: ffff9ee37f159000/0xf915a5bdf3c9ce37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce3e expref: -99 pid: 5753 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166839.344700:0:5753:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1762166839.344702:0:5753:0:(mgc_request.c:1812:mgc_process_log()) Process log params-ffff9ee373e88000 from 7 10000000:01000000:2.0:1762166839.344705:0:5753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1762166839.344736:0:5753:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15200/0xf915a5bdf3c9ce45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.344744:0:5753:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15200/0xf915a5bdf3c9ce45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.344752:0:5753:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15200/0xf915a5bdf3c9ce45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166839.344808:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451944320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1762166839.344849:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166839.344885:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451944320 00000100:00100000:2.0:1762166839.344888:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166839.344892:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451944320 00000100:00100000:3.0:1762166839.344950:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1762166839.344959:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+12:5753:x1847765451944320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1762166839.344987:0:30813:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166839.344999:0:30813:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee2425f5200/0xf915a5bdf3c9ce4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf915a5bdf3c9ce45 expref: -99 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.345021:0:30813:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee2425f5200/0xf915a5bdf3c9ce4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf915a5bdf3c9ce45 expref: 13 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.345030:0:30813:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee2425f5200/0xf915a5bdf3c9ce4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf915a5bdf3c9ce45 expref: 13 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.345038:0:30813:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2425f5200, rc 0) 00000100:00100000:3.0:1762166839.345075:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+13:5753:x1847765451944320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166839.345081:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1762166839.345110:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451944320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1762166839.345124:0:5753:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15200/0xf915a5bdf3c9ce45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce4c expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.345133:0:5753:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15200/0xf915a5bdf3c9ce45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c9ce4c expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166839.345175:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451944448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1762166839.345199:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166839.345223:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166839.345276:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451944448 00000100:00100000:3.0:1762166839.345281:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451944448 00000100:00100000:3.0:1762166839.345312:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1762166839.345318:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+13:5753:x1847765451944448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1762166839.345414:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+13:5753:x1847765451944448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166839.345421:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1762166839.345434:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451944448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1762166839.345475:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451944576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1762166839.345519:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166839.345541:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166839.346363:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451944576 00000100:00100000:3.0:1762166839.346369:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451944576 00000100:00100000:3.0:1762166839.346405:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1762166839.346414:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+13:5753:x1847765451944576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1762166839.346595:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+13:5753:x1847765451944576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166839.346602:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1762166839.346647:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451944576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1762166839.347334:0:30960:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1762166839.347420:0:5753:0:(obd_config.c:2039:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1762166839.347445:0:5753:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.203.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1762166839.347454:0:5753:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15200/0xf915a5bdf3c9ce45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce4c expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.347464:0:5753:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.135@tcp lock: ffff9ee36dc15200/0xf915a5bdf3c9ce45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce4c expref: -99 pid: 5753 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166839.347474:0:5753:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1762166839.347477:0:5753:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-client-ffff9ee242a37000 from 42 10000000:01000000:0.0:1762166839.347480:0:5753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1762166839.347505:0:5753:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee37f158e00/0xf915a5bdf3c9ce53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.347512:0:5753:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.135@tcp lock: ffff9ee37f158e00/0xf915a5bdf3c9ce53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.347520:0:5753:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.135@tcp lock: ffff9ee37f158e00/0xf915a5bdf3c9ce53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166839.347538:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451944704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.347586:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166839.347626:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166839.347695:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451944704 00000100:00100000:3.0:1762166839.347700:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451944704 00000100:00100000:3.0:1762166839.347740:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1762166839.347748:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+13:5753:x1847765451944704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1762166839.347757:0:30813:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166839.347806:0:30813:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee2425f4200/0xf915a5bdf3c9ce5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf915a5bdf3c9ce53 expref: -99 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.347826:0:30813:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee2425f4200/0xf915a5bdf3c9ce5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf915a5bdf3c9ce53 expref: 14 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.347837:0:30813:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee2425f4200/0xf915a5bdf3c9ce5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf915a5bdf3c9ce53 expref: 14 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.347845:0:30813:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2425f4200, rc 0) 00000100:00100000:3.0:1762166839.347878:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+14:5753:x1847765451944704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166839.347884:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1762166839.347961:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451944704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1762166839.347973:0:5753:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.135@tcp lock: ffff9ee37f158e00/0xf915a5bdf3c9ce53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce5a expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.347982:0:5753:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.135@tcp lock: ffff9ee37f158e00/0xf915a5bdf3c9ce53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c9ce5a expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166839.348050:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451944832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.348072:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166839.348100:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166839.348252:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451944832 00000100:00100000:3.0:1762166839.348256:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451944832 00000100:00100000:3.0:1762166839.348318:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1762166839.348326:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+14:5753:x1847765451944832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1762166839.348431:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+14:5753:x1847765451944832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166839.348437:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1762166839.348524:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451944832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.348562:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451944960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.348601:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166839.348621:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166839.348641:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451944960 00000100:00100000:3.0:1762166839.348647:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451944960 00000100:00100000:3.0:1762166839.348681:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1762166839.348689:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+14:5753:x1847765451944960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1762166839.348908:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+14:5753:x1847765451944960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166839.348916:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1762166839.349000:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451944960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1762166839.349800:0:30961:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 42 00000020:01000000:0.0:1762166839.349960:0:5753:0:(obd_config.c:2039:class_config_parse_llog()) Processed log lustre-client gen 42-41 (rc=0) 10000000:01000000:0.0:1762166839.349974:0:5753:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.203.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1762166839.349982:0:5753:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee37f158e00/0xf915a5bdf3c9ce53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce5a expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.349992:0:5753:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.135@tcp lock: ffff9ee37f158e00/0xf915a5bdf3c9ce53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce5a expref: -99 pid: 5753 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166839.350001:0:5753:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1762166839.350003:0:5753:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1762166839.350006:0:5753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1762166839.350026:0:5753:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee37f159400/0xf915a5bdf3c9ce61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.350045:0:5753:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.135@tcp lock: ffff9ee37f159400/0xf915a5bdf3c9ce61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.350054:0:5753:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.135@tcp lock: ffff9ee37f159400/0xf915a5bdf3c9ce61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166839.350070:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451945088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.350101:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166839.350138:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166839.350186:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451945088 00000100:00100000:3.0:1762166839.350191:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451945088 00000100:00100000:3.0:1762166839.350227:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1762166839.350234:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+14:5753:x1847765451945088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1762166839.350243:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166839.350254:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee2425f5a00/0xf915a5bdf3c9ce68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf915a5bdf3c9ce61 expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.350270:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee2425f5a00/0xf915a5bdf3c9ce68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf915a5bdf3c9ce61 expref: 15 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.350279:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee2425f5a00/0xf915a5bdf3c9ce68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf915a5bdf3c9ce61 expref: 15 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.350287:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2425f5a00, rc 0) 00000100:00100000:3.0:1762166839.350329:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+15:5753:x1847765451945088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166839.350337:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1762166839.350366:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451945088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1762166839.350380:0:5753:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.135@tcp lock: ffff9ee37f159400/0xf915a5bdf3c9ce61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce68 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.350388:0:5753:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.135@tcp lock: ffff9ee37f159400/0xf915a5bdf3c9ce61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c9ce68 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166839.350444:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451945216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.350468:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166839.350486:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166839.350505:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451945216 00000100:00100000:2.0:1762166839.350511:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451945216 00000100:00100000:2.0:1762166839.350555:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1762166839.350564:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+15:5753:x1847765451945216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1762166839.350752:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+15:5753:x1847765451945216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166839.350787:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1762166839.350905:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451945216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.350930:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451945344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.350966:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166839.351048:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166839.351087:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451945344 00000100:00100000:3.0:1762166839.351091:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451945344 00000100:00100000:3.0:1762166839.351121:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1762166839.351128:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+15:5753:x1847765451945344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1762166839.354008:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+15:5753:x1847765451945344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2871us (3033us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166839.354021:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1762166839.354050:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451945344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1762166839.354707:0:30962:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:0.0:1762166839.354801:0:5753:0:(obd_config.c:2039:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1762166839.354826:0:5753:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.203.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1762166839.354836:0:5753:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee37f159400/0xf915a5bdf3c9ce61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce68 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.354846:0:5753:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.135@tcp lock: ffff9ee37f159400/0xf915a5bdf3c9ce61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce68 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166839.354855:0:5753:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1762166839.354857:0:5753:0:(mgc_request.c:1812:mgc_process_log()) Process log params-ffff9ee242a37000 from 7 10000000:01000000:0.0:1762166839.354861:0:5753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1762166839.354893:0:5753:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee37f158c00/0xf915a5bdf3c9ce6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.354901:0:5753:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.135@tcp lock: ffff9ee37f158c00/0xf915a5bdf3c9ce6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.354909:0:5753:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.135@tcp lock: ffff9ee37f158c00/0xf915a5bdf3c9ce6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166839.354942:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451945472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.354983:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166839.355022:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166839.355039:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451945472 00000100:00100000:2.0:1762166839.355045:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451945472 00000100:00100000:2.0:1762166839.355085:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1762166839.355092:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+15:5753:x1847765451945472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1762166839.355102:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166839.355111:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee36dc15000/0xf915a5bdf3c9ce76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf915a5bdf3c9ce6f expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.355127:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee36dc15000/0xf915a5bdf3c9ce76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf915a5bdf3c9ce6f expref: 16 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.355133:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee36dc15000/0xf915a5bdf3c9ce76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf915a5bdf3c9ce6f expref: 16 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.355138:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15000, rc 0) 00000100:00100000:2.0:1762166839.355167:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+16:5753:x1847765451945472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166839.355173:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1762166839.355200:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451945472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1762166839.355212:0:5753:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.135@tcp lock: ffff9ee37f158c00/0xf915a5bdf3c9ce6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce76 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166839.355220:0:5753:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.135@tcp lock: ffff9ee37f158c00/0xf915a5bdf3c9ce6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c9ce76 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166839.355255:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451945600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.355281:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166839.355307:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166839.355375:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451945600 00000100:00100000:2.0:1762166839.355380:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451945600 00000100:00100000:2.0:1762166839.355414:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1762166839.355422:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+16:5753:x1847765451945600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1762166839.355525:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+16:5753:x1847765451945600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166839.355533:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1762166839.355570:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451945600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.355609:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451945728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1762166839.355654:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166839.355674:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166839.355676:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451945728 00000100:00100000:2.0:1762166839.355681:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451945728 00000100:00100000:2.0:1762166839.355716:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1762166839.355723:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+16:5753:x1847765451945728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1762166839.355916:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+16:5753:x1847765451945728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166839.355923:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1762166839.356002:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451945728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1762166839.356756:0:30963:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1762166839.356903:0:5753:0:(obd_config.c:2039:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1762166839.356917:0:5753:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.203.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1762166839.356924:0:5753:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee37f158c00/0xf915a5bdf3c9ce6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce76 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.356950:0:5753:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.135@tcp lock: ffff9ee37f158c00/0xf915a5bdf3c9ce6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce76 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1762166839.356963:0:5753:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1762166839.356965:0:5753:0:(mgc_request.c:1812:mgc_process_log()) Process log nodemap-ffff9ee348a24a88 from 1 10000000:01000000:3.0:1762166839.356968:0:5753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1762166839.356989:0:5753:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee2425f5400/0xf915a5bdf3c9ce7d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.356997:0:5753:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.135@tcp lock: ffff9ee2425f5400/0xf915a5bdf3c9ce7d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.357004:0:5753:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.135@tcp lock: ffff9ee2425f5400/0xf915a5bdf3c9ce7d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166839.357021:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451945856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1762166839.357048:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166839.357075:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c360c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166839.357081:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451945856 00000100:00100000:2.0:1762166839.357085:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451945856 00000100:00100000:2.0:1762166839.357115:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1762166839.357123:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+16:5753:x1847765451945856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1762166839.357131:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166839.357142:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee36dc15600/0xf915a5bdf3c9ce84 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf915a5bdf3c9ce7d expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.357156:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee36dc15600/0xf915a5bdf3c9ce84 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf915a5bdf3c9ce7d expref: 17 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.357165:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee36dc15600/0xf915a5bdf3c9ce84 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf915a5bdf3c9ce7d expref: 17 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.357173:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15600, rc 0) 00000100:00100000:2.0:1762166839.357214:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+17:5753:x1847765451945856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166839.357230:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1762166839.357268:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451945856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1762166839.357282:0:5753:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.135@tcp lock: ffff9ee2425f5400/0xf915a5bdf3c9ce7d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce84 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.357291:0:5753:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.135@tcp lock: ffff9ee2425f5400/0xf915a5bdf3c9ce7d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c9ce84 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1762166839.357309:0:5753:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.203.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1762166839.357312:0:5753:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee2425f5400/0xf915a5bdf3c9ce7d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce84 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.357319:0:5753:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.135@tcp lock: ffff9ee2425f5400/0xf915a5bdf3c9ce7d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce84 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1762166839.357332:0:5753:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1762166839.357334:0:5753:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-sptlrpc-ffff9ee348a24a88 from 1 10000000:01000000:3.0:1762166839.357336:0:5753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1762166839.357348:0:5753:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee2425f4c00/0xf915a5bdf3c9ce8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.357355:0:5753:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.135@tcp lock: ffff9ee2425f4c00/0xf915a5bdf3c9ce8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.357362:0:5753:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.135@tcp lock: ffff9ee2425f4c00/0xf915a5bdf3c9ce8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166839.357373:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451945984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1762166839.357402:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166839.357422:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c360c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166839.357431:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451945984 00000100:00100000:2.0:1762166839.357436:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451945984 00000100:00100000:2.0:1762166839.357464:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1762166839.357472:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+17:5753:x1847765451945984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1762166839.357479:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166839.357487:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee36dc14800/0xf915a5bdf3c9ce92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf915a5bdf3c9ce8b expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.357500:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee36dc14800/0xf915a5bdf3c9ce92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf915a5bdf3c9ce8b expref: 18 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.357507:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee36dc14800/0xf915a5bdf3c9ce92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf915a5bdf3c9ce8b expref: 18 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166839.357513:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14800, rc 0) 00000100:00100000:2.0:1762166839.357558:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:5753:x1847765451945984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166839.357565:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1762166839.357579:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451945984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1762166839.357593:0:5753:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.135@tcp lock: ffff9ee2425f4c00/0xf915a5bdf3c9ce8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce92 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.357612:0:5753:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.135@tcp lock: ffff9ee2425f4c00/0xf915a5bdf3c9ce8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf915a5bdf3c9ce92 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166839.357652:0:5753:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451946112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1762166839.357675:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166839.357696:0:5753:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c360c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166839.357713:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451946112 00000100:00100000:2.0:1762166839.357718:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451946112 00000100:00100000:2.0:1762166839.357749:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1762166839.357754:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:5753:x1847765451946112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1762166839.357906:0:5753:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1807908-b95d-4027-b65a-753b7d69e554:5753:1847765451946112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1762166839.357908:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:5753:x1847765451946112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (229us total) trans 0 rc -2/-2 00000100:00100000:2.0:1762166839.357919:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 10000000:01000000:3.0:1762166839.357934:0:5753:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.203.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1762166839.357946:0:5753:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.135@tcp lock: ffff9ee2425f4c00/0xf915a5bdf3c9ce8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce92 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.357953:0:5753:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.135@tcp lock: ffff9ee2425f4c00/0xf915a5bdf3c9ce8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf915a5bdf3c9ce92 expref: -99 pid: 5753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166839.719879:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1762166840.022832:0:31086:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg335-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1762166840.744127:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1762166841.008792:0:23749:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1762166841.767906:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1762166842.034087:0:22362:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1762166842.070218:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166842.070308:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444343424 00000100:00100000:1.0:1762166842.070322:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444343424 00000100:00100000:1.0:1762166842.070384:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 5 00000100:00100000:1.0:1762166842.070393:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:46311:x1847765444343424:12345-192.168.203.35@tcp:41:lfs.0 00000020:00080000:1.0:1762166842.070402:0:30819:0:(tgt_handler.c:788:tgt_request_handle()) operation 41 on unconnected OST from 12345-192.168.203.35@tcp 00000100:00100000:1.0:1762166842.070486:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:46311:x1847765444343424:12345-192.168.203.35@tcp:41:lfs.0 Request processed in 93us (277us total) trans 0 rc -107/-107 00000100:00100000:1.0:1762166842.070495:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 5 00000100:00100000:2.0:1762166842.080565:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166842.080624:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444343552 00000100:00100000:1.0:1762166842.080633:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444343552 00000100:00100000:1.0:1762166842.080701:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 6 00000100:00100000:1.0:1762166842.080710:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2357:x1847765444343552:12345-192.168.203.35@tcp:38:lfs.0 00010000:00080000:1.0:1762166842.080737:0:30819:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'da9d93ea-d728-4b01-a76b-4b4ff9c19538' at ffff9ee36e073800, cookie 0xf915a5bdf3c9cd88 00010000:00080000:1.0:1762166842.080744:0:30819:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp recovering/t4294968923 exp ffff9ee36e073800 cur 462 last 1762166838 00010000:02000400:1.0:1762166842.080752:0:30819:0:(ldlm_lib.c:2019:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects 00010000:00080000:1.0:1762166842.084796:0:30819:0:(ldlm_lib.c:2082:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1762166842.084835:0:30819:0:(mdt_handler.c:7249:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:01000000:1.0:1762166842.084844:0:30819:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee34aa0e300 00000100:00080000:1.0:1762166842.084980:0:30819:0:(import.c:65:import_set_state_nolock()) ffff9ee37f7d7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1762166842.085062:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2357:x1847765444343552:12345-192.168.203.35@tcp:38:lfs.0 Request processed in 4352us (4504us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.085070:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 6 00010000:00080000:2.0:1762166842.085147:0:30855:0:(ldlm_lib.c:2527:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:2.0:1762166842.085158:0:30855:0:(ldlm_lib.c:2665:replay_request_or_update()) Waiting for transno 4294969112 00000020:00080000:2.0:1762166842.085163:0:30855:0:(update_recovery.c:587:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 4294969111 00010000:00080000:2.0:1762166842.085166:0:30855:0:(ldlm_lib.c:2210:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 4294969112 00010000:00080000:2.0:1762166842.085169:0:30855:0:(ldlm_lib.c:2228:check_for_next_transno()) waking for next (4294969112) 00000020:00080000:2.0:1762166842.085171:0:30855:0:(update_recovery.c:587:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 4294969111 00000020:00080000:2.0:1762166842.085189:0:30855:0:(update_records.c:54:update_records_dump()) master transno = 4294969111 batchid = 37 flags = 0 ops = 2 params = 4 00000020:00080000:2.0:1762166842.085193:0:30855:0:(update_records.c:73:update_records_dump()) update 0th [0x240000400:0x66:0x0] xattr_set params_count = 3 00000020:00080000:2.0:1762166842.085198:0:30855:0:(update_records.c:88:update_records_dump()) param = ffff9ee36e065464 0th off = 0 size = 12 00000020:00080000:2.0:1762166842.085201:0:30855:0:(update_records.c:88:update_records_dump()) param = ffff9ee36e06547c 1th off = 1 size = 52 00000020:00080000:2.0:1762166842.085203:0:30855:0:(update_records.c:88:update_records_dump()) param = ffff9ee36e0654bc 2th off = 2 size = 4 00000020:00080000:2.0:1762166842.085206:0:30855:0:(update_records.c:73:update_records_dump()) update 1th [0x280000400:0x60:0x0] xattr_set params_count = 3 00000020:00080000:2.0:1762166842.085209:0:30855:0:(update_records.c:88:update_records_dump()) param = ffff9ee36e065464 0th off = 0 size = 12 00000020:00080000:2.0:1762166842.085211:0:30855:0:(update_records.c:88:update_records_dump()) param = ffff9ee36e0654cc 1th off = 3 size = 52 00000020:00080000:2.0:1762166842.085213:0:30855:0:(update_records.c:88:update_records_dump()) param = ffff9ee36e0654bc 2th off = 2 size = 4 80000000:00020000:2.0:1762166842.085248:0:30855:0:(fld_handler.c:205:fld_local_lookup()) srv-lustre-MDT0000: FLD cache range [0x0000000240000400-0x0000000280000400]:0:ost does not match requested flag 0: rc = -5 00000100:00100000:3.0:1762166842.086202:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166842.086239:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444259456 00000100:00100000:1.0:1762166842.086246:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444259456 00000100:00100000:1.0:1762166842.086295:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7 00000100:00100000:1.0:1762166842.086306:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2357:x1847765444259456:12345-192.168.203.35@tcp:101:lfs.0 00010000:00080000:1.0:1762166842.086319:0:30819:0:(ldlm_lib.c:3207:target_queue_recovery_request()) Next recovery transno: 4294969112, current: 4294968923, replaying 00010000:00010000:1.0:1762166842.086327:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166842.086347:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9ce99 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a25 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762166842.086924:0:30819:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 535us 80000000:00020000:2.0:1762166842.090389:0:30855:0:(fld_handler.c:244:fld_server_lookup()) srv-lustre-MDT0000: Cannot find sequence 0x240000400: rc = -2 00000004:00200000:3.0:1762166842.093996:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x3:0x0]: returning size 21 00000004:00080000:3.0:1762166842.094018:0:30819:0:(mdt_open.c:503:mdt_mfd_open()) orphan mfd not found, fid = [0x200000404:0x3:0x0], cookie = 0xf915a5bdf3c9ba5d 00000004:00080000:3.0:1762166842.094021:0:30819:0:(mdt_open.c:507:mdt_mfd_open()) Store old cookie 0xf915a5bdf3c9ba5d in new mfd 00010000:00010000:3.0:1762166842.094148:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9ce99 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a25 expref: 8 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.094165:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee34ada3100) 00010000:00010000:3.0:1762166842.094167:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166842.094172:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9ce99 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a25 expref: 8 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.094189:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473c00, rc 0) 00000100:00100000:3.0:1762166842.094263:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2357:x1847765444259456:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 7959us (8061us total) trans 4294968923 rc 301/301 00000100:00100000:3.0:1762166842.094271:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7 00010000:00080000:2.0:1762166842.094874:0:30855:0:(ldlm_lib.c:2082:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 69 seconds 00000020:00080000:2.0:1762166842.094880:0:30855:0:(update_recovery.c:486:dtrq_destroy()) destroy x0 t4294969111 00000020:00080000:2.0:1762166842.094889:0:30855:0:(update_recovery.c:587:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1762166842.094892:0:30855:0:(ldlm_lib.c:2210:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 4294969112 00000020:00080000:2.0:1762166842.094896:0:30855:0:(update_recovery.c:587:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1762166842.094898:0:30855:0:(ldlm_lib.c:2210:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 4294969112 00000100:00100000:3.0:1762166842.104875:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166842.104975:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444261248 00000100:00100000:0.0:1762166842.104985:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444261248 00000100:00100000:0.0:1762166842.105043:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 8 00000100:00100000:0.0:1762166842.105056:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2357:x1847765444261248:12345-192.168.203.35@tcp:101:lfs.0 00010000:00080000:0.0:1762166842.105075:0:30819:0:(ldlm_lib.c:3207:target_queue_recovery_request()) Next recovery transno: 4294969112, current: 4294968928, replaying 00010000:00010000:0.0:1762166842.105086:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.105108:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cea7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a48 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1762166842.106483:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1:0x0]: returning size 11776 00000004:00080000:0.0:1762166842.106506:0:30819:0:(mdt_open.c:503:mdt_mfd_open()) orphan mfd not found, fid = [0x200000404:0x1:0x0], cookie = 0xf915a5bdf3c9bad4 00000004:00080000:0.0:1762166842.106509:0:30819:0:(mdt_open.c:507:mdt_mfd_open()) Store old cookie 0xf915a5bdf3c9bad4 in new mfd 00010000:00010000:0.0:1762166842.106595:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cea7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a48 expref: 9 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.106607:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee36062b300) 00010000:00010000:0.0:1762166842.106608:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166842.106612:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cea7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a48 expref: 9 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.106642:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158200, rc 0) 00000100:00100000:0.0:1762166842.106703:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2357:x1847765444261248:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1650us (1836us total) trans 4294968928 rc 301/301 00000100:00100000:0.0:1762166842.106711:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 8 00000100:00100000:0.0:1762166842.107712:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166842.107754:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444287232 00000100:00100000:3.0:1762166842.107789:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444287232 00000100:00100000:3.0:1762166842.107837:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 9 00000100:00100000:3.0:1762166842.107849:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2357:x1847765444287232:12345-192.168.203.35@tcp:101:lfs.0 00010000:00080000:3.0:1762166842.107865:0:30819:0:(ldlm_lib.c:3207:target_queue_recovery_request()) Next recovery transno: 4294969112, current: 4294968988, replaying 00010000:00010000:3.0:1762166842.107874:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166842.107891:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5800/0xf915a5bdf3c9ceb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c1d expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1762166842.108972:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x7:0x0]: returning size 11776 00000004:00080000:0.0:1762166842.108989:0:30819:0:(mdt_open.c:503:mdt_mfd_open()) orphan mfd not found, fid = [0x200000404:0x7:0x0], cookie = 0xf915a5bdf3c9c236 00000004:00080000:0.0:1762166842.108991:0:30819:0:(mdt_open.c:507:mdt_mfd_open()) Store old cookie 0xf915a5bdf3c9c236 in new mfd 00010000:00010000:0.0:1762166842.109049:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5800/0xf915a5bdf3c9ceb5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c1d expref: 10 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.109060:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343a13400) 00010000:00010000:0.0:1762166842.109062:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166842.109065:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5800/0xf915a5bdf3c9ceb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c1d expref: 10 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.109076:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2425f5800, rc 0) 00000100:00100000:0.0:1762166842.109179:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2357:x1847765444287232:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1330us (1465us total) trans 4294968988 rc 301/301 00000100:00100000:0.0:1762166842.109187:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 9 00000100:00100000:3.0:1762166842.110042:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166842.110080:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444300800 00000100:00100000:0.0:1762166842.110087:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444300800 00000100:00100000:0.0:1762166842.110137:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 10 00000100:00100000:0.0:1762166842.110145:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2357:x1847765444300800:12345-192.168.203.35@tcp:101:lfs.0 00010000:00080000:0.0:1762166842.110160:0:30819:0:(ldlm_lib.c:3207:target_queue_recovery_request()) Next recovery transno: 4294969112, current: 4294969027, replaying 00010000:00010000:0.0:1762166842.110168:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.110195:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cec3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90cd3 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1762166842.111240:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xe:0x0]: returning size 11776 00000004:00080000:0.0:1762166842.111262:0:30819:0:(mdt_open.c:503:mdt_mfd_open()) orphan mfd not found, fid = [0x200000404:0xe:0x0], cookie = 0xf915a5bdf3c9c531 00000004:00080000:0.0:1762166842.111265:0:30819:0:(mdt_open.c:507:mdt_mfd_open()) Store old cookie 0xf915a5bdf3c9c531 in new mfd 00010000:00010000:0.0:1762166842.111336:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cec3 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cd3 expref: 11 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.111350:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee36062be00) 00010000:00010000:0.0:1762166842.111353:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166842.111358:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cec3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cd3 expref: 11 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.111375:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159a00, rc 0) 00000100:00100000:0.0:1762166842.111427:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2357:x1847765444300800:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1282us (1386us total) trans 4294969027 rc 301/301 00000100:00100000:0.0:1762166842.111435:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 10 00000100:00100000:3.0:1762166842.112270:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166842.112322:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444302592 00000100:00100000:0.0:1762166842.112329:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444302592 00000100:00100000:0.0:1762166842.112377:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 11 00000100:00100000:0.0:1762166842.112385:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2357:x1847765444302592:12345-192.168.203.35@tcp:101:lfs.0 00010000:00080000:0.0:1762166842.112399:0:30819:0:(ldlm_lib.c:3207:target_queue_recovery_request()) Next recovery transno: 4294969112, current: 4294969033, replaying 00010000:00010000:0.0:1762166842.112406:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.112421:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ced1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90cef expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1762166842.113447:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0xf:0x0]: returning size 11776 00000004:00080000:0.0:1762166842.113480:0:30819:0:(mdt_open.c:503:mdt_mfd_open()) orphan mfd not found, fid = [0x200000404:0xf:0x0], cookie = 0xf915a5bdf3c9c593 00000004:00080000:0.0:1762166842.113483:0:30819:0:(mdt_open.c:507:mdt_mfd_open()) Store old cookie 0xf915a5bdf3c9c593 in new mfd 00010000:00010000:0.0:1762166842.113565:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ced1 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cef expref: 12 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.113577:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee36062bc00) 00010000:00010000:0.0:1762166842.113580:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166842.113583:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ced1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cef expref: 12 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.113598:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159600, rc 0) 00000100:00100000:0.0:1762166842.113642:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2357:x1847765444302592:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1258us (1375us total) trans 4294969033 rc 301/301 00000100:00100000:0.0:1762166842.113649:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 11 00000100:00100000:2.0:1762166842.115872:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166842.115905:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166842.115925:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444343680 00000100:00100000:2.0:1762166842.115934:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166842.115935:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444343680 00000100:00100000:1.0:1762166842.115957:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444343808 00000100:00100000:1.0:1762166842.115963:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444343808 00000100:00100000:2.0:1762166842.115971:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166842.115976:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444343936 00000100:00100000:0.0:1762166842.115981:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444343936 00000100:00100000:3.0:1762166842.115986:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444344064 00000100:00100000:3.0:1762166842.115993:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444344064 00000100:00100000:1.0:1762166842.115994:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 12 00000100:00100000:1.0:1762166842.116007:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2357:x1847765444343680:12345-192.168.203.35@tcp:101:ldlm_lock_repla.0 00000100:00100000:2.0:1762166842.116016:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166842.116032:0:30817:0:(service.c:3434:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1762166842.116034:0:30819:0:(service.c:3434:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00010000:00080000:1.0:1762166842.116037:0:30818:0:(ldlm_lib.c:3166:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9ee34371bb80 x1847765444343680/t0(0) o101->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:628/0 lens 328/0 e 0 to 0 dl 1762166853 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1762166842.116044:0:30817:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1762166842.116045:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444344192 00000100:00100000:0.0:1762166842.116051:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444344192 00000100:00100000:1.0:1762166842.116067:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2357:x1847765444343680:12345-192.168.203.35@tcp:101:ldlm_lock_repla.0 Request processed in 63us (201us total) trans 0 rc 0/-999 00000100:00100000:1.0:1762166842.116075:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 12 00000100:00100000:1.0:1762166842.116089:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 13 00000100:00100000:1.0:1762166842.116096:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2357:x1847765444343808:12345-192.168.203.35@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1762166842.116105:0:30818:0:(ldlm_lib.c:3166:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9ee343718700 x1847765444343808/t0(0) o101->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:628/0 lens 328/0 e 0 to 0 dl 1762166853 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1762166842.116130:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2357:x1847765444343808:12345-192.168.203.35@tcp:101:ldlm_lock_repla.0 Request processed in 35us (226us total) trans 0 rc 0/-999 00000100:00100000:1.0:1762166842.116136:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 13 00000100:00100000:1.0:1762166842.116147:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 14 00000100:00100000:1.0:1762166842.116154:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2357:x1847765444343936:12345-192.168.203.35@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1762166842.116164:0:30818:0:(ldlm_lib.c:3166:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9ee36e3b1f80 x1847765444343936/t0(0) o101->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:628/0 lens 328/0 e 0 to 0 dl 1762166853 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00080000:2.0:1762166842.116167:0:30855:0:(update_recovery.c:587:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1762166842.116178:0:30855:0:(ldlm_lib.c:2210:check_for_next_transno()) max: 1, connected: 1, completed: 1, queue_len: 0, req_transno: 0, next_transno: 4294969112 00010000:00080000:2.0:1762166842.116182:0:30855:0:(ldlm_lib.c:2244:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1762166842.116186:0:30855:0:(update_recovery.c:587:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000100:00100000:1.0:1762166842.116192:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2357:x1847765444343936:12345-192.168.203.35@tcp:101:ldlm_lock_repla.0 Request processed in 35us (255us total) trans 0 rc 0/-999 00010000:00080000:2.0:1762166842.116193:0:30855:0:(ldlm_lib.c:2434:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1762166842.116197:0:30855:0:(ldlm_lib.c:2264:check_for_next_lock()) waking for next lock 00000100:00100000:1.0:1762166842.116202:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 14 00010000:00080000:2.0:1762166842.116208:0:30855:0:(ldlm_lib.c:2867:target_recovery_thread()) @@@ processing lock from 192.168.203.35@tcp: req@ffff9ee34371bb80 x1847765444343680/t0(0) o101->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:628/0 lens 328/0 e 0 to 0 dl 1762166853 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1762166842.116218:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 15 00000100:00100000:1.0:1762166842.116227:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2357:x1847765444344064:12345-192.168.203.35@tcp:101:ldlm_lock_repla.0 00010000:00010000:2.0:1762166842.116230:0:30855:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00080000:1.0:1762166842.116236:0:30818:0:(ldlm_lib.c:3166:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9ee36e3b3800 x1847765444344064/t0(0) o101->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:628/0 lens 328/0 e 0 to 0 dl 1762166853 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1762166842.116246:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2357:x1847765444344064:12345-192.168.203.35@tcp:101:ldlm_lock_repla.0 Request processed in 20us (278us total) trans 0 rc 0/-999 00000100:00100000:1.0:1762166842.116250:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 15 00010000:00010000:2.0:1762166842.116258:0:30855:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9cedf lrc: 2/0,0 mode: --/CR res: [0x200000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90cef expref: -99 pid: 30855 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166842.116259:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16 00000100:00100000:1.0:1762166842.116269:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2357:x1847765444344192:12345-192.168.203.35@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1762166842.116275:0:30818:0:(ldlm_lib.c:3166:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9ee36e3b3100 x1847765444344192/t0(0) o101->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:628/0 lens 328/0 e 0 to 0 dl 1762166853 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1762166842.116289:0:30855:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9cedf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cef expref: 16 pid: 30855 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166842.116293:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2357:x1847765444344192:12345-192.168.203.35@tcp:101:ldlm_lock_repla.0 Request processed in 25us (281us total) trans 0 rc 0/-999 00000100:00100000:1.0:1762166842.116306:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16 00010000:00010000:2.0:1762166842.116319:0:30855:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9cedf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cef expref: 16 pid: 30855 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.116329:0:30855:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15a00, rc 0) 00010000:00080000:2.0:1762166842.116386:0:30855:0:(ldlm_lib.c:2082:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:2.0:1762166842.116397:0:30855:0:(ldlm_lib.c:2434:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1762166842.116398:0:30855:0:(ldlm_lib.c:2264:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1762166842.116403:0:30855:0:(ldlm_lib.c:2867:target_recovery_thread()) @@@ processing lock from 192.168.203.35@tcp: req@ffff9ee343718700 x1847765444343808/t0(0) o101->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:628/0 lens 328/0 e 0 to 0 dl 1762166853 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1762166842.116412:0:30855:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.116422:0:30855:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9cee6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90cd3 expref: -99 pid: 30855 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.116432:0:30855:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9cee6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cd3 expref: 16 pid: 30855 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.116449:0:30855:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9cee6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cd3 expref: 16 pid: 30855 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.116454:0:30855:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14200, rc 0) 00010000:00080000:2.0:1762166842.116470:0:30855:0:(ldlm_lib.c:2082:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1762166842.116477:0:30855:0:(ldlm_lib.c:2434:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1762166842.116478:0:30855:0:(ldlm_lib.c:2264:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1762166842.116481:0:30855:0:(ldlm_lib.c:2867:target_recovery_thread()) @@@ processing lock from 192.168.203.35@tcp: req@ffff9ee36e3b1f80 x1847765444343936/t0(0) o101->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:628/0 lens 328/0 e 0 to 0 dl 1762166853 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1762166842.116489:0:30855:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.116497:0:30855:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9ceed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90c1d expref: -99 pid: 30855 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.116505:0:30855:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9ceed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c1d expref: 16 pid: 30855 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.116510:0:30855:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9ceed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c1d expref: 16 pid: 30855 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.116515:0:30855:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14a00, rc 0) 00010000:00080000:2.0:1762166842.116542:0:30855:0:(ldlm_lib.c:2082:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1762166842.116548:0:30855:0:(ldlm_lib.c:2434:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1762166842.116549:0:30855:0:(ldlm_lib.c:2264:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1762166842.116553:0:30855:0:(ldlm_lib.c:2867:target_recovery_thread()) @@@ processing lock from 192.168.203.35@tcp: req@ffff9ee36e3b3800 x1847765444344064/t0(0) o101->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:628/0 lens 328/0 e 0 to 0 dl 1762166853 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1762166842.116560:0:30855:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.116567:0:30855:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9cef4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a25 expref: -99 pid: 30855 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.116580:0:30855:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9cef4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x3:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a25 expref: 16 pid: 30855 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.116587:0:30855:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9cef4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x3:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a25 expref: 16 pid: 30855 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.116593:0:30855:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15c00, rc 0) 00010000:00080000:2.0:1762166842.116607:0:30855:0:(ldlm_lib.c:2082:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1762166842.116613:0:30855:0:(ldlm_lib.c:2434:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1762166842.116615:0:30855:0:(ldlm_lib.c:2264:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1762166842.116619:0:30855:0:(ldlm_lib.c:2867:target_recovery_thread()) @@@ processing lock from 192.168.203.35@tcp: req@ffff9ee36e3b3100 x1847765444344192/t0(0) o101->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:628/0 lens 328/0 e 0 to 0 dl 1762166853 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1762166842.116626:0:30855:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.116634:0:30855:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cefb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90a48 expref: -99 pid: 30855 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.116654:0:30855:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cefb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a48 expref: 16 pid: 30855 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.116660:0:30855:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cefb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a48 expref: 16 pid: 30855 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.116665:0:30855:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc14c00, rc 0) 00010000:00080000:2.0:1762166842.116688:0:30855:0:(ldlm_lib.c:2082:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1762166842.116693:0:30855:0:(ldlm_lib.c:2434:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1762166842.117376:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166842.117412:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444344320 00000100:00100000:3.0:1762166842.117417:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444344320 00000100:00100000:3.0:1762166842.117451:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 0 00000100:00100000:3.0:1762166842.117461:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2357:x1847765444344320:12345-192.168.203.35@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1762166842.117472:0:31205:0:(ldlm_lib.c:3116:target_queue_recovery_request()) @@@ queue final req req@ffff9ee35047d180 x1847765444344320/t0(0) o400->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:628/0 lens 224/0 e 0 to 0 dl 1762166853 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1762166842.117490:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2357:x1847765444344320:12345-192.168.203.35@tcp:400:ptlrpcd_rcv.0 Request processed in 32us (116us total) trans 0 rc 0/-999 00000100:00100000:3.0:1762166842.117497:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 0 00010000:00080000:2.0:1762166842.117517:0:30855:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1762166842.117697:0:30855:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1762166842.129283:0:30855:0:(tgt_lastrcvd.c:187:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1762166842.129326:0:30855:0:(ldlm_lib.c:1980:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1762166842.129339:0:30855:0:(ldlm_lib.c:2919:target_recovery_thread()) @@@ processing final ping from 192.168.203.35@tcp: req@ffff9ee35047d180 x1847765444344320/t0(0) o400->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:628/0 lens 224/0 e 0 to 0 dl 1762166853 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1762166842.129421:0:30855:0:(ldlm_lib.c:1853:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted. 00000001:00100000:3.0:1762166842.134159:0:30849:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of da9d93ea-d728-4b01-a76b-4b4ff9c19538 00000100:00100000:0.0:1762166842.136595:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166842.136689:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444343424 00000100:00100000:3.0:1762166842.136701:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444343424 00000100:00100000:3.0:1762166842.136786:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17 00000100:00100000:3.0:1762166842.136798:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:46311:x1847765444343424:12345-192.168.203.35@tcp:41:lfs.0 00000004:00000024:3.0:1762166842.136853:0:31205:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2260074496 avail 2257977344 00000100:00100000:3.0:1762166842.136923:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:46311:x1847765444343424:12345-192.168.203.35@tcp:41:lfs.0 Request processed in 127us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.136944:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17 00000100:00100000:3.0:1762166842.138906:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166842.138994:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444344576 00000100:00100000:1.0:1762166842.139011:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444344576 00000100:00080000:3.0:1762166842.139086:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166842.139112:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 133 00000100:00100000:1.0:1762166842.139127:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:46311:x1847765444344576:12345-192.168.203.35@tcp:13:lfs.0 00002000:00000024:1.0:1762166842.139181:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1762166842.139266:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:46311:x1847765444344576:12345-192.168.203.35@tcp:13:lfs.0 Request processed in 143us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.139272:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 133 00000100:00100000:1.0:1762166842.140332:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166842.140403:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444344704 00000100:00100000:0.0:1762166842.140413:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444344704 00000100:00080000:3.0:1762166842.140477:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166842.140494:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 134 00000100:00100000:0.0:1762166842.140507:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:46311:x1847765444344704:12345-192.168.203.35@tcp:13:lfs.0 00002000:00000024:0.0:1762166842.140555:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 57737216 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1762166842.140621:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:46311:x1847765444344704:12345-192.168.203.35@tcp:13:lfs.0 Request processed in 117us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.140649:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 134 00000004:00000080:2.0:1762166842.149654:0:30855:0:(mdd_device.c:2257:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffafd902edbe10 00100000:10000000:2.0:1762166842.149669:0:30855:0:(lfsck_lib.c:3080:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1762166842.150141:0:30841:0:(osp_precreate.c:877:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x66:0x0] 00000004:00080000:3.0:1762166842.150151:0:30843:0:(osp_precreate.c:877:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x60:0x0] 00000100:00100000:3.0:1762166842.150192:0:30843:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:30843:1847765451946368:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1762166842.150192:0:30841:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:30841:1847765451946240:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1762166842.150261:0:30841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166842.150294:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451946240 00000100:00100000:3.0:1762166842.150303:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451946240 00000100:00100000:0.0:1762166842.150311:0:30841:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855900 going to sleep for 11 seconds 00000100:00080000:0.0:1762166842.150345:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166842.150366:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:3.0:1762166842.150378:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:30841:x1847765451946240:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1762166842.150410:0:26444:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 129 -> diff = -27 00002000:02000040:3.0:1762166842.150415:0:26444:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:103 to 0x240000400:129) 00000100:00100000:1.0:1762166842.150852:0:30843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166842.150883:0:30843:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.150907:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451946368 00000100:00100000:0.0:1762166842.150913:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451946368 00000100:00080000:1.0:1762166842.150956:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166842.150969:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:0.0:1762166842.150978:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:30843:x1847765451946368:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1762166842.150994:0:7858:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 129 -> diff = -33 00002000:02000040:0.0:1762166842.150997:0:7858:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:97 to 0x280000400:129) 00002000:00010000:3.0:1762166842.155181:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.155190:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5800/0xf915a5bdf3c9cf02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.155202:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.155203:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.155208:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5800/0xf915a5bdf3c9cf02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.155219:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5800/0xf915a5bdf3c9cf02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.155239:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5800/0xf915a5bdf3c9cf02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.155246:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5800/0xf915a5bdf3c9cf02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.155271:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.155293:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.155302:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5800/0xf915a5bdf3c9cf02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.155311:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f5800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.155316:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5800/0xf915a5bdf3c9cf02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.155324:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5800/0xf915a5bdf3c9cf02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.155342:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5800/0xf915a5bdf3c9cf02 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.155349:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5800/0xf915a5bdf3c9cf02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.155366:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.155368:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.155370:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.155633:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.155638:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cf09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.155646:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.155648:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.155651:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cf09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.155660:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cf09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.155668:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cf09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.155674:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cf09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.155701:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.155752:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.155757:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cf09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.155793:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f4e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.155797:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cf09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.155803:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cf09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.155816:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cf09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.155823:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4e00/0xf915a5bdf3c9cf09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.155838:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.155840:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.155841:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.155967:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.155978:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5600/0xf915a5bdf3c9cf10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.155986:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.155988:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.155991:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5600/0xf915a5bdf3c9cf10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156003:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5600/0xf915a5bdf3c9cf10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156011:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5600/0xf915a5bdf3c9cf10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156017:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5600/0xf915a5bdf3c9cf10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156041:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.156115:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.156120:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5600/0xf915a5bdf3c9cf10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.156128:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f5600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.156131:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5600/0xf915a5bdf3c9cf10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.156140:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5600/0xf915a5bdf3c9cf10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.156164:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5600/0xf915a5bdf3c9cf10 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.156171:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5600/0xf915a5bdf3c9cf10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.156201:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.156203:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.156206:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.156279:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.156284:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cf17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156291:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.156293:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.156296:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cf17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156305:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cf17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156324:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cf17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156331:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cf17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156349:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.156379:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.156393:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cf17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.156400:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f4000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.156403:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cf17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.156410:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cf17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.156419:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cf17 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.156439:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4000/0xf915a5bdf3c9cf17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.156471:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.156479:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.156482:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.156602:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.156608:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cf1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156616:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.156617:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.156620:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cf1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156628:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cf1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156636:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cf1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156641:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cf1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156666:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.156756:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.156779:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cf1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.156787:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f5000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.156790:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cf1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.156798:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cf1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.156811:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cf1e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.156818:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5000/0xf915a5bdf3c9cf1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.156837:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.156841:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.156843:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.156922:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.156932:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cf25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156940:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.156941:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.156943:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cf25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156952:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cf25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156959:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cf25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156965:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cf25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.156982:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.157015:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.157020:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cf25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157029:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f4600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.157032:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cf25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157051:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cf25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157062:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cf25 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157069:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f4600/0xf915a5bdf3c9cf25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157085:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.157087:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.157089:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.157208:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.157214:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cf2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.157221:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.157222:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.157225:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cf2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.157233:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cf2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.157251:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cf2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.157258:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cf2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.157278:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.157304:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.157310:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cf2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157318:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f5c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.157321:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cf2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157329:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cf2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157339:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cf2c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157345:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3c9cf2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157367:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.157370:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.157372:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.157513:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.157518:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9cf33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.157540:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.157541:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.157544:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9cf33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.157552:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9cf33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.157559:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9cf33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.157566:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9cf33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.157589:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.157633:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.157639:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9cf33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157648:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.157651:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9cf33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157659:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9cf33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157670:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9cf33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157677:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9cf33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157692:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.157695:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.157698:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.157840:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.157851:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cf3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.157859:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.157860:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.157864:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cf3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.157872:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cf3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.157880:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cf3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.157887:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cf3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.157905:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.157926:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.157933:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cf3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157951:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.157954:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cf3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157961:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cf3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157971:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cf3a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157978:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9cf3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.157994:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.157996:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.157999:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.158132:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.158138:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9cf41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.158145:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.158146:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.158149:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9cf41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.158158:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9cf41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.158175:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9cf41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.158183:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9cf41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.158207:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.158316:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.158336:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9cf41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.158345:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.158348:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9cf41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.158356:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9cf41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.158393:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9cf41 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.158401:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9cf41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.158429:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.158432:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.158434:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.159126:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.159132:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9cf48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.159140:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.159142:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.159145:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9cf48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.159154:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9cf48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.159167:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9cf48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.159174:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9cf48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.159189:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.159212:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.159219:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9cf48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.159226:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.159229:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9cf48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.159237:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9cf48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.159249:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9cf48 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.159256:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9cf48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.159275:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.159283:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.159286:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.159409:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.159417:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cf4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.159422:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.159423:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.159425:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cf4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.159431:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cf4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.159436:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cf4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.159440:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cf4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.159452:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.159476:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.159483:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cf4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.159490:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.159493:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cf4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.159500:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cf4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.159511:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cf4f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.159518:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9cf4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.159542:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.159544:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.159546:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.159685:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.159689:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9cf56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.159694:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.159695:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.159697:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9cf56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.159703:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9cf56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166842.159715:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.159717:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9cf56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.159725:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9cf56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.159725:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cf5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.159747:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.159750:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.159753:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cf5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.159759:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166842.159804:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cf5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.159806:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.159815:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9cf56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.159817:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cf5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.159836:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.159840:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9cf56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.159853:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cf5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.159871:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9cf56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.159881:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.159886:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9cf56 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.159894:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9cf56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.159899:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.159906:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cf5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.159913:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.159914:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.159917:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.159920:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cf5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.159940:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cf5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.159941:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.159966:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cf5d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.159974:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9cf5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.159989:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.159991:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.159993:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.160088:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.160094:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9cf64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.160101:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.160103:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.160106:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9cf64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.160115:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9cf64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.160122:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9cf64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.160128:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9cf64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.160151:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.160218:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.160224:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9cf64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.160232:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.160236:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9cf64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.160244:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9cf64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.160257:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9cf64 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166842.160264:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166842.160265:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9cf64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.160271:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cf6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.160283:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.160285:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.160290:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cf6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.160301:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cf6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.160306:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166842.160309:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cf6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.160311:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.160316:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166842.160321:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cf6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.160340:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.160361:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.160367:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cf6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.160375:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.160379:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cf6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.160387:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cf6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.160400:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cf6b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.160408:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9cf6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166842.160418:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166842.160422:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.160425:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166842.160429:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9cf72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.160429:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166842.160436:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.160437:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.160439:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9cf72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.160446:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9cf72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.160451:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9cf72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.160456:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9cf72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.160471:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.160491:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.160496:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9cf72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.160503:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.160507:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9cf72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.160515:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9cf72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.160537:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9cf72 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.160546:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9cf72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.160558:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.160567:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.160570:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.160738:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.160744:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9cf79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.160782:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.160785:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.160788:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9cf79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.160798:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9cf79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.160805:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9cf79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.160813:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9cf79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.160831:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1762166842.160845:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.160851:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9cf80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.160858:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.160859:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.160862:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9cf80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.160868:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9cf80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.160889:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9cf80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.160897:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9cf80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.160902:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.160909:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9cf79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.160913:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.160934:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.160939:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9cf79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.160948:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9cf79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.160962:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9cf79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.160970:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9cf79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.160987:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.160992:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9cf80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166842.160992:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.161003:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9cf87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161005:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.161011:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9cf80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.161017:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.161020:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166842.161026:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9cf80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.161026:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9cf87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.161051:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9cf87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161054:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9cf80 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.161065:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9cf87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161087:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9cf80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.161089:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9cf87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161113:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166842.161117:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1762166842.161118:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9cf87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161129:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.161133:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9cf87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.161137:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.161143:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9cf87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.161157:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.161159:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9cf87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161167:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9cf87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161188:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.161190:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.161195:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.161210:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.161217:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9cf8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.161225:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.161227:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.161230:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9cf8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.161240:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9cf8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.161248:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9cf8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166842.161250:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.161258:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cf95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.161262:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9cf8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.161266:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.161269:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.161272:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cf95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.161280:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cf95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.161285:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cf95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.161289:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166842.161289:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cf95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.161310:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1762166842.161329:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1762166842.161334:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9cf8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161349:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.161352:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9cf8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.161357:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.161358:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9cf8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.161366:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cf95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161370:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9cf8e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161383:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9cf8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.161387:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.161393:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cf95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161395:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.161398:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.161400:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.161407:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cf95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.161421:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cf95 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.161428:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9cf95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.161446:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.161449:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.161453:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.161642:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.161648:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cf9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.161665:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.161667:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.161670:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cf9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.161679:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cf9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166842.161683:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.161686:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cf9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.161698:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cf9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.161701:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9cfa3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.161710:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.161712:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.161716:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9cfa3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.161719:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166842.161730:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9cfa3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.161738:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9cfa3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.161746:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9cfa3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161781:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1762166842.161786:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.161796:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cf9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161808:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.161811:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cf9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161818:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cf9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161846:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cf9c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161854:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9cf9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161867:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.161870:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9cfa3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161877:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.161879:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9cfa3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161887:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9cfa3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161895:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9cfa3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161902:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9cfa3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.161914:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.161915:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.161918:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.161994:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.162044:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.162051:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9cfaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.162058:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.162060:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.162063:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9cfaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.162071:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9cfaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.162078:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9cfaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.162093:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9cfaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.162114:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.162146:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.162152:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9cfaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.162160:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.162171:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9cfaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.162185:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9cfaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.162197:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9cfaa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.162205:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9cfaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.162221:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.162223:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.162225:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.162353:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.162358:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687600/0xf915a5bdf3c9cfb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.162366:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.162367:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.162370:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687600/0xf915a5bdf3c9cfb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.162378:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245687600/0xf915a5bdf3c9cfb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.162386:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687600/0xf915a5bdf3c9cfb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.162392:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687600/0xf915a5bdf3c9cfb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.162409:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.162432:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.162443:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245687600/0xf915a5bdf3c9cfb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.162450:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.162453:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687600/0xf915a5bdf3c9cfb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.162460:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687600/0xf915a5bdf3c9cfb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.162471:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245687600/0xf915a5bdf3c9cfb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.162477:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245687600/0xf915a5bdf3c9cfb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.162491:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.162493:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.162495:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.162633:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.162640:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9cfb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.162648:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.162650:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.162653:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9cfb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.162664:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9cfb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.162679:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9cfb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.162683:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9cfb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.162702:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1762166842.162800:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.162807:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9cfbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.162826:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.162828:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166842.162829:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.162834:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9cfbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.162836:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9cfb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.162852:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9cfbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.162854:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.162860:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9cfb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.162863:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9cfbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.162874:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9cfbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.162879:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9cfb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.162895:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9cfb8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.162906:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.162917:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9cfb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.162938:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.162942:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9cfbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.162944:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.162950:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.162954:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9cfbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.162962:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9cfbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.162975:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9cfbf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.162982:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9cfbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.163000:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.163002:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.163005:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.163042:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.163048:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9cfc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.163055:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.163056:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.163060:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9cfc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.163069:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9cfc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.163078:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9cfc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.163085:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9cfc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.163103:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.163128:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.163134:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9cfc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.163143:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.163147:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9cfc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.163155:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9cfc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.163175:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9cfc6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166842.163177:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.163186:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9cfcd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.163187:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9cfc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.163200:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.163203:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.163206:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9cfcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.163211:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.163215:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166842.163216:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9cfcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.163217:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166842.163226:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9cfcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.163239:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9cfcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.163273:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.163288:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.163294:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9cfcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.163302:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.163306:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9cfcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.163315:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9cfcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.163332:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9cfcd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.163339:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9cfcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.163354:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.163364:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.163368:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.163428:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.163440:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9cfd4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.163447:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.163449:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.163452:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9cfd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.163462:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9cfd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.163470:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9cfd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.163477:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9cfd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.163497:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.163520:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.163537:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9cfd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.163558:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.163562:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9cfd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.163570:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9cfd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.163583:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9cfd4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.163591:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9cfd4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166842.163593:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.163604:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686200/0xf915a5bdf3c9cfdb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.163612:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166842.163613:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.163616:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166842.163617:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.163621:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166842.163623:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686200/0xf915a5bdf3c9cfdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.163633:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245686200/0xf915a5bdf3c9cfdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.163640:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686200/0xf915a5bdf3c9cfdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.163646:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686200/0xf915a5bdf3c9cfdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.163669:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.163756:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.163779:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245686200/0xf915a5bdf3c9cfdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.163787:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.163791:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686200/0xf915a5bdf3c9cfdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.163799:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686200/0xf915a5bdf3c9cfdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.163811:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245686200/0xf915a5bdf3c9cfdb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.163818:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686200/0xf915a5bdf3c9cfdb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.163836:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.163838:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.163840:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.163841:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.163848:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9cfe2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.163856:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.163857:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.163861:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9cfe2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.163869:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9cfe2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.163888:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9cfe2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.163894:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9cfe2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.163914:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.163952:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.163959:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9cfe2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.163968:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.163971:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9cfe2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166842.163990:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166842.163992:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9cfe2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.163998:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9cfe9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.164009:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9cfe2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.164030:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9cfe2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.164033:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.164037:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.164042:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9cfe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.164053:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166842.164053:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9cfe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.164057:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.164063:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166842.164063:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9cfe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.164069:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9cfe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.164085:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.164103:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.164108:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9cfe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.164115:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.164118:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9cfe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.164123:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9cfe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.164141:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9cfe9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.164146:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9cfe9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.164158:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.164161:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.164164:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.164203:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.164208:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9cff0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.164216:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.164217:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.164220:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9cff0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.164228:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9cff0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.164235:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9cff0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.164242:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9cff0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.164265:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166842.164294:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166842.164300:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9cff0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.164309:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166842.164312:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9cff0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.164320:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9cff0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.164332:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9cff0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.164347:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9cff0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.164363:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166842.164366:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166842.164369:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.164501:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.164511:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9cff7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.164519:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.164521:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.164535:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9cff7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.164544:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9cff7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.164552:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9cff7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.164558:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9cff7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.164575:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.164589:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.164593:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9cff7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.164599:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216c400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.164602:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9cff7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.164607:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9cff7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.164614:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9cff7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.164618:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9cff7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.164629:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.164635:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.164637:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.164859:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.164864:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee38216d600/0xf915a5bdf3c9cffe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.164871:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.164873:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.164876:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee38216d600/0xf915a5bdf3c9cffe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.164886:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee38216d600/0xf915a5bdf3c9cffe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.164905:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee38216d600/0xf915a5bdf3c9cffe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.164913:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee38216d600/0xf915a5bdf3c9cffe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.164932:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.164957:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.164963:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee38216d600/0xf915a5bdf3c9cffe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.164969:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216d600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.164972:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee38216d600/0xf915a5bdf3c9cffe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.164978:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee38216d600/0xf915a5bdf3c9cffe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.164986:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee38216d600/0xf915a5bdf3c9cffe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.164990:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee38216d600/0xf915a5bdf3c9cffe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.165006:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.165008:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.165011:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.165030:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.165038:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d005 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.165046:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.165047:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.165051:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.165060:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.165069:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.165075:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.165096:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.165118:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.165125:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.165134:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.165138:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.165146:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.165158:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d005 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.165165:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d005 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.165201:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.165204:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.165206:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.165280:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.165287:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d00c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.165295:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.165297:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.165300:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d00c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.165311:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d00c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.165319:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d00c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.165325:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d00c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.165345:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.165366:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.165372:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d00c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.165379:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216ce00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.165383:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d00c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166842.165395:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166842.165400:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d00c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.165403:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9d013 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.165411:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d00c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.165430:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.165433:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.165436:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d00c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.165439:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9d013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.165451:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9d013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.165464:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9d013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.165469:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.165472:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166842.165473:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9d013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.165475:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166842.165491:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.165499:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.165505:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9d013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.165513:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.165517:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9d013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.165534:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9d013 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.165545:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9d013 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.165553:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9d013 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.165575:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.165577:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.165579:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.165797:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.165804:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d01a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.165811:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.165813:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.165816:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d01a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.165825:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d01a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.165832:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d01a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.165843:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d01a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.165858:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.165880:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.165885:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d01a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.165890:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.165892:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d01a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.165901:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d01a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.165909:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d01a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.165913:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d01a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.165922:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.165924:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.165924:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.166081:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.166086:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d021 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.166092:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.166093:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.166096:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.166104:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.166112:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.166119:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.166137:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.166164:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.166170:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.166190:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.166193:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.166200:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d021 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.166212:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d021 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.166219:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d021 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.166241:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.166244:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.166246:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166842.166266:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166842.166276:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d028 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.166285:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.166286:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.166289:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d028 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.166298:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d028 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.166306:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d028 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.166313:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d028 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.166330:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.166351:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.166357:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d028 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166842.166360:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.166370:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d02f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.166371:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216cc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.166378:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d028 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.166394:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d028 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.166397:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.166400:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.166405:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d02f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.166417:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d02f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.166427:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d028 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.166428:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d02f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.166449:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d028 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.166450:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d02f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.166484:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1762166842.166488:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.166493:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d02f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.166503:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.166505:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.166510:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d02f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.166518:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d02f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.166537:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d02f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.166542:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d02f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.166552:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.166553:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.166555:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1762166842.166611:0:26444:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:102 00000100:00100000:3.0:1762166842.166698:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:30841:x1847765451946240:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16320us (16433us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.166709:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:1.0:1762166842.166732:0:30841:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:30841:1847765451946240:0@lo:5:osp-pre-0-0.0 00002000:00010000:0.0:1762166842.166744:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.166751:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d036 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762166842.166755:0:30841:0:(osp_precreate.c:955:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x81:0x0] from OST, last_created [0x240000400:0x81:0x0]last_used is [0x240000400:0x66:0x0] 00010000:00010000:0.0:1762166842.166780:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.166783:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.166786:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.166798:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.166806:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.166819:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d036 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.166837:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1762166842.166846:0:30841:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:30841:1847765451946496:0@lo:5:osp-pre-0-0.0 00010000:00010000:2.0:1762166842.166849:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.166856:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d036 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.166865:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.166869:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d036 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.166879:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d036 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166842.166890:0:30841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166842.166892:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d036 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.166901:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d036 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.166917:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.166920:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.166922:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166842.166939:0:30841:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166842.166945:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451946496 00000100:00100000:3.0:1762166842.166951:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451946496 00000100:00100000:3.0:1762166842.166988:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:3.0:1762166842.166995:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:30841:x1847765451946496:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1762166842.167023:0:26444:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 130 00002000:00010000:0.0:1762166842.167135:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.167141:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9d03d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.167149:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.167151:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.167154:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9d03d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.167163:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9d03d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.167171:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9d03d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.167178:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9d03d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.167197:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.167229:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.167235:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9d03d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.167254:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.167258:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9d03d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.167266:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9d03d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.167277:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9d03d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.167284:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9d03d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.167299:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.167300:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.167302:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.167541:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.167546:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686600/0xf915a5bdf3c9d044 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.167558:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.167560:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.167562:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686600/0xf915a5bdf3c9d044 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.167568:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245686600/0xf915a5bdf3c9d044 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.167573:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686600/0xf915a5bdf3c9d044 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.167577:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686600/0xf915a5bdf3c9d044 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.167591:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.167620:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.167626:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245686600/0xf915a5bdf3c9d044 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.167638:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.167642:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686600/0xf915a5bdf3c9d044 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.167650:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686600/0xf915a5bdf3c9d044 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.167660:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245686600/0xf915a5bdf3c9d044 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.167667:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686600/0xf915a5bdf3c9d044 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.167682:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.167684:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.167686:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.168593:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.168602:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9d04b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.168612:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.168614:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.168618:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9d04b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.168630:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9d04b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.168638:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9d04b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.168651:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9d04b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.168673:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.168698:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.168705:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9d04b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.168713:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.168717:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9d04b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.168727:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9d04b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.169036:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9d04b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.169047:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245687200/0xf915a5bdf3c9d04b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.169072:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.169075:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.169078:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.169147:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.169153:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d052 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.169161:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.169163:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.169166:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d052 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.169177:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d052 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.169185:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d052 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.169192:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d052 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.169215:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.169244:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.169252:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d052 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.169261:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.169265:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d052 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.169274:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d052 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.169286:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d052 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.169294:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d052 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.169314:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.169324:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.169326:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.169601:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.169607:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d059 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.169627:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.169629:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.169632:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d059 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.169642:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d059 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.169651:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d059 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.169659:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.169679:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.169726:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.169740:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.169804:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.169810:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.169820:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.169842:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d059 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.169852:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d059 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.169888:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.169891:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.169897:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.170146:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.170153:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9d060 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.170162:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.170163:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.170166:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9d060 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.170176:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9d060 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.170183:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9d060 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.170198:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9d060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.170220:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.170244:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.170250:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9d060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.170257:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.170260:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9d060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.170267:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9d060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.170278:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9d060 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.170282:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686400/0xf915a5bdf3c9d060 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.170295:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.170298:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.170300:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.170664:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.170671:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9d067 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.170679:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.170681:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.170684:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9d067 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.170693:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9d067 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.170701:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9d067 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.170707:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9d067 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.170725:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.170747:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.170754:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9d067 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.170778:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.170783:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9d067 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.170804:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9d067 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.170823:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9d067 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.170830:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9d067 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.170856:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.170859:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.170862:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.171178:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.171185:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d06e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.171202:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.171204:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.171208:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d06e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.171218:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d06e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.171225:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d06e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.171229:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d06e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.171244:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.171272:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.171280:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d06e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.171288:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439be000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.171291:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d06e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.171299:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d06e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166842.171313:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:30841:x1847765451946496:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4313us (4419us total) trans 21474836752 rc 0/0 00010000:00010000:1.0:1762166842.171329:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d06e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.171344:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d06e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166842.171349:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:2.0:1762166842.171360:0:30841:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:30841:1847765451946496:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1762166842.171385:0:30841:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x81:0x0]-[0x240000400:0xa1:0x0] 00010000:00010000:1.0:1762166842.171397:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.171401:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.171406:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.171474:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.171478:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d075 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.171483:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.171484:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.171486:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d075 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.171492:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d075 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.171496:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d075 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.171505:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d075 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.171519:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.171551:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.171556:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d075 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.171562:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439bfe00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.171565:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d075 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.171571:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d075 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.171579:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d075 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.171588:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d075 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.171598:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.171600:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.171601:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.171711:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.171715:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d07c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.171720:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.171721:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.171722:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d07c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.171728:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d07c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.171732:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d07c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.171736:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d07c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.171748:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.171759:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.171780:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d07c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.171787:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439bfa00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.171791:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d07c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.171798:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d07c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.171811:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d07c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.171818:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d07c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.171831:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.171832:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.171834:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.172447:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.172453:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d083 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.172469:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.172471:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.172473:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d083 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.172483:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d083 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.172490:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d083 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.172497:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d083 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.172517:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.172560:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.172568:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d083 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.172578:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439bf400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.172581:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d083 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.172590:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d083 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.172604:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d083 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.172611:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d083 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.172634:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.172647:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.172650:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.172718:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.172722:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d08a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.172728:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.172728:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.172730:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d08a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.172736:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d08a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.172740:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d08a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.172749:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d08a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.172826:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.173024:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.173036:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d08a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.173044:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439bec00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.173049:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d08a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.173057:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d08a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.173075:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d08a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.173082:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d08a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.173102:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.173106:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.173109:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.173137:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.173143:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d091 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.173150:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.173151:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.173153:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d091 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.173162:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d091 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.173169:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d091 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.173175:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d091 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.173193:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.173211:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.173217:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d091 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.173225:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439be400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.173228:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d091 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.173235:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d091 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.173257:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d091 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.173263:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d091 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.173277:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.173280:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.173282:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.173432:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.173437:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d098 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.173455:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.173457:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.173460:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d098 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.173469:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d098 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.173477:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d098 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.173484:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d098 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.173507:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.173560:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.173567:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d098 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.173577:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439bf800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166842.173581:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d098 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.173590:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d098 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.173601:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d098 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.173609:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d098 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.173625:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.173627:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.173630:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166842.173746:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166842.173752:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d09f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.173759:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.173793:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.173797:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d09f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.173810:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d09f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.173819:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d09f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.173833:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d09f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.173873:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1762166842.173968:0:7858:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:96 00010000:00010000:2.0:1762166842.174021:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.174028:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d09f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.174037:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439bee00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166842.174042:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d09f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.174043:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:30843:x1847765451946368:12345-0@lo:5:osp-pre-1-0.0 Request processed in 23063us (23188us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166842.174061:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d09f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.174063:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00010000:00010000:2.0:1762166842.174082:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d09f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.174090:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d09f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.174108:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166842.174114:0:30843:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:30843:1847765451946368:0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1762166842.174118:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.174129:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1762166842.174136:0:30843:0:(osp_precreate.c:955:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x81:0x0] from OST, last_created [0x280000400:0x81:0x0]last_used is [0x280000400:0x60:0x0] 00000100:00100000:1.0:1762166842.174212:0:30843:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:30843:1847765451946624:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1762166842.174271:0:30843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166842.174321:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451946624 00000100:00100000:1.0:1762166842.174331:0:30843:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.174331:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451946624 00000100:00100000:0.0:1762166842.174379:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1762166842.174389:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:30843:x1847765451946624:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1762166842.174426:0:7858:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 130 00000100:00100000:0.0:1762166842.176610:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:30843:x1847765451946624:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2219us (2336us total) trans 17179869422 rc 0/0 00000100:00100000:0.0:1762166842.176622:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:1.0:1762166842.176666:0:30843:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:30843:1847765451946624:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1762166842.176680:0:30843:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x81:0x0]-[0x280000400:0xa1:0x0] 00000100:00100000:0.0:1762166842.468110:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166842.468184:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444344832 00000100:00100000:2.0:1762166842.468195:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444344832 00000100:00100000:2.0:1762166842.468256:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 44 00000100:00100000:2.0:1762166842.468266:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2361:x1847765444344832:12345-192.168.203.35@tcp:400:kworker.0 00000020:00080000:2.0:1762166842.468276:0:30815:0:(tgt_handler.c:788:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.35@tcp 00000100:00100000:2.0:1762166842.468349:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2361:x1847765444344832:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 83us (250us total) trans 0 rc -107/-107 00000100:00100000:2.0:1762166842.468357:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 44 00000100:00100000:3.0:1762166842.474118:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166842.474247:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444344960 00000100:00100000:0.0:1762166842.474258:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444344960 00000100:00100000:0.0:1762166842.474311:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 45 00000100:00100000:0.0:1762166842.474321:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2357:x1847765444344960:12345-192.168.203.35@tcp:250:ptlrpcd_01_01.0 00010000:00080000:0.0:1762166842.474350:0:30815:0:(ldlm_lib.c:1428:target_handle_connect()) MGS: connection from 1d2907fd-ec36-418b-9892-2b7af8c34cb2@192.168.203.35@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:0.0:1762166842.474393:0:30815:0:(genops.c:1402:class_connect()) connect: client 1d2907fd-ec36-418b-9892-2b7af8c34cb2, cookie 0xf915a5bdf3c9d0a6 00000020:01000000:0.0:1762166842.474403:0:30815:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee34a04d200 00000100:00080000:0.0:1762166842.474583:0:30815:0:(import.c:65:import_set_state_nolock()) ffff9ee348a73000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1762166842.474686:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+4:2357:x1847765444344960:12345-192.168.203.35@tcp:250:ptlrpcd_01_01.0 Request processed in 365us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.474695:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 45 00010000:00010000:2.0:1762166842.791951:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1762166843.356755:0:31291:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg335-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00000100:00100000:3.0:1762166843.559994:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451946752:0@lo:13:osp-pre-0-0.0 00000100:00000400:1.0:1762166843.559996:0:3293:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1762166827/real 1762166827] req@ffff9ee36e2bd500 x1847765451937408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1762166843 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1762166843.559999:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1762166843.560018:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1762166843.560026:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ee36f1fd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000400:2.0:1762166843.560034:0:3294:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1762166827/real 1762166827] req@ffff9ee36e2be300 x1847765451937536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1762166843 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1762166843.560042:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ee36f1fd800 using connection 192.168.203.135@tcp/0@lo 00000100:00100000:0.0:1762166843.560071:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ee36dce6d80 x1847765451947008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1762166843.560090:0:3294:0:(client.c:2512:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9ee36e2be300 x1847765451937536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1762166843 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1762166843.560091:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1762166843.560099:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1762166843.560103:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ee37f4c7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1762166843.560111:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ee37f4c7000 using connection 192.168.203.135@tcp/0@lo 00000100:00100000:2.0:1762166843.560124:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451947136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166843.560127:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ee24240c700 x1847765451947264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1762166843.560166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1762166843.560170:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1762166843.560172:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ee37f4c6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1762166843.560177:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ee37f4c6000 using connection 192.168.203.135@tcp/0@lo 00000100:00100000:0.0:1762166843.560189:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ee24240d500 x1847765451947648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1762166843.560211:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166843.560243:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451947392:0@lo:400:kworker.0 00000100:00100000:0.0:1762166843.560248:0:3292:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1847765451947008:0@lo:38:kworker.0 00000100:00100000:2.0:1762166843.560296:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1847765451937536:0@lo:400:kworker.0 00000100:00100000:3.0:1762166843.560305:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166843.560315:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166843.560341:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1762166843.560350:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f1807908-b95d-4027-b65a-753b7d69e554:3294:1847765451946880:0@lo:400:kworker.0 00000100:00100000:3.0:1762166843.560362:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1762166843.560363:0:3292:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1847765451947264:0@lo:38:kworker.0 00000100:00100000:3.0:1762166843.560375:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451947520:0@lo:400:kworker.0 00000100:00100000:2.0:1762166843.560404:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166843.560444:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166843.560456:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166843.560496:0:3292:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1847765451947648:0@lo:38:kworker.0 00000100:00100000:3.0:1762166843.560513:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451947008 00000100:00100000:0.0:1762166843.560538:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166843.560540:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451947008 00000100:00100000:2.0:1762166843.560559:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166843.560589:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451947136 00000100:00100000:0.0:1762166843.560598:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451947136 00000100:00100000:3.0:1762166843.560599:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451947264 00000100:00100000:3.0:1762166843.560606:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451947264 00000100:00100000:3.0:1762166843.560621:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451947648 00000100:00100000:3.0:1762166843.560626:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451947648 00000100:00100000:2.0:1762166843.560634:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451947392 00000100:00100000:2.0:1762166843.560643:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451947392 00000100:00100000:3.0:1762166843.560660:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1762166843.560663:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451946752 00000100:00100000:0.0:1762166843.560669:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451946752 00000100:00100000:3.0:1762166843.560672:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3292:x1847765451947008:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1762166843.560687:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451947520 00000100:00100000:0.0:1762166843.560698:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1762166843.560703:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451947520 00010000:00080000:3.0:1762166843.560709:0:31205:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 464 last 0 00000100:00100000:0.0:1762166843.560711:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1847765451947136:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1762166843.560738:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1762166843.560749:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765451947392:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1762166843.560757:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 57606144 pending 0 free 3857711104 avail 3855613952 00000020:00000080:3.0:1762166843.560827:0:31205:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf915a5bdf3c9d0ad 00000004:00100000:3.0:1762166843.560854:0:31205:0:(mdt_handler.c:7253:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000000:3.0:1762166843.560864:0:31205:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee34aa0e300 00000100:00100000:2.0:1762166843.560873:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765451947392:12345-0@lo:400:kworker.0 Request processed in 124us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.560874:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1847765451947136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.560892:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1762166843.560893:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1762166843.560931:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1762166843.560934:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1762166843.560943:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765451946752:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1762166843.560947:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765451947520:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1762166843.560969:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 54329344 pending 0 free 3856662528 avail 3854565376 00000100:00100000:2.0:1762166843.561002:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765451947520:12345-0@lo:400:kworker.0 Request processed in 59us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.561013:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1762166843.561025:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765451946752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.561034:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1762166843.561081:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451946880 00000100:00100000:0.0:1762166843.561092:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451946880 00000100:00100000:2.0:1762166843.561121:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451947520:0@lo:400:kworker.0 00000100:00100000:0.0:1762166843.561140:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1762166843.561144:0:31205:0:(import.c:65:import_set_state_nolock()) ffff9ee3471c6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1762166843.561145:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451947392:0@lo:400:kworker.0 00000100:00100000:0.0:1762166843.561156:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3294:x1847765451946880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166843.561203:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3294:x1847765451946880:12345-0@lo:400:kworker.0 Request processed in 53us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.561212:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1762166843.561222:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1762166843.561230:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3292:x1847765451947264:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1762166843.561238:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1847765451947008:12345-0@lo:38:kworker.0 Request processed in 561us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.561251:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1762166843.561259:0:30819:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 464 last 0 00000100:00100000:3.0:1762166843.561286:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1762166843.561292:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451946752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166843.561302:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3292:x1847765451947648:12345-0@lo:38:kworker.0 00000020:00000080:2.0:1762166843.561303:0:30819:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf915a5bdf3c9d0b4 00000004:00100000:2.0:1762166843.561320:0:30819:0:(mdt_handler.c:7253:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000000:2.0:1762166843.561332:0:30819:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee34aa0e300 00010000:00080000:3.0:1762166843.561341:0:31205:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 464 last 0 00000100:00100000:0.0:1762166843.561356:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f1807908-b95d-4027-b65a-753b7d69e554:3294:1847765451946880:0@lo:400:kworker.0 00000100:00100000:0.0:1762166843.561377:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451947136:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1762166843.561379:0:30819:0:(import.c:65:import_set_state_nolock()) ffff9ee348aad800 : changing import state from RECOVER to FULL 00000020:00000080:3.0:1762166843.561403:0:31205:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf915a5bdf3c9d0bb 00000004:00100000:3.0:1762166843.561416:0:31205:0:(mdt_handler.c:7253:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000000:3.0:1762166843.561422:0:31205:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee34aa0e300 00000100:00100000:2.0:1762166843.561431:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1847765451947264:12345-0@lo:38:kworker.0 Request processed in 199us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.561440:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1762166843.561464:0:31205:0:(import.c:65:import_set_state_nolock()) ffff9ee3471c0000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1762166843.561503:0:3292:0:(import.c:1123:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00100000:3.0:1762166843.561533:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1847765451947648:12345-0@lo:38:kworker.0 Request processed in 232us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.561541:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1762166843.562381:0:3292:0:(import.c:1321:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9ee36dce6d80 x1847765451947008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1762166853 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1762166843.562400:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9ee36f1fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1762166843.562423:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9ee36f1fd800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1762166843.562428:0:3292:0:(import.c:1722:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1762166843.573335:0:3292:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1847765451947008:0@lo:38:kworker.0 00000100:00080000:2.0:1762166843.573386:0:3292:0:(import.c:1123:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1762166843.574281:0:3292:0:(import.c:1321:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9ee24240c700 x1847765451947264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1762166853 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1762166843.574292:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9ee37f4c7000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1762166843.574299:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9ee37f4c7000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1762166843.574303:0:3292:0:(import.c:1722:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1762166843.574308:0:3292:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1847765451947264:0@lo:38:kworker.0 00000100:00080000:2.0:1762166843.574336:0:3292:0:(import.c:1123:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1762166843.574342:0:3292:0:(import.c:951:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1762166843.574346:0:3292:0:(import.c:1204:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1762166843.574348:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9ee37f4c6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1762166843.574352:0:3292:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1847765451947648:0@lo:38:kworker.0 00000100:00100000:1.0:1762166843.578868:0:3293:0:(client.c:2512:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9ee36e2bd500 x1847765451937408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1762166843 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1762166843.579116:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765451937408:0@lo:400:kworker.0 00010000:00010000:1.0:1762166843.816897:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1762166843.977405:0:31339:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:3.0:1762166844.260103:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166844.260230:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444345088 00000100:00100000:0.0:1762166844.260248:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444345088 00000100:00100000:0.0:1762166844.260335:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 47 00000100:00100000:0.0:1762166844.260349:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+4:37765:x1847765444345088:12345-192.168.203.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1762166844.260374:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.260398:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee2439be600/0xf915a5bdf3c9d0c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f1f expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.260435:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee2439be600/0xf915a5bdf3c9d0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f1f expref: 5 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.260448:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee2439be600/0xf915a5bdf3c9d0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f1f expref: 5 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.260458:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2439be600, rc 0) 00000100:00100000:0.0:1762166844.260585:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+5:37765:x1847765444345088:12345-192.168.203.35@tcp:101:ll_cfg_requeue.0 Request processed in 239us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.260594:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 47 00000100:00100000:1.0:1762166844.261743:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166844.261806:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444345216 00000100:00100000:0.0:1762166844.261814:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444345216 00000100:00100000:0.0:1762166844.261869:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 48 00000100:00100000:0.0:1762166844.261882:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+5:37765:x1847765444345216:12345-192.168.203.35@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1762166844.261926:0:30815:0:(mgs_nids.c:896:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1762166844.261941:0:30815:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1762166844.261944:0:30815:0:(mgs_nids.c:315:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1762166844.262747:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+5:37765:x1847765444345216:12345-192.168.203.35@tcp:256:ll_cfg_requeue.0 Request processed in 863us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.262757:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 48 00000100:00100000:3.0:1762166844.264241:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166844.264363:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444345344 00000100:00100000:0.0:1762166844.264372:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444345344 00000100:00100000:0.0:1762166844.264410:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 49 00000100:00100000:0.0:1762166844.264417:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+5:37765:x1847765444345344:12345-192.168.203.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1762166844.264429:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.264442:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee2439bea00/0xf915a5bdf3c9d0c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f26 expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.264463:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee2439bea00/0xf915a5bdf3c9d0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f26 expref: 6 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.264470:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee2439bea00/0xf915a5bdf3c9d0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f26 expref: 6 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.264477:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2439bea00, rc 0) 00000100:00100000:0.0:1762166844.264530:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+6:37765:x1847765444345344:12345-192.168.203.35@tcp:101:ll_cfg_requeue.0 Request processed in 112us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.264536:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 49 00000100:00100000:1.0:1762166844.265426:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166844.265467:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444345472 00000100:00100000:0.0:1762166844.265472:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444345472 00000100:00100000:0.0:1762166844.265519:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 50 00000100:00100000:0.0:1762166844.265528:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+6:37765:x1847765444345472:12345-192.168.203.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1762166844.265661:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+7:37765:x1847765444345472:12345-192.168.203.35@tcp:501:ll_cfg_requeue.0 Request processed in 134us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.265668:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 50 00000100:00100000:3.0:1762166844.266335:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166844.266385:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444345600 00000100:00100000:0.0:1762166844.266390:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444345600 00000100:00100000:0.0:1762166844.266425:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 51 00000100:00100000:0.0:1762166844.266432:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+7:37765:x1847765444345600:12345-192.168.203.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1762166844.266599:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+7:37765:x1847765444345600:12345-192.168.203.35@tcp:503:ll_cfg_requeue.0 Request processed in 167us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.266607:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 51 00000100:00100000:3.0:1762166844.268240:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166844.268290:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444345728 00000100:00100000:0.0:1762166844.268296:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444345728 00000100:00100000:0.0:1762166844.268329:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 52 00000100:00100000:0.0:1762166844.268335:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+7:37765:x1847765444345728:12345-192.168.203.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1762166844.268343:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.268358:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee2439bf600/0xf915a5bdf3c9d0d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f2d expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.268377:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee2439bf600/0xf915a5bdf3c9d0d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f2d expref: 8 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.268384:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee2439bf600/0xf915a5bdf3c9d0d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f2d expref: 8 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.268390:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2439bf600, rc 0) 00000100:00100000:0.0:1762166844.268421:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+8:37765:x1847765444345728:12345-192.168.203.35@tcp:101:ll_cfg_requeue.0 Request processed in 86us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.268439:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 52 00000100:00100000:1.0:1762166844.269174:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166844.269231:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444345856 00000100:00100000:0.0:1762166844.269242:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444345856 00000100:00100000:0.0:1762166844.269282:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 53 00000100:00100000:0.0:1762166844.269289:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+8:37765:x1847765444345856:12345-192.168.203.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1762166844.269389:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+8:37765:x1847765444345856:12345-192.168.203.35@tcp:501:ll_cfg_requeue.0 Request processed in 100us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.269396:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 53 00000100:00100000:3.0:1762166844.270038:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166844.270082:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444345984 00000100:00100000:2.0:1762166844.270087:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444345984 00000100:00100000:2.0:1762166844.270122:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 54 00000100:00100000:2.0:1762166844.270129:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+8:37765:x1847765444345984:12345-192.168.203.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1762166844.270294:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+8:37765:x1847765444345984:12345-192.168.203.35@tcp:503:ll_cfg_requeue.0 Request processed in 165us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.270301:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 54 00000100:00100000:3.0:1762166844.272199:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166844.272262:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444346112 00000100:00100000:2.0:1762166844.272270:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444346112 00000100:00100000:2.0:1762166844.272312:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 55 00000100:00100000:2.0:1762166844.272321:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+8:37765:x1847765444346112:12345-192.168.203.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1762166844.272334:0:30813:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166844.272350:0:30813:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee245687200/0xf915a5bdf3c9d0d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f34 expref: -99 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.272372:0:30813:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee245687200/0xf915a5bdf3c9d0d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f34 expref: 9 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.272381:0:30813:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee245687200/0xf915a5bdf3c9d0d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f34 expref: 9 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.272389:0:30813:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687200, rc 0) 00000100:00100000:2.0:1762166844.272433:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:37765:x1847765444346112:12345-192.168.203.35@tcp:101:ll_cfg_requeue.0 Request processed in 114us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.272440:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 55 00000100:00100000:1.0:1762166844.273382:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166844.273426:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444346240 00000100:00100000:2.0:1762166844.273432:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444346240 00000100:00100000:2.0:1762166844.273461:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 56 00000100:00100000:2.0:1762166844.273468:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:37765:x1847765444346240:12345-192.168.203.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1762166844.273569:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:37765:x1847765444346240:12345-192.168.203.35@tcp:501:ll_cfg_requeue.0 Request processed in 101us (189us total) trans 0 rc -2/-2 00000100:00100000:2.0:1762166844.273577:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 56 00010000:00010000:2.0:1762166844.839976:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166845.268438:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.268484:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444346368 00000100:00100000:3.0:1762166845.268493:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444346368 00000100:00100000:3.0:1762166845.268575:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 21 00000100:00100000:3.0:1762166845.268587:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:46760:x1847765444346368:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166845.268602:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1762166845.268616:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1762166845.268621:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d0de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f3b expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.268671:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d0e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.268681:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.268689:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166845.268755:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:3.0:1762166845.268759:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166845.268823:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.268847:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d0de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f3b expref: 13 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.268863:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d0e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f3b expref: 12 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.268869:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee363960800) 00010000:00010000:3.0:1762166845.268871:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166845.268873:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216d000, rc 0) 00000100:00100000:3.0:1762166845.268919:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:46760:x1847765444346368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 338us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166845.268923:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 21 00000100:00100000:3.0:1762166845.270896:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166845.270953:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444346496 00000100:00100000:0.0:1762166845.270960:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444346496 00000100:00100000:0.0:1762166845.271001:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 22 00000100:00100000:0.0:1762166845.271010:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:46760:x1847765444346496:12345-192.168.203.35@tcp:41:lfs.0 00000004:00000024:0.0:1762166845.271042:0:31205:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2260074496 avail 2257977344 00000100:00100000:0.0:1762166845.271091:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:46760:x1847765444346496:12345-192.168.203.35@tcp:41:lfs.0 Request processed in 82us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166845.271098:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 22 00000100:00100000:1.0:1762166845.272138:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166845.272185:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444346624 00000100:00100000:0.0:1762166845.272190:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444346624 00000100:00100000:0.0:1762166845.272231:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 137 00000100:00080000:1.0:1762166845.272241:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166845.272241:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:46760:x1847765444346624:12345-192.168.203.35@tcp:13:lfs.0 00002000:00000024:0.0:1762166845.272266:0:8383:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 54329344 pending 0 free 3856662528 avail 3854565376 00000100:00100000:0.0:1762166845.272307:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:46760:x1847765444346624:12345-192.168.203.35@tcp:13:lfs.0 Request processed in 69us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166845.272314:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 137 00000100:00100000:3.0:1762166845.272883:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166845.272924:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444346752 00000100:00100000:0.0:1762166845.272930:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444346752 00000100:00080000:1.0:1762166845.272980:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166845.272981:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 138 00000100:00100000:0.0:1762166845.272993:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:46760:x1847765444346752:12345-192.168.203.35@tcp:13:lfs.0 00002000:00000024:0.0:1762166845.273015:0:8383:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 57606144 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1762166845.273050:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:46760:x1847765444346752:12345-192.168.203.35@tcp:13:lfs.0 Request processed in 60us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166845.273058:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 138 00000100:00100000:3.0:1762166845.285822:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166845.285892:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444346880 00000100:00100000:0.0:1762166845.285902:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444346880 00000100:00100000:0.0:1762166845.285952:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 23 00000100:00100000:0.0:1762166845.285961:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:46777:x1847765444346880:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166845.285980:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166845.285999:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d0ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f42 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166845.286057:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d0f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.286069:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d0f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.286082:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d0f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.286093:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d0fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.286100:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d0fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.286120:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d0fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.287408:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d101 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.287421:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d101 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.287430:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d101 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:0.0:1762166845.287459:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x14:0x0]: returning size 11776 00000004:00200000:0.0:1762166845.287463:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166845.287499:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d101 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.287563:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d0f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.287570:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d0f3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.287576:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d0f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.287581:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439be400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166845.287585:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d0f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.287593:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d0f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.287604:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee363960800) 00010000:00010000:0.0:1762166845.287614:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166845.287620:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d0f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.287625:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d0f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.287637:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d0fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.287642:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d0fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.287648:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d0fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.287653:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439bec00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166845.287656:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d0fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.287662:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d0fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.287670:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe7a1a38 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166845.287672:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166845.287675:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d0fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.287680:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d0fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.287710:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d0ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f42 expref: 14 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166845.287732:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d101 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f42 expref: 13 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166845.287738:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:0.0:1762166845.287740:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166845.287743:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2439bfa00, rc 0) 00000100:00100000:0.0:1762166845.287827:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:46777:x1847765444346880:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1866us (2015us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166845.287837:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 23 00000100:00100000:1.0:1762166845.289549:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166845.289605:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444347136 00000100:00100000:0.0:1762166845.289614:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444347136 00000100:00100000:0.0:1762166845.289654:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 24 00000100:00100000:0.0:1762166845.289663:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:46777:x1847765444347136:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166845.289678:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166845.289691:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d108 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f49 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166845.289750:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d10f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.289779:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d10f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.289789:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d10f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.289801:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d116 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.289821:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d116 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.289827:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d116 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.290640:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d11d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.290650:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d11d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.290657:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d11d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:0.0:1762166845.290665:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x15:0x0]: returning size 0 00010000:00010000:0.0:1762166845.290812:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d10f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.290819:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d10f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.290825:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d10f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.290829:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439bf800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166845.290832:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d10f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.290838:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d10f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.290848:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:0.0:1762166845.290856:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166845.290860:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d10f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.290866:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d10f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.290875:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d116 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.290881:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d116 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.290886:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d116 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.290890:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439bf400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166845.290892:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d116 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.290898:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d116 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.290904:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0xaf1e71b4 (ffff9ee34bdb4c00) 00010000:00010000:0.0:1762166845.290906:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166845.290908:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d116 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.290913:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d116 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.290946:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d108 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f49 expref: 16 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166845.290968:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d11d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f49 expref: 15 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166845.290975:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166845.290977:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166845.290979:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2439be000, rc 0) 00000100:00100000:0.0:1762166845.291031:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:46777:x1847765444347136:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1369us (1492us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1762166845.291039:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 24 00000100:00100000:3.0:1762166845.292227:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166845.292280:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444347392 00000100:00100000:0.0:1762166845.292287:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444347392 00000100:00100000:0.0:1762166845.292327:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 0 00000100:00100000:0.0:1762166845.292338:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:46777:x1847765444347392:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166845.292484:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:46777:x1847765444347392:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 147us (256us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1762166845.292491:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 0 00000100:00100000:3.0:1762166845.293582:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166845.293641:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444347648 00000100:00100000:0.0:1762166845.293647:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444347648 00000100:00100000:0.0:1762166845.293686:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 25 00000100:00100000:0.0:1762166845.293694:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:46777:x1847765444347648:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166845.293705:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166845.293720:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d12b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f50 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166845.293800:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d132 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.293822:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d132 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.293832:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d132 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:0.0:1762166845.293843:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x15:0x0]: returning size 0 00010000:00010000:0.0:1762166845.293906:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d12b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f50 expref: 19 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166845.293916:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d132 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f50 expref: 18 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166845.293921:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166845.293923:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166845.293925:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2439be200, rc 0) 00000100:00100000:0.0:1762166845.293955:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:46777:x1847765444347648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 263us (377us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1762166845.293959:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 25 00000100:00100000:1.0:1762166845.295330:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166845.295374:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444347904 00000100:00100000:0.0:1762166845.295381:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444347904 00000100:00100000:0.0:1762166845.295417:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 26 00000100:00100000:0.0:1762166845.295425:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:46777:x1847765444347904:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166845.295441:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166845.295451:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfc00/0xf915a5bdf3c9d140 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f57 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166845.295497:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d147 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.295528:0:31205:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d11d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f49 expref: 19 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166845.295535:0:31205:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d147 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x15:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.295565:0:31205:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d11d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f49 expref: 19 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166845.295574:0:31205:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d11d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f49 expref: 19 pid: 31205 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1762166845.295584:0:31205:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:31205:1847765451947776:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166845.295641:0:31205:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166845.296459:0:31205:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:31205:1847765451947776:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166845.296477:0:31205:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d147 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x15:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000100:00100000:1.0:1762166845.296799:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166845.296888:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444348032 00000100:00100000:0.0:1762166845.296894:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444348032 00010000:00010000:0.0:1762166845.296917:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d11d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f49 expref: 20 pid: 31205 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1762166845.296945:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 601 00000100:00100000:0.0:1762166845.296953:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444348032:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166845.296963:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166845.296969:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d11d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f49 expref: 20 pid: 31205 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1762166845.296990:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d11d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f49 expref: 20 pid: 31205 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1762166845.297006:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d11d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f49 expref: 20 pid: 31205 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1762166845.297018:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166845.297022:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d147 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x15:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.297029:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d147 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x15:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.297035:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d147 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x15:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166845.297060:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166845.297084:0:31205:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d147 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x15:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.297093:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d147 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x15:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000100:00100000:0.0:1762166845.297099:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765444348032:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 145us (299us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166845.297107:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x15:0x0]: returning size 0 00000100:00100000:0.0:1762166845.297110:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 601 00010000:00010000:3.0:1762166845.297240:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfc00/0xf915a5bdf3c9d140 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f57 expref: 20 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.297250:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d147 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x15:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f57 expref: 19 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.297254:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:3.0:1762166845.297256:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166845.297258:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2439bf200, rc 0) 00000100:00100000:3.0:1762166845.297284:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:46777:x1847765444347904:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1862us (1958us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1762166845.297289:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 26 00000100:00100000:1.0:1762166845.298137:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166845.298173:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444348160 00000100:00100000:0.0:1762166845.298177:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444348160 00000100:00100000:0.0:1762166845.298209:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1 00000100:00100000:0.0:1762166845.298218:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:46777:x1847765444348160:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:0.0:1762166845.298289:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:46777:x1847765444348160:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 72us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166845.298296:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1 00000100:00100000:0.0:1762166845.298921:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.298957:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444348416 00000100:00100000:3.0:1762166845.298963:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444348416 00000100:00100000:3.0:1762166845.299007:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2 00000100:00100000:3.0:1762166845.299015:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:46777:x1847765444348416:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166845.299135:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:46777:x1847765444348416:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 121us (215us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1762166845.299140:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2 00000100:00100000:1.0:1762166845.299997:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.300085:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444348672 00000100:00100000:3.0:1762166845.300096:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444348672 00000100:00100000:3.0:1762166845.300153:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 27 00000100:00100000:3.0:1762166845.300167:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:46777:x1847765444348672:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166845.300188:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166845.300191:0:31205:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1762166845.300223:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d147 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x15:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f57 expref: 20 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.300258:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d132 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x15:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f50 expref: 19 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.300265:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:3.0:1762166845.300275:0:31205:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166845.300294:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d155 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f5e expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.300391:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d15c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.300403:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d15c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.300412:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d15c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166845.300424:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x15:0x0]: returning size 0 00010000:00010000:3.0:1762166845.300554:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d155 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x15:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f5e expref: 21 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.300570:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d15c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f5e expref: 20 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.300575:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee363960600) 00010000:00010000:3.0:1762166845.300577:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166845.300579:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216d400, rc 0) 00000100:00100000:3.0:1762166845.300625:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:46777:x1847765444348672:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 464us (640us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1762166845.300637:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 27 00000100:00100000:1.0:1762166845.301695:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.301734:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444348928 00000100:00100000:3.0:1762166845.301740:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444348928 00000100:00100000:3.0:1762166845.301806:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3 00000100:00100000:3.0:1762166845.301814:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:46777:x1847765444348928:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166845.301814:0:30820:0:(service.c:3434:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1762166845.301828:0:30820:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00010000:3.0:1762166845.301863:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x15:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d15c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f5e expref: 20 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.301891:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d16a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.301902:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d16a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.301911:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d16a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.302169:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d16a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.302178:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d16a lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.302185:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d16a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.302192:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166845.302196:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d16a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.302204:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d16a lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.302223:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee363960600) 00010000:00010000:3.0:1762166845.302226:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166845.302231:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d16a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.302237:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d16a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.302249:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee363960600) 00010000:00010000:3.0:1762166845.302251:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166845.302255:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d15c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x15:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f5e expref: 20 pid: 31205 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166845.302404:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:46777:x1847765444348928:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 589us (711us total) trans 8589934599 rc -22/-22 00000100:00100000:3.0:1762166845.302413:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3 00000100:00100000:0.0:1762166845.308434:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.308515:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444349056 00000100:00100000:3.0:1762166845.308532:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444349056 00000100:00100000:3.0:1762166845.308608:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 28 00000100:00100000:3.0:1762166845.308620:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:46777:x1847765444349056:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166845.308648:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166845.308675:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d171 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f65 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.308741:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d171 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f65 expref: 21 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.308759:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d171 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f65 expref: 21 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.308834:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee363960f00) 00010000:00010000:3.0:1762166845.308839:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166845.308843:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216cc00, rc 0) 00000100:00100000:3.0:1762166845.308915:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:46777:x1847765444349056:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 296us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166845.308924:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 28 00000100:00100000:0.0:1762166845.310305:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.310344:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444349312 00000100:00100000:3.0:1762166845.310351:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444349312 00000100:00100000:3.0:1762166845.310396:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 29 00000100:00100000:3.0:1762166845.310406:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:46777:x1847765444349312:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166845.310421:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166845.310425:0:31205:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1762166845.310450:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d101 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f42 expref: 21 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.310466:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:3.0:1762166845.310476:0:31205:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166845.310489:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d178 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f6c expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.311254:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d17f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.311269:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d17f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.311278:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d17f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166845.311300:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17:0x0]: returning size 0 00010000:00010000:3.0:1762166845.311348:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d178 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f6c expref: 23 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.311382:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d17f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f6c expref: 22 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.311389:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17:0x0].0x0 (ffff9ee363960a00) 00010000:00010000:3.0:1762166845.311392:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166845.311395:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216ce00, rc 0) 00000100:00100000:3.0:1762166845.311453:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:46777:x1847765444349312:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1047us (1153us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1762166845.311460:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 29 00000100:00100000:0.0:1762166845.312946:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.313006:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444349568 00000100:00100000:3.0:1762166845.313021:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444349568 00000100:00100000:3.0:1762166845.313085:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 30 00000100:00100000:3.0:1762166845.313096:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:46777:x1847765444349568:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166845.313118:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166845.313137:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d600/0xf915a5bdf3c9d18d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f73 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.313226:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d194 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.313240:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d194 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.313249:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d194 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166845.313275:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x15:0x0]: returning size 0 00010000:00010000:3.0:1762166845.313385:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d600/0xf915a5bdf3c9d18d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x15:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f73 expref: 25 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.313404:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d194 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f73 expref: 24 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.313413:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee363960f00) 00010000:00010000:3.0:1762166845.313416:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166845.313419:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216c400, rc 0) 00000100:00100000:3.0:1762166845.313492:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:46777:x1847765444349568:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 399us (552us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1762166845.313500:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 30 00000100:00100000:0.0:1762166845.314610:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.314644:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444349824 00000100:00100000:3.0:1762166845.314648:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444349824 00000100:00100000:3.0:1762166845.314676:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 4 00000100:00100000:3.0:1762166845.314681:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:46777:x1847765444349824:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:3.0:1762166845.314719:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x15:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d194 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f73 expref: 24 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.314740:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1a2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.314752:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d171 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f65 expref: 24 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.314759:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1a2 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.314823:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d171 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f65 expref: 24 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.314837:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d171 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f65 expref: 24 pid: 31205 timeout: 566 lvb_type: 0 00000100:00100000:3.0:1762166845.314849:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451947904:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166845.314922:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166845.315739:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451947904:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166845.315788:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1a2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166845.316232:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166845.316298:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444349952 00000100:00100000:2.0:1762166845.316304:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444349952 00010000:00010000:2.0:1762166845.316338:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d171 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f65 expref: 25 pid: 31205 timeout: 566 lvb_type: 0 00000100:00100000:2.0:1762166845.316377:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 602 00000100:00100000:2.0:1762166845.316386:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3456e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444349952:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166845.316397:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166845.316408:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d171 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f65 expref: 25 pid: 31205 timeout: 566 lvb_type: 0 00010000:00010000:2.0:1762166845.316419:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d171 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f65 expref: 25 pid: 31205 timeout: 566 lvb_type: 0 00010000:00010000:2.0:1762166845.316433:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d171 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f65 expref: 25 pid: 31205 timeout: 566 lvb_type: 0 00010000:00010000:2.0:1762166845.316446:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee363960f00) 00010000:00010000:2.0:1762166845.316449:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1a2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166845.316456:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1a2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166845.316463:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1a2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166845.316488:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166845.316523:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1a2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.316533:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1a2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166845.316544:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3456e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765444349952:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 158us (312us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166845.316551:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d1a9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166845.316556:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 602 00010000:00010000:3.0:1762166845.316568:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d17f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f6c expref: 24 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.316577:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d1a9 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.316601:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d17f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f6c expref: 23 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.316626:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d17f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f6c expref: 23 pid: 31205 timeout: 566 lvb_type: 0 00000100:00100000:3.0:1762166845.316638:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451948032:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166845.316722:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166845.317455:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451948032:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166845.317472:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d1a9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166845.317808:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166845.317849:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444350080 00000100:00100000:2.0:1762166845.317862:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444350080 00010000:00010000:2.0:1762166845.317883:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d17f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f6c expref: 24 pid: 31205 timeout: 566 lvb_type: 0 00000100:00100000:2.0:1762166845.317912:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 603 00000100:00100000:2.0:1762166845.317919:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444350080:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166845.317927:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166845.317931:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d17f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f6c expref: 24 pid: 31205 timeout: 566 lvb_type: 0 00010000:00010000:2.0:1762166845.317938:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d17f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f6c expref: 24 pid: 31205 timeout: 566 lvb_type: 0 00010000:00010000:2.0:1762166845.317950:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d17f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f6c expref: 24 pid: 31205 timeout: 566 lvb_type: 0 00010000:00010000:2.0:1762166845.317959:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17:0x0].0x0 (ffff9ee363960a00) 00010000:00010000:2.0:1762166845.317961:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d1a9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166845.317966:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d1a9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166845.317970:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d1a9 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166845.317985:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166845.317997:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d1a9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.318006:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d1a9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166845.318011:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444350080:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 91us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166845.318017:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 603 00000100:00100000:3.0:1762166845.318419:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451948160:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166845.318464:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166845.318498:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166845.318567:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451948160 00000100:00100000:2.0:1762166845.318572:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451948160 00000100:00100000:2.0:1762166845.318624:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1762166845.318632:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30821:x1847765451948160:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1762166845.318641:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166845.318701:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30821:x1847765451948160:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 69us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166845.318708:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1762166845.318733:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451948160:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1762166845.318812:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934602 00000001:00080000:3.0:1762166845.318872:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934603 00010000:00010000:3.0:1762166845.318892:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d1a9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.318897:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d1a9 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x17:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.318901:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d1a9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.318910:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166845.318912:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d1a9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.318918:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d1a9 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x17:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.318924:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17:0x0].0x0 (ffff9ee363960a00) 00010000:00010000:3.0:1762166845.318926:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166845.318928:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d1a9 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x17:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.318932:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d1a9 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x17:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.318945:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1a2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.318951:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1a2 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.318956:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1a2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.318960:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166845.318962:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1a2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.318967:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1a2 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.318974:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee363960f00) 00010000:00010000:3.0:1762166845.318976:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166845.318984:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1a2 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.318989:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1a2 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.319001:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee363960f00) 00010000:00010000:3.0:1762166845.319004:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166845.319009:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d194 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x15:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f73 expref: 25 pid: 31205 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166845.319066:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:46777:x1847765444349824:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 4384us (4458us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1762166845.319072:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 4 00000020:00080000:3.0:1762166845.319074:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166845.320747:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.320813:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444350208 00000100:00100000:3.0:1762166845.320819:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444350208 00000100:00100000:3.0:1762166845.320863:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 31 00000100:00100000:3.0:1762166845.320873:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:46777:x1847765444350208:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166845.320887:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166845.320904:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044e00/0xf915a5bdf3c9d1b0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f7a expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.320947:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044e00/0xf915a5bdf3c9d1b0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f7a expref: 25 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.320964:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044e00/0xf915a5bdf3c9d1b0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f7a expref: 25 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.320980:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee363960600) 00010000:00010000:3.0:1762166845.320991:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166845.320994:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382044e00, rc 0) 00000100:00100000:3.0:1762166845.321036:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:46777:x1847765444350208:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 164us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166845.321043:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 31 00000100:00100000:0.0:1762166845.323027:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.323065:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444350464 00000100:00100000:3.0:1762166845.323073:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444350464 00000100:00100000:3.0:1762166845.323114:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 5 00000100:00100000:3.0:1762166845.323126:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:46777:x1847765444350464:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:3.0:1762166845.323492:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x17:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1762166845.323603:0:30821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 64 off8320 00000004:00080000:3.0:1762166845.323614:0:30821:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 466115850253ns, next at 467115847658ns, rc = 0 00000001:00080000:3.0:1762166845.323620:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934605 00010000:00010000:3.0:1762166845.323662:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1b7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.323675:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1b7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.323683:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1b7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.323690:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1b7 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.323696:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1b7 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.323701:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1b7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166845.323721:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166845.323746:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166845.323755:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1b7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166845.323788:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166845.323793:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1b7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166845.323801:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1b7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166845.323811:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17:0x0].0x0 (ffff9ee363960000) 00010000:00010000:2.0:1762166845.323814:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166845.323817:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1b7 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166845.323821:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1b7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166845.323835:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166845.323836:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166845.323837:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166845.323852:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:46777:x1847765444350464:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 728us (827us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1762166845.323861:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 5 00000020:00080000:3.0:1762166845.323866:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166845.324797:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.324837:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444350720 00000100:00100000:3.0:1762166845.324844:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444350720 00000100:00100000:3.0:1762166845.324879:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 6 00000100:00100000:3.0:1762166845.324887:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:46777:x1847765444350720:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166845.325058:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:46777:x1847765444350720:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 172us (264us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1762166845.325066:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 6 00000100:00100000:0.0:1762166845.337206:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.337260:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444350848 00000100:00100000:3.0:1762166845.337268:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444350848 00000100:00100000:3.0:1762166845.337314:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 32 00000100:00100000:3.0:1762166845.337321:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:46788:x1847765444350848:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166845.337338:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166845.337354:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d1be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f81 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.337412:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d1c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337425:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d1c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337436:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d1c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337447:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d1cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337467:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d1cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337473:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d1cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337581:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d1d3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337589:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337593:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166845.337617:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x14:0x0]: returning size 11776 00000004:00200000:3.0:1762166845.337620:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166845.337639:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337650:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d1c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337657:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d1c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337663:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d1c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337668:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382044600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166845.337672:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d1c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337678:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d1c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337695:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee363960800) 00010000:00010000:3.0:1762166845.337699:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166845.337704:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d1c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337709:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d1c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337722:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d1cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337726:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d1cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337729:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d1cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337732:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382044a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166845.337733:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d1cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337736:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d1cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337740:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe7a1a38 (ffff9ee363960f00) 00010000:00010000:3.0:1762166845.337742:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166845.337743:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d1cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337746:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d1cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.337800:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d1be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f81 expref: 30 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.337815:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f81 expref: 29 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.337821:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee363960a00) 00010000:00010000:3.0:1762166845.337823:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166845.337824:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382045800, rc 0) 00000100:00100000:3.0:1762166845.337875:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:46788:x1847765444350848:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 553us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166845.337882:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 32 00000100:00100000:0.0:1762166845.339356:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.339395:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444351104 00000100:00100000:3.0:1762166845.339402:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444351104 00000100:00100000:3.0:1762166845.339441:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 33 00000100:00100000:3.0:1762166845.339449:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:46788:x1847765444351104:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166845.339462:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166845.339475:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9d1da lrc: 2/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f88 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.339536:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d1e1 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339547:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d1e1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339555:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d1e1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339567:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1e8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339587:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339593:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339674:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d1e1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339680:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d1e1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339686:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d1e1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339690:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166845.339694:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d1e1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339700:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d1e1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339710:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee363960a00) 00010000:00010000:3.0:1762166845.339713:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166845.339716:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d1e1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339722:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d1e1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339733:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339738:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1e8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339748:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1e8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339752:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166845.339755:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1e8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339781:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1e8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339788:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0xaf1e71b4 (ffff9ee363960500) 00010000:00010000:3.0:1762166845.339790:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166845.339793:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1e8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339798:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d1e8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.339823:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9d1da lrc: 1/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f88 expref: 30 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.339832:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee363960a00) 00010000:00010000:3.0:1762166845.339834:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166845.339838:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9d1da lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f88 expref: 30 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.339845:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382045600, rc 0) 00000100:00100000:3.0:1762166845.339888:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:46788:x1847765444351104:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 439us (536us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166845.339895:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 33 00000100:00100000:1.0:1762166845.341170:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.341207:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444351360 00000100:00100000:3.0:1762166845.341213:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444351360 00000100:00100000:3.0:1762166845.341246:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 34 00000100:00100000:3.0:1762166845.341253:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:46788:x1847765444351360:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166845.341264:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166845.341276:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d1ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f8f expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1762166845.341343:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x14:0x0]: returning size 11776 00010000:00010000:3.0:1762166845.341440:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d1ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f8f expref: 31 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.341450:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee363960800) 00010000:00010000:3.0:1762166845.341453:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166845.341456:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d1ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f8f expref: 31 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.341467:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216c400, rc 0) 00000100:00100000:3.0:1762166845.341514:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:46788:x1847765444351360:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 249us (336us total) trans 8589934608 rc 301/301 00000100:00100000:3.0:1762166845.341523:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 34 00000100:00100000:0.0:1762166845.342532:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.342567:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444351488 00000100:00100000:3.0:1762166845.342572:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444351488 00000100:00100000:3.0:1762166845.342608:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 35 00000100:00100000:3.0:1762166845.342615:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:46788:x1847765444351488:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:3.0:1762166845.342652:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1fd lrc: 3/1,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342664:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1fd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342681:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1fd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342694:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d204 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342700:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d204 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342705:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d204 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342810:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d20b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342818:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d20b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342824:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d20b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166845.342847:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x15:0x0]: returning size 0 00000004:00200000:3.0:1762166845.342851:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166845.342857:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d20b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342867:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1fd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342873:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1fd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342879:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1fd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342892:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166845.342896:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1fd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342902:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1fd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342911:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee363960a00) 00010000:00010000:3.0:1762166845.342914:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166845.342917:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1fd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342923:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d1fd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342933:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d204 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342938:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d204 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342943:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d204 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342947:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166845.342950:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d204 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342955:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d204 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342959:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0xaf1e71b4 (ffff9ee363960e00) 00010000:00010000:3.0:1762166845.342966:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166845.342969:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d204 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342974:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d204 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342985:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d20b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342989:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d20b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342995:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d20b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.342999:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166845.343002:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d20b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.343007:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d20b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.343012:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee363960600) 00010000:00010000:3.0:1762166845.343014:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166845.343016:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d20b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.343021:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d20b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00000100:00100000:3.0:1762166845.343067:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:46788:x1847765444351488:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 451us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166845.343075:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 35 00000100:00100000:0.0:1762166845.344056:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.344094:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444351744 00000100:00100000:3.0:1762166845.344100:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444351744 00000100:00100000:3.0:1762166845.344134:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7 00000100:00100000:3.0:1762166845.344140:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:46788:x1847765444351744:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166845.344305:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:46788:x1847765444351744:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 164us (251us total) trans 8589934609 rc 0/0 00000100:00100000:3.0:1762166845.344324:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7 00000100:00100000:1.0:1762166845.351120:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.351191:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444352000 00000100:00100000:3.0:1762166845.351199:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444352000 00000100:00100000:3.0:1762166845.351260:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 36 00000100:00100000:3.0:1762166845.351270:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:46790:x1847765444352000:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166845.351291:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166845.351295:0:31205:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1762166845.351322:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d1d3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f81 expref: 31 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.351336:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee363960a00) 00010000:00010000:3.0:1762166845.351346:0:31205:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166845.351357:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d212 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f96 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.351487:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d219 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351498:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d219 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351519:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d219 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351547:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d220 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351554:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d220 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351559:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d220 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351631:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d227 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351639:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d227 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351646:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d227 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166845.351655:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x15:0x0]: returning size 0 00010000:00010000:3.0:1762166845.351746:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d219 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351752:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d219 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351757:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d219 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351781:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166845.351784:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d219 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351789:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d219 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351800:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee363960e00) 00010000:00010000:3.0:1762166845.351802:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166845.351805:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d219 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351809:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d219 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351815:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d220 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351818:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d220 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351821:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d220 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351824:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166845.351826:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d220 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351829:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d220 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351832:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0xaf1e71b4 (ffff9ee363960500) 00010000:00010000:3.0:1762166845.351834:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166845.351835:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d220 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351838:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d220 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.351874:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d212 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f96 expref: 33 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.351888:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d227 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f96 expref: 32 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.351893:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee363960600) 00010000:00010000:3.0:1762166845.351894:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166845.351896:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216c400, rc 0) 00000100:00100000:3.0:1762166845.351944:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:46790:x1847765444352000:12345-192.168.203.35@tcp:101:dd.0 Request processed in 675us (831us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1762166845.351951:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 36 00000100:00100000:0.0:1762166845.353529:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.353570:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444352128 00000100:00100000:3.0:1762166845.353577:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444352128 00000100:00100000:3.0:1762166845.353624:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 37 00000100:00100000:3.0:1762166845.353633:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:46790:x1847765444352128:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166845.353648:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166845.353662:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d235 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90f9d expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.353686:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d600/0xf915a5bdf3c9d23c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.353696:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d600/0xf915a5bdf3c9d23c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.353705:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d600/0xf915a5bdf3c9d23c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.353797:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d235 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f9d expref: 34 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.353824:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d600/0xf915a5bdf3c9d23c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f9d expref: 33 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.353832:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee363960600) 00010000:00010000:3.0:1762166845.353836:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1762166845.353839:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216d600, rc 0) 00000100:00100000:3.0:1762166845.353884:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:46790:x1847765444352128:12345-192.168.203.35@tcp:101:dd.0 Request processed in 252us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166845.353890:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 37 00000100:00100000:0.0:1762166845.355105:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.355147:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444352384 00000100:00100000:3.0:1762166845.355196:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444352384 00000100:00100000:3.0:1762166845.355234:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 38 00000100:00100000:3.0:1762166845.355243:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:46790:x1847765444352384:12345-192.168.203.35@tcp:36:dd.0 00010000:00010000:3.0:1762166845.355275:0:31205:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166845.355292:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d227 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f96 expref: 33 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.355305:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee363960600) 00010000:00010000:3.0:1762166845.355308:0:31205:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166845.355473:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d243 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.355485:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d243 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.355493:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d243 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000001:00080000:3.0:1762166845.355568:0:31205:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934611 00000004:00010000:3.0:1762166845.355594:0:31205:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005091aca4 reply state 00000000b0056d94 transno 8589934612 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d243 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000100:00100000:3.0:1762166845.355603:0:31205:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166845.355676:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:46790:x1847765444352384:12345-192.168.203.35@tcp:36:dd.0 Request processed in 433us (571us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1762166845.355687:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 38 00000020:00080000:3.0:1762166845.355691:0:31205:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762166845.356362:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d243 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.356372:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d243 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.356378:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d243 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.356383:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166845.356386:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d243 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.356393:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d243 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.356403:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee363960600) 00010000:00010000:3.0:1762166845.356406:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166845.356409:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d243 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.356415:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d243 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00000100:00100000:0.0:1762166845.356671:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166845.356727:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444352512 00000100:00100000:2.0:1762166845.356734:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444352512 00000100:00100000:2.0:1762166845.356807:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 985 00000100:00100000:2.0:1762166845.356826:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:46790:x1847765444352512:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:2.0:1762166845.356839:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166845.356850:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9d24a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90fa4 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166845.356867:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cc62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ef5 expref: 8 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166845.356873:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166845.356874:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166845.356877:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9d24a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fa4 expref: 8 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166845.356902:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cc62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ef5 expref: 8 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166845.356914:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cc62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ef5 expref: 8 pid: 12400 timeout: 566 lvb_type: 1 00000100:00100000:2.0:1762166845.356927:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451948288:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166845.356991:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243611cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166845.357912:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451948288:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166845.357931:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9d24a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fa4 expref: 8 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166845.357945:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687a00, rc 0) 00000100:00100000:2.0:1762166845.357997:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:46790:x1847765444352512:12345-192.168.203.35@tcp:101:dd.0 Request processed in 1173us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166845.358004:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 985 00000100:00100000:1.0:1762166845.358106:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166845.358198:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444352640 00000100:00100000:2.0:1762166845.358204:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444352640 00010000:00010000:2.0:1762166845.358225:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cc62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ef5 expref: 8 pid: 12400 timeout: 566 lvb_type: 1 00000100:00100000:2.0:1762166845.358255:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 604 00000100:00100000:2.0:1762166845.358261:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2361:x1847765444352640:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166845.358270:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166845.358273:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cc62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ef5 expref: 8 pid: 12400 timeout: 566 lvb_type: 1 00010000:00010000:2.0:1762166845.358283:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cc62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ef5 expref: 8 pid: 12400 timeout: 566 lvb_type: 1 00010000:00010000:2.0:1762166845.358303:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9cc62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ef5 expref: 8 pid: 12400 timeout: 566 lvb_type: 1 00010000:00010000:2.0:1762166845.358313:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166845.358315:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166845.358320:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9d24a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fa4 expref: 7 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166845.358329:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9d24a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fa4 expref: 7 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166845.358366:0:5741:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee245687a00/0xf915a5bdf3c9d24a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fa4 expref: 7 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166845.358377:0:5741:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5741:1847765451948416:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762166845.358421:0:5741:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243611cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166845.359444:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166845.359445:0:5741:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5741:1847765451948416:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762166845.359460:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166845.359514:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2361:x1847765444352640:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1242us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166845.359523:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 604 00000100:00100000:1.0:1762166845.359665:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444352768 00000100:00100000:1.0:1762166845.359697:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444352768 00002000:00010000:1.0:1762166845.359741:0:26247:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/96 (0->18446744073709551615) 00002000:00100000:1.0:1762166845.359746:0:26247:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047ce00 with x1847765444352768 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166845.359760:0:26247:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee35047ce00. 00000100:00100000:1.0:1762166845.359839:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 970 00000100:00100000:1.0:1762166845.359848:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2361:x1847765444352768:12345-192.168.203.35@tcp:10:dd.0 00002000:00010000:1.0:1762166845.360204:0:26247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x60:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166845.360208:0:26247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x60:0x0] updating lvb mtime from disk: 1762166824 -> 1762166845 00002000:00010000:1.0:1762166845.360211:0:26247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x60:0x0] updating lvb atime from disk: 1762166824 -> 1762166824 00002000:00010000:1.0:1762166845.360214:0:26247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x60:0x0] updating lvb ctime from disk: 1762166824 -> 1762166845 00002000:00010000:1.0:1762166845.360216:0:26247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x60:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762166845.360288:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2361:x1847765444352768:12345-192.168.203.35@tcp:10:dd.0 Request processed in 440us (847us total) trans 17179869423 rc 0/0 00000100:00100000:1.0:1762166845.360295:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 970 00002000:00010000:1.0:1762166845.360299:0:26247:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/96 (0->18446744073709551615) 00002000:00100000:1.0:1762166845.360301:0:26247:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047ce00 with x1847765444352768 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166845.360305:0:26247:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee35047ce00. 00000100:00100000:0.0:1762166845.370616:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166845.370669:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.370727:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444353152 00000100:00100000:1.0:1762166845.370729:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444352896 00000100:00100000:3.0:1762166845.370739:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444353152 00000100:00100000:1.0:1762166845.370743:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444352896 00000100:00100000:3.0:1762166845.370848:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 8 00002000:00100000:1.0:1762166845.370858:0:26247:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x60:0x0] (0->1048575) req@ffff9ee36dce5500 x1847765444352896/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:631/0 lens 488/0 e 0 to 0 dl 1762166856 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1762166845.370860:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:46790:x1847765444353152:12345-192.168.203.35@tcp:35:dd.0 00002000:00100000:1.0:1762166845.370887:0:26247:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce5500 with x1847765444352896 ext(0->1048575) 00002000:00010000:1.0:1762166845.370894:0:26247:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dce5500 00000100:00100000:1.0:1762166845.370937:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 971 00000100:00100000:1.0:1762166845.370946:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444352896:12345-192.168.203.35@tcp:4:dd.0 00000100:00100000:3.0:1762166845.371248:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:46790:x1847765444353152:12345-192.168.203.35@tcp:35:dd.0 Request processed in 388us (576us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1762166845.371257:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 8 00000100:00100000:1.0:1762166845.377612:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2360:x1847765444352896:12345-192.168.203.35@tcp:4:dd.0 Request processed in 6656us (6995us total) trans 17179869424 rc 0/0 00000100:00100000:1.0:1762166845.377623:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 971 00002000:00100000:1.0:1762166845.377633:0:26247:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x60:0x0] (0->1048575) req@ffff9ee36dce5500 x1847765444352896/t17179869424(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:631/0 lens 488/448 e 0 to 0 dl 1762166856 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166845.377640:0:26247:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce5500 with x1847765444352896 ext(0->1048575) 00002000:00010000:1.0:1762166845.377646:0:26247:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dce5500 00000100:00100000:0.0:1762166845.379686:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.379732:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444353280 00000100:00100000:3.0:1762166845.379742:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444353280 00000100:00100000:3.0:1762166845.379804:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 39 00000100:00100000:3.0:1762166845.379811:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:46791:x1847765444353280:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166845.379827:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166845.379842:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d251 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90fab expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.379905:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d258 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.379915:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d258 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.379922:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d258 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.379931:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d25f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.379935:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d25f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.379946:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d25f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.380032:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d266 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.380037:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d266 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.380044:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d266 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166845.380075:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x14:0x0]: returning size 11776 00000004:00200000:3.0:1762166845.380080:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166845.380101:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d266 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.380111:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d258 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.380117:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d258 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.380123:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d258 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.380128:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166845.380132:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d258 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.380138:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d258 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.380149:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee363960800) 00010000:00010000:3.0:1762166845.380159:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166845.380163:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d258 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.380167:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d258 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.380177:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d25f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.380180:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d25f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.380184:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d25f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.380187:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166845.380188:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d25f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.380191:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d25f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.380195:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe7a1a38 (ffff9ee363960e00) 00010000:00010000:3.0:1762166845.380197:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166845.380198:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d25f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.380201:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d25f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166845.380225:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d251 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fab expref: 37 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.380248:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d266 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fab expref: 36 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166845.380256:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee363960500) 00010000:00010000:3.0:1762166845.380258:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166845.380260:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216ce00, rc 0) 00000100:00100000:3.0:1762166845.380316:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:46791:x1847765444353280:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 499us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166845.380326:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 39 00000100:00100000:0.0:1762166845.381517:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166845.381691:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444353536 00000100:00100000:3.0:1762166845.381696:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444353536 00000100:00100000:3.0:1762166845.381735:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 40 00000100:00100000:3.0:1762166845.381742:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:46791:x1847765444353536:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166845.381754:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166845.381795:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d26d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90fb2 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166845.381904:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d274 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.381915:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d274 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.381924:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d274 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.381936:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d27b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.381942:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d27b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.381947:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d27b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.382013:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d274 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.382028:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d274 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.382033:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d274 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.382038:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166845.382041:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d274 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.382047:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d274 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.382056:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee363960500) 00010000:00010000:2.0:1762166845.382058:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166845.382061:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d274 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.382066:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d274 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.382076:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d27b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.382081:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d27b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.382085:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d27b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.382090:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166845.382092:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d27b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.382112:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d27b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.382119:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0xaf1e71b4 (ffff9ee360714600) 00010000:00010000:2.0:1762166845.382122:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166845.382125:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d27b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.382131:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d27b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.382158:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d26d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fb2 expref: 37 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166845.382167:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee363960500) 00010000:00010000:2.0:1762166845.382169:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166845.382173:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d26d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fb2 expref: 37 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166845.382182:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216d400, rc 0) 00000100:00100000:2.0:1762166845.382228:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:46791:x1847765444353536:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 486us (726us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166845.382234:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 40 00000100:00100000:0.0:1762166845.383497:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166845.383548:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444353792 00000100:00100000:2.0:1762166845.383554:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444353792 00000100:00100000:2.0:1762166845.383594:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 41 00000100:00100000:2.0:1762166845.383604:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:46791:x1847765444353792:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166845.383617:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166845.383640:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9d282 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90fb9 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166845.383722:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686200/0xf915a5bdf3c9d289 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.383733:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686200/0xf915a5bdf3c9d289 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.383748:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686200/0xf915a5bdf3c9d289 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:2.0:1762166845.383759:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x14:0x0]: returning size 11776 00010000:00010000:2.0:1762166845.383895:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9d282 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fb9 expref: 39 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166845.383909:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686200/0xf915a5bdf3c9d289 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fb9 expref: 38 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166845.383917:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee363960500) 00010000:00010000:2.0:1762166845.383920:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166845.383923:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686200, rc 0) 00000100:00100000:2.0:1762166845.383968:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:46791:x1847765444353792:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 366us (475us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1762166845.383976:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 41 00000100:00100000:0.0:1762166845.385064:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166845.385094:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444353920 00000100:00100000:2.0:1762166845.385099:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444353920 00000100:00100000:2.0:1762166845.385130:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 42 00000100:00100000:2.0:1762166845.385139:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:46791:x1847765444353920:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166845.385180:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d297 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385200:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d297 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385208:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d297 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385220:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d29e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385226:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d29e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385232:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d29e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385305:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9d2a5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385313:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9d2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385320:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9d2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:2.0:1762166845.385343:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x15:0x0]: returning size 1048576 00000004:00200000:2.0:1762166845.385347:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166845.385354:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9d2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385363:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d297 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385376:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d297 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385393:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d297 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385399:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166845.385402:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d297 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385408:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d297 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385418:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee363960500) 00010000:00010000:2.0:1762166845.385421:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166845.385425:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d297 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385430:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d297 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385440:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d29e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385446:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d29e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385451:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d29e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385456:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166845.385458:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d29e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385464:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d29e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385476:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0xaf1e71b4 (ffff9ee360714200) 00010000:00010000:2.0:1762166845.385478:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166845.385481:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d29e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385487:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d29e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385500:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9d2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385520:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9d2a5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385526:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9d2a5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385531:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166845.385533:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9d2a5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385540:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9d2a5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385546:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee363960600) 00010000:00010000:2.0:1762166845.385549:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166845.385551:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9d2a5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166845.385556:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9d2a5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00000100:00100000:2.0:1762166845.385613:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:46791:x1847765444353920:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 475us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166845.385625:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 42 00010000:00010000:1.0:1762166845.863863:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1762166846.148100:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869422 is committed 00000001:00080000:0.0:1762166846.148166:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869424 is committed 00010000:00010000:1.0:1762166846.888916:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1762166847.172233:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:2.0:1762166847.172263:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1762166847.172337:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1762166847.172529:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451948544:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166847.172592:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166847.172646:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451948544 00000100:00100000:2.0:1762166847.172656:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451948544 00000100:00080000:3.0:1762166847.172711:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166847.172739:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:2.0:1762166847.172752:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765451948544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1762166847.172817:0:7858:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:102 count 1 00010000:00010000:2.0:1762166847.172843:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d2ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.172866:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cc4d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ee7 expref: 6 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166847.172875:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166847.172878:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166847.172882:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d2ac lrc: 4/0,1 mode: --/PW res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.173573:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cc4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ee7 expref: 6 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166847.173595:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cc4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ee7 expref: 6 pid: 7858 timeout: 567 lvb_type: 1 00000100:00100000:2.0:1762166847.173608:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451948672:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166847.173703:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c59600 going to sleep for 11 seconds 00000100:00100000:1.0:1762166847.174979:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451948672:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166847.175022:0:7858:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d2ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166847.175146:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166847.175175:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444354048 00000100:00100000:2.0:1762166847.175180:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444354048 00010000:00010000:2.0:1762166847.175214:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cc4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ee7 expref: 7 pid: 7858 timeout: 567 lvb_type: 1 00000100:00100000:2.0:1762166847.175245:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 605 00000100:00100000:2.0:1762166847.175255:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2360:x1847765444354048:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00080000:3.0:1762166847.175263:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1762166847.175269:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166847.175276:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cc4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ee7 expref: 7 pid: 7858 timeout: 567 lvb_type: 1 00010000:00010000:2.0:1762166847.175292:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cc4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ee7 expref: 7 pid: 7858 timeout: 567 lvb_type: 1 00010000:00010000:2.0:1762166847.175313:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9cc4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ee7 expref: 7 pid: 7858 timeout: 567 lvb_type: 1 00010000:00010000:2.0:1762166847.175327:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166847.175328:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166847.175333:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d2ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.175341:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d2ac lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.175366:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166847.175406:0:7858:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d2ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166847.175417:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d2ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166847.175418:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2360:x1847765444354048:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 160us (268us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166847.175437:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d2ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166847.175441:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 605 00010000:00010000:1.0:1762166847.175461:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d2ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166847.175477:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166847.175484:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166847.175501:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d2ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.175508:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166847.175512:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d2ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.175518:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d2ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.175533:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d2ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.175537:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d2ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.175563:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166847.175565:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166847.175567:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166847.175859:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3293:x1847765451948544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3108us (3265us total) trans 21474836753 rc 0/0 00000100:00100000:1.0:1762166847.175869:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000004:00080000:2.0:1762166847.175893:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435ab480/2, rc 0, transno 21474836753 00000100:00100000:2.0:1762166847.175902:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451948544:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1762166847.179329:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836752 is committed 00000100:00100000:1.0:1762166847.588352:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166847.588410:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166847.588469:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444354176 00000100:00100000:1.0:1762166847.588474:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166847.588503:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444354176 00000100:00100000:0.0:1762166847.588534:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444354304 00000100:00100000:0.0:1762166847.588541:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444354304 00000100:00100000:2.0:1762166847.588573:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 57 00000100:00100000:2.0:1762166847.588603:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2359:x1847765444354176:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:0.0:1762166847.588611:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1 00000100:00100000:0.0:1762166847.588622:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2358:x1847765444354304:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762166847.588664:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444354432 00000100:00080000:1.0:1762166847.588674:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166847.588677:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444354432 00000100:00100000:2.0:1762166847.588711:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2359:x1847765444354176:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 106us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166847.588711:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2358:x1847765444354304:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 83us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166847.588733:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1 00000100:00100000:2.0:1762166847.588734:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 57 00000100:00100000:3.0:1762166847.588755:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 196 00000100:00100000:3.0:1762166847.588823:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f548450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2359:x1847765444354432:12345-192.168.203.35@tcp:400:kworker.0 00000100:00080000:0.0:1762166847.588858:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166847.588901:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f548450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2359:x1847765444354432:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 80us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166847.588910:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 196 00000001:02000400:3.0:1762166847.657650:0:31540:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 50a: mirror extend/copy preserves sparseness ========================================================== 05:47:27 (1762166847) 00010000:00010000:1.0:1762166847.912915:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1762166848.191991:0:31588:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-flr test_50a OST does not support SEEK_HOLE 00000100:00000400:2.0:1762166848.679846:0:3294:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1762166832/real 1762166832] req@ffff9ee34371b480 x1847765451937920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1762166848 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000400:1.0:1762166848.681220:0:3296:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1762166832/real 1762166832] req@ffff9ee34371ad80 x1847765451937792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1762166848 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1762166848.681253:0:3296:0:(client.c:2512:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9ee34371ad80 x1847765451937792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1762166848 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1762166848.681280:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1847765451937792:0@lo:400:kworker.0 00000100:00100000:1.0:1762166848.681303:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762166848.681313:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451948928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762166848.681390:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166848.681445:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451948928 00000100:00100000:0.0:1762166848.681457:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451948928 00000100:00100000:3.0:1762166848.681472:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1762166848.681502:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451948800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166848.681524:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1762166848.681535:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765451948928:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166848.681559:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1762166848.681573:0:8383:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 54329344 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1762166848.681602:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451948800 00000100:00100000:3.0:1762166848.681607:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451948800 00000100:00100000:3.0:1762166848.681639:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1762166848.681641:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765451948928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166848.681647:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451948800:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166848.681656:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00002000:00000024:3.0:1762166848.681667:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 59310080 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1762166848.681698:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451948800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166848.681703:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1762166848.681715:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836752 gen 2 00000100:00100000:0.0:1762166848.681739:0:3296:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee2435ab480 x1847765451948544/t21474836753(21474836753) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166863 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1762166848.681742:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166848.681832:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869422 gen 2 00000100:00100000:3.0:1762166848.681854:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451948800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166848.681908:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765451949184:0@lo:400:kworker.0 00000100:00100000:3.0:1762166848.681955:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166848.681984:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1762166848.681994:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1847765451949312:0@lo:400:kworker.0 00000100:00100000:3.0:1762166848.682032:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166848.682083:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451949184 00000100:00100000:3.0:1762166848.682089:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451949184 00000100:00100000:1.0:1762166848.682097:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1847765451949440:0@lo:400:kworker.0 00000100:00100000:0.0:1762166848.682122:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451948928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166848.682139:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451949312 00000100:00100000:3.0:1762166848.682148:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451949312 00000100:00100000:1.0:1762166848.682148:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166848.682150:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f1807908-b95d-4027-b65a-753b7d69e554:3296:1847765451949056:0@lo:400:kworker.0 00000100:00100000:3.0:1762166848.682193:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451949440 00000100:00100000:3.0:1762166848.682197:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451949440 00000100:00100000:0.0:1762166848.682219:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166848.682229:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1762166848.682241:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1847765451949184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166848.682279:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1847765451949184:12345-0@lo:400:kworker.0 Request processed in 44us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166848.682284:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1762166848.682298:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1762166848.682305:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1847765451949312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166848.682331:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1847765451949312:12345-0@lo:400:kworker.0 Request processed in 28us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166848.682335:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1762166848.682347:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1762166848.682353:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1847765451949440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166848.682389:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1847765451949440:12345-0@lo:400:kworker.0 Request processed in 37us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166848.682399:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1762166848.682427:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166848.682434:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1847765451949440:0@lo:400:kworker.0 00000100:00100000:3.0:1762166848.682453:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1847765451949312:0@lo:400:kworker.0 00000100:00100000:3.0:1762166848.682506:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765451949184:0@lo:400:kworker.0 00000100:00100000:3.0:1762166848.682585:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451949056 00000100:00100000:3.0:1762166848.682589:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451949056 00000100:00100000:3.0:1762166848.682627:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1762166848.682635:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+18:3296:x1847765451949056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166848.682674:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+18:3296:x1847765451949056:12345-0@lo:400:kworker.0 Request processed in 41us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166848.682679:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1762166848.682734:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f1807908-b95d-4027-b65a-753b7d69e554:3296:1847765451949056:0@lo:400:kworker.0 00000100:00100000:2.0:1762166848.692109:0:3294:0:(client.c:2512:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9ee34371b480 x1847765451937920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1762166848 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1762166848.692143:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1847765451937920:0@lo:400:kworker.0 00000001:02000400:1.0:1762166848.817580:0:31636:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 50b: mirror rsync handles sparseness == 05:47:28 (1762166848) 00010000:00010000:1.0:1762166848.936088:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1762166849.396197:0:31684:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-flr test_50b OST does not support SEEK_HOLE 00010000:00010000:2.0:1762166849.959988:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1762166850.042192:0:31732:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 50c: punch_hole/mmap_write stale other mirrors ========================================================== 05:47:29 (1762166849) 00000100:00100000:3.0:1762166850.073019:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166850.073079:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444354688 00000100:00100000:0.0:1762166850.073091:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444354688 00000100:00080000:3.0:1762166850.073129:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166850.073155:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 43 00000100:00100000:3.0:1762166850.073165:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:47941:x1847765444354688:12345-192.168.203.35@tcp:36:mkdir.0 00010000:00010000:3.0:1762166850.073218:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166850.073247:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d0e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f3b expref: 16 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.073264:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee363960800) 00010000:00010000:3.0:1762166850.073276:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166850.073437:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d2b3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.073447:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d2b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.073455:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d2b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.073464:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d2ba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.073483:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d2ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.073490:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d2ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762166850.075230:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19:0x0]: returning size 512 00010000:00010000:2.0:1762166850.075243:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d2b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.075253:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d2b3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.075260:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d2b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.075267:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.075273:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d2b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.075280:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d2b3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.075293:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee363960a00) 00010000:00010000:2.0:1762166850.075296:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.075309:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d2b3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.075316:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d2b3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000004:00010000:2.0:1762166850.075335:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000040889cd8 reply state 00000000b22df031 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d2ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762166850.075344:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166850.075448:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:47941:x1847765444354688:12345-192.168.203.35@tcp:36:mkdir.0 Request processed in 2282us (2435us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1762166850.075457:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 43 00010000:00010000:2.0:1762166850.076298:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d2ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.076308:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d2ba lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.076313:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d2ba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.076319:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.076322:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d2ba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.076328:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d2ba lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.076337:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7b0e8b47 (ffff9ee363960f00) 00010000:00010000:2.0:1762166850.076340:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.076343:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d2ba lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.076360:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d2ba lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762166850.082483:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.082554:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444354816 00000100:00100000:2.0:1762166850.082567:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444354816 00000100:00100000:2.0:1762166850.082627:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 44 00000100:00100000:2.0:1762166850.082642:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:47943:x1847765444354816:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166850.082661:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166850.082683:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d2c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90fc0 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.082742:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9d2c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.082754:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9d2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.082864:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9d2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762166850.082930:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:2.0:1762166850.082936:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 24 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166850.082961:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9d2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.082986:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d2c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fc0 expref: 18 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.083004:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9d2c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fc0 expref: 17 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.083025:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee360714500) 00010000:00010000:2.0:1762166850.083028:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762166850.083032:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687c00, rc 0) 00000100:00100000:2.0:1762166850.083096:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:47943:x1847765444354816:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 461us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166850.083102:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 44 00000100:00100000:1.0:1762166850.084165:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.084205:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444354944 00000100:00100000:2.0:1762166850.084211:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444354944 00000100:00100000:2.0:1762166850.084241:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 45 00000100:00100000:2.0:1762166850.084249:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:47943:x1847765444354944:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166850.084258:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166850.084266:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d2cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90fc7 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.084295:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d2d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084302:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d2d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084307:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d2d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084316:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d2dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084320:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d2dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084324:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d2dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084399:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9d2e4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084405:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9d2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084409:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9d2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762166850.084425:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19:0x0]: returning size 512 00000004:00200000:2.0:1762166850.084427:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166850.084442:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9d2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084449:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d2d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084454:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d2d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084459:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d2d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084462:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.084465:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d2d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084479:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d2d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084486:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee360714500) 00010000:00010000:2.0:1762166850.084488:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.084490:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d2d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084500:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d2d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084507:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d2dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084510:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d2dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084514:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d2dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084516:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.084518:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d2dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084522:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d2dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084526:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7b0e8b47 (ffff9ee360714200) 00010000:00010000:2.0:1762166850.084527:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.084528:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d2dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084531:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d2dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.084549:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d2cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fc7 expref: 19 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.084555:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9d2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fc7 expref: 18 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.084567:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:2.0:1762166850.084569:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1762166850.084570:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686600, rc 0) 00000100:00100000:2.0:1762166850.084601:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:47943:x1847765444354944:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 354us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166850.084605:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 45 00000100:00100000:2.0:1762166850.085450:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.085488:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444355072 00000100:00100000:3.0:1762166850.085493:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444355072 00000100:00100000:3.0:1762166850.085519:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 46 00000100:00100000:3.0:1762166850.085526:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:47943:x1847765444355072:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166850.085539:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166850.085547:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d2eb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90fce expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.085572:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d2f2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085578:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d2f2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085584:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d2f2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085593:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d2f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085597:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085601:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085629:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d2f2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085633:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d2f2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085636:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d2f2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085639:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166850.085642:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d2f2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085650:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d2f2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085657:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:3.0:1762166850.085660:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166850.085662:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d2f2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085668:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d2f2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085679:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085685:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d2f9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085690:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d2f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085696:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166850.085699:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d2f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085704:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d2f9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085712:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x98a5b8df (ffff9ee363960800) 00010000:00010000:3.0:1762166850.085714:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166850.085716:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d2f9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085719:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d2f9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.085743:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d2eb lrc: 1/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fce expref: 19 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.085749:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:3.0:1762166850.085750:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166850.085752:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d2eb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fce expref: 19 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.085758:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216d000, rc 0) 00000100:00100000:3.0:1762166850.085810:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:47943:x1847765444355072:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 285us (362us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166850.085815:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 46 00000100:00100000:3.0:1762166850.086689:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.086728:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444355200 00000100:00100000:2.0:1762166850.086734:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444355200 00000100:00100000:2.0:1762166850.086795:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 47 00000100:00100000:2.0:1762166850.086806:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:47943:x1847765444355200:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166850.086820:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166850.086829:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d300 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90fd5 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.086869:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d307 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.086876:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d307 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.086882:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d307 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.086889:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d30e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.086894:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d30e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.086906:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d30e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.086937:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d307 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.086941:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d307 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.086945:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d307 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.086948:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.086951:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d307 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.086954:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d307 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.086960:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:2.0:1762166850.086962:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.086964:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d307 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.086968:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d307 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.086973:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d30e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.086977:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d30e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.086982:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d30e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.086994:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.086997:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d30e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.087004:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d30e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.087012:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x98a5b8df (ffff9ee360714f00) 00010000:00010000:2.0:1762166850.087015:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.087018:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d30e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.087024:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d30e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.087050:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d300 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fd5 expref: 19 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.087059:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:2.0:1762166850.087061:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.087065:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d300 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fd5 expref: 19 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.087074:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687600, rc 0) 00000100:00100000:2.0:1762166850.087110:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:47943:x1847765444355200:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 306us (422us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166850.087117:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 47 00000100:00100000:0.0:1762166850.088049:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.088082:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444355328 00000100:00100000:2.0:1762166850.088086:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444355328 00000100:00100000:2.0:1762166850.088122:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 48 00000100:00100000:2.0:1762166850.088128:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:47943:x1847765444355328:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166850.088136:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166850.088145:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9d315 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90fdc expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.088173:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d31c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.088179:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d31c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.088184:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d31c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762166850.088212:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19:0x0]: returning size 512 00000004:00200000:2.0:1762166850.088214:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166850.088226:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d31c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.088241:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9d315 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fdc expref: 20 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.088255:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d31c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fdc expref: 19 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.088262:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:2.0:1762166850.088265:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762166850.088268:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686c00, rc 0) 00000100:00100000:2.0:1762166850.088305:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:47943:x1847765444355328:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 175us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166850.088321:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 48 00000100:00100000:0.0:1762166850.090085:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.090134:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444355456 00000100:00100000:3.0:1762166850.090142:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444355456 00000100:00100000:3.0:1762166850.090185:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 49 00000100:00100000:3.0:1762166850.090195:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:47943:x1847765444355456:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166850.090208:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166850.090222:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d323 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90fe3 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.090266:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d32a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090278:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d32a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090287:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d32a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090307:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d331 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090314:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d331 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090321:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d331 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090372:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d32a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090380:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d32a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090387:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d32a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090393:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166850.090396:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d32a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090403:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d32a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090413:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:3.0:1762166850.090416:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166850.090420:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d32a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090426:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d32a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090437:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d331 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090449:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d331 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090455:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d331 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090460:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166850.090463:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d331 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090482:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d331 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090492:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x98a5b8df (ffff9ee363960200) 00010000:00010000:3.0:1762166850.090495:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166850.090499:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d331 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090505:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d331 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.090534:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d323 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fe3 expref: 20 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.090544:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:3.0:1762166850.090547:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166850.090551:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d323 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fe3 expref: 20 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.090561:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216cc00, rc 0) 00000100:00100000:3.0:1762166850.090607:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:47943:x1847765444355456:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 413us (527us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166850.090621:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 49 00000100:00100000:3.0:1762166850.091671:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166850.091711:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444355712 00000100:00100000:0.0:1762166850.091722:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444355712 00000100:00100000:0.0:1762166850.091755:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 50 00000100:00100000:0.0:1762166850.091780:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:47943:x1847765444355712:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166850.091789:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166850.091791:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762166850.091805:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d31c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fdc expref: 19 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166850.091818:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:0.0:1762166850.091821:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166850.091828:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d338 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90fea expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166850.091895:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d33f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762166850.091902:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d33f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762166850.091908:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d33f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762166850.091916:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d346 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762166850.091920:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d346 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762166850.091924:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d346 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762166850.092377:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d34d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762166850.092389:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d34d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762166850.092394:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d34d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762166850.092401:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a:0x0]: returning size 0 00010000:00010000:0.0:1762166850.092419:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d33f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762166850.092423:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d33f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762166850.092426:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d33f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762166850.092429:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439bf800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166850.092431:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d33f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762166850.092435:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d33f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762166850.092440:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:0.0:1762166850.092441:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166850.092444:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d33f lrc: 2/0,0 mode: --/CW res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762166850.092447:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d33f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000004:00010000:0.0:1762166850.092453:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000991be6cb reply state 000000003f6d3d22 transno 8589934616 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d346 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762166850.092467:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762166850.092498:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d338 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fea expref: 21 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166850.092507:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d34d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fea expref: 20 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166850.092511:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166850.092513:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166850.092515:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2439bf000, rc 0) 00000100:00100000:0.0:1762166850.092557:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:47943:x1847765444355712:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 795us (887us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1762166850.092564:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 50 00010000:00010000:3.0:1762166850.093165:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d346 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.093175:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d346 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.093182:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d346 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.093188:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439bf400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166850.093191:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d346 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.093198:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d346 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.093208:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x98a5b8df (ffff9ee34bdb4e00) 00010000:00010000:3.0:1762166850.093211:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166850.093214:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d346 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.093218:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d346 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762166850.093641:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166850.093672:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444355968 00000100:00100000:0.0:1762166850.093678:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444355968 00000100:00100000:0.0:1762166850.093709:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 51 00000100:00100000:0.0:1762166850.093715:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:47943:x1847765444355968:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166850.093725:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166850.093732:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d35b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ff1 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166850.093811:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d362 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762166850.093819:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d34d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fea expref: 21 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166850.093824:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d362 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762166850.093857:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d34d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fea expref: 21 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166850.093875:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d34d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fea expref: 21 pid: 30819 timeout: 570 lvb_type: 0 00000100:00100000:0.0:1762166850.093887:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765451949568:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166850.093960:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fca83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166850.094672:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765451949568:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166850.094691:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d362 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762166850.094881:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.094918:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444356096 00000100:00100000:2.0:1762166850.094923:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444356096 00010000:00010000:2.0:1762166850.094959:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d34d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fea expref: 22 pid: 30819 timeout: 570 lvb_type: 0 00000100:00100000:2.0:1762166850.094992:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 606 00000100:00100000:2.0:1762166850.095001:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765444356096:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166850.095012:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166850.095018:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d34d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fea expref: 22 pid: 30819 timeout: 570 lvb_type: 0 00010000:00010000:2.0:1762166850.095026:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d34d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fea expref: 22 pid: 30819 timeout: 570 lvb_type: 0 00010000:00010000:2.0:1762166850.095038:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d34d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fea expref: 22 pid: 30819 timeout: 570 lvb_type: 0 00010000:00010000:2.0:1762166850.095048:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:2.0:1762166850.095050:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d362 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.095055:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d362 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.095059:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d362 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.095077:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166850.095098:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d362 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.095104:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d362 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762166850.095114:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a:0x0]: returning size 0 00000100:00100000:2.0:1762166850.095118:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765444356096:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 117us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166850.095129:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 606 00000004:00080000:3.0:1762166850.095399:0:30819:0:(osp_internal.h:565:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x67:0x0], count =27 00000004:00080000:3.0:1762166850.095407:0:30819:0:(osp_object.c:1632:osp_create()) Writing gap [0x240000400:0x67:0x0]+27 in llog 00000004:00080000:3.0:1762166850.095485:0:30819:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x82:0x0], index 0: 0 00000004:00080000:3.0:1762166850.095490:0:30819:0:(osp_internal.h:565:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x61:0x0], count =33 00000004:00080000:3.0:1762166850.095494:0:30819:0:(osp_object.c:1632:osp_create()) Writing gap [0x280000400:0x61:0x0]+33 in llog 00000004:00080000:3.0:1762166850.095502:0:30819:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x82:0x0], index 1: 0 00000004:00080000:3.0:1762166850.095510:0:30819:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x83:0x0], index 1: 0 00000004:00080000:3.0:1762166850.095516:0:30819:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x83:0x0], index 0: 0 00010000:00010000:3.0:1762166850.095670:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d362 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.095676:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d362 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.095680:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d362 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.095684:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439be200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166850.095686:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d362 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.095691:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d362 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.095706:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:3.0:1762166850.095708:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166850.095711:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d362 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.095715:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d362 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.095750:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d35b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ff1 expref: 21 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.095757:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:3.0:1762166850.095759:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166850.095779:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d35b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ff1 expref: 21 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.095786:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2439be000, rc 0) 00000100:00100000:3.0:1762166850.095818:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:47943:x1847765444355968:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2102us (2177us total) trans 8589934617 rc 301/301 00000100:00100000:3.0:1762166850.095826:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 51 00000100:00100000:3.0:1762166850.096791:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.096829:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444356352 00000100:00100000:3.0:1762166850.096847:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444356352 00000100:00100000:3.0:1762166850.096888:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 9 00000100:00100000:3.0:1762166850.096898:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:47943:x1847765444356352:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166850.097124:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:47943:x1847765444356352:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 226us (333us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1762166850.097131:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 9 00000100:00100000:0.0:1762166850.097979:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166850.098013:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444356608 00000100:00100000:0.0:1762166850.098018:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444356608 00000100:00100000:0.0:1762166850.098052:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 10 00000100:00100000:0.0:1762166850.098061:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:47943:x1847765444356608:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166850.098202:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:47943:x1847765444356608:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 141us (224us total) trans 8589934619 rc 0/0 00000100:00100000:0.0:1762166850.098211:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 10 00000100:00100000:0.0:1762166850.108165:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.108212:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444356864 00000100:00100000:3.0:1762166850.108223:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444356864 00000100:00100000:3.0:1762166850.108300:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 52 00000100:00100000:3.0:1762166850.108310:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:47945:x1847765444356864:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166850.108330:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166850.108354:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d370 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90ff8 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.108426:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d377 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108439:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d377 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108455:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d377 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108481:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d37e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108489:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d37e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108495:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d37e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108603:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d377 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108610:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d377 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108617:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d377 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108629:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166850.108634:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d377 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108642:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d377 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108653:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:3.0:1762166850.108663:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166850.108668:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d377 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108677:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d377 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108689:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d37e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108695:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d37e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108702:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d37e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108706:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166850.108709:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d37e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108715:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d37e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108723:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x98a5b8df (ffff9ee363960200) 00010000:00010000:3.0:1762166850.108729:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166850.108732:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d37e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108738:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d37e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.108799:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d370 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ff8 expref: 23 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.108809:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:3.0:1762166850.108812:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166850.108816:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d370 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90ff8 expref: 23 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.108827:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216cc00, rc 0) 00000100:00100000:3.0:1762166850.108882:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:47945:x1847765444356864:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 575us (725us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166850.108890:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 52 00000100:00100000:0.0:1762166850.110275:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.110327:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444357120 00000100:00100000:3.0:1762166850.110334:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444357120 00000100:00100000:3.0:1762166850.110373:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 53 00000100:00100000:3.0:1762166850.110382:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:47945:x1847765444357120:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166850.110396:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166850.110407:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d385 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f90fff expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1762166850.110494:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19:0x0]: returning size 512 00010000:00010000:3.0:1762166850.110604:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d385 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fff expref: 24 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.110621:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee360714500) 00010000:00010000:3.0:1762166850.110625:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166850.110630:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d385 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fff expref: 24 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.110643:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216d000, rc 0) 00000100:00100000:3.0:1762166850.110693:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:47945:x1847765444357120:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 311us (420us total) trans 8589934620 rc 301/301 00000100:00100000:3.0:1762166850.110701:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 53 00000100:00100000:0.0:1762166850.111831:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.111855:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444357248 00000100:00100000:3.0:1762166850.111860:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444357248 00000100:00100000:3.0:1762166850.111890:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 54 00000100:00100000:3.0:1762166850.111900:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:47945:x1847765444357248:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:3.0:1762166850.111947:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d393 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.111959:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d393 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.111969:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d393 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.111980:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d39a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.111985:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d39a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.111989:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d39a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112061:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112066:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112070:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762166850.112095:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a:0x0]: returning size 0 00000004:00200000:3.0:1762166850.112098:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166850.112104:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112114:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d393 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112120:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d393 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112125:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d393 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112130:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166850.112133:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d393 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112140:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d393 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112150:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:3.0:1762166850.112153:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166850.112156:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d393 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112168:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d393 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112179:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d39a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112183:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d39a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112186:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d39a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112189:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166850.112190:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d39a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112193:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d39a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112198:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x98a5b8df (ffff9ee363960800) 00010000:00010000:3.0:1762166850.112199:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166850.112200:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d39a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112203:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d39a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112211:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112215:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3a1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112224:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112226:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166850.112228:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112231:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3a1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112243:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960100) 00010000:00010000:3.0:1762166850.112245:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166850.112246:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3a1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.112249:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3a1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762166850.112298:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:47945:x1847765444357248:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 401us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166850.112302:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 54 00000100:00100000:0.0:1762166850.113359:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.113411:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444357504 00000100:00100000:2.0:1762166850.113417:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444357504 00000100:00100000:2.0:1762166850.113451:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 11 00000100:00100000:2.0:1762166850.113459:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:47945:x1847765444357504:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166850.113625:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:47945:x1847765444357504:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 165us (266us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1762166850.113632:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 11 00000100:00100000:0.0:1762166850.121173:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.121219:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444357760 00000100:00100000:3.0:1762166850.121229:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444357760 00000100:00100000:3.0:1762166850.121284:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 55 00000100:00100000:3.0:1762166850.121294:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:47947:x1847765444357760:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166850.121313:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166850.121332:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9d3a8 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91006 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.121496:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d3af lrc: 3/1,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121527:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d3af lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121537:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d3af lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121551:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d3b6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121557:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121562:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121627:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d3bd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121634:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d3bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121641:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d3bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762166850.121651:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a:0x0]: returning size 0 00010000:00010000:3.0:1762166850.121745:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d3af lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121753:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d3af lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121759:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d3af lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121844:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166850.121852:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d3af lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121859:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d3af lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121872:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:3.0:1762166850.121875:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166850.121879:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d3af lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121885:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9d3af lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121897:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121902:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d3b6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121911:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d3b6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121916:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166850.121919:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d3b6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121924:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d3b6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121930:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x98a5b8df (ffff9ee363960700) 00010000:00010000:3.0:1762166850.121937:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166850.121940:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d3b6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.121945:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9d3b6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.122045:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9d3a8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91006 expref: 27 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.122058:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d3bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91006 expref: 26 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.122065:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:3.0:1762166850.122067:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166850.122070:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382044200, rc 0) 00000100:00100000:3.0:1762166850.122124:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:47947:x1847765444357760:12345-192.168.203.35@tcp:101:dd.0 Request processed in 832us (960us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1762166850.122132:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 55 00000100:00100000:0.0:1762166850.123353:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.123385:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444358016 00000100:00100000:3.0:1762166850.123391:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444358016 00000100:00100000:3.0:1762166850.123421:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 56 00000100:00100000:3.0:1762166850.123426:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:47947:x1847765444358016:12345-192.168.203.35@tcp:36:dd.0 00010000:00010000:3.0:1762166850.123460:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166850.123485:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d3bd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91006 expref: 26 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.123500:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:3.0:1762166850.123509:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166850.123688:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3cb lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.123699:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3cb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.123707:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3cb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:3.0:1762166850.123746:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934623 00000004:00010000:3.0:1762166850.123783:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000349cb01c reply state 00000000c5203975 transno 8589934624 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3cb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762166850.123790:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166850.123841:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:47947:x1847765444358016:12345-192.168.203.35@tcp:36:dd.0 Request processed in 414us (491us total) trans 8589934624 rc 0/0 00000100:00100000:3.0:1762166850.123847:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 56 00000020:00080000:3.0:1762166850.123850:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762166850.124431:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3cb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.124441:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3cb lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.124447:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3cb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.124453:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.124457:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3cb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.124463:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3cb lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.124487:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960100) 00010000:00010000:2.0:1762166850.124491:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.124495:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3cb lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.124512:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d3cb lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762166850.124576:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.124605:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444358144 00000100:00100000:3.0:1762166850.124610:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444358144 00000100:00100000:3.0:1762166850.124683:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 57 00000100:00100000:3.0:1762166850.124693:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:47947:x1847765444358144:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166850.124705:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166850.124717:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d3d2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9100d expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.124749:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d3d2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9100d expref: 28 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.124787:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d3d2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9100d expref: 28 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.124819:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960800) 00010000:00010000:3.0:1762166850.124824:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166850.124826:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382044a00, rc 0) 00000100:00100000:3.0:1762166850.124881:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:47947:x1847765444358144:12345-192.168.203.35@tcp:101:dd.0 Request processed in 188us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166850.124888:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 57 00000100:00100000:0.0:1762166850.125984:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.126031:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444358400 00000100:00100000:3.0:1762166850.126037:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444358400 00000100:00100000:3.0:1762166850.126077:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 58 00000100:00100000:3.0:1762166850.126086:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:47947:x1847765444358400:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:3.0:1762166850.126099:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166850.126102:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1762166850.126118:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d3d2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9100d expref: 28 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.126132:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960800) 00010000:00010000:3.0:1762166850.126139:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166850.126149:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d3d9 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91014 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.126184:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d3e0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.126192:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d3e0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.126199:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d3e0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000040:00080000:3.0:1762166850.126670:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 88 off8408 00000004:00080000:3.0:1762166850.126680:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 470918916911ns, next at 467115847658ns, rc = 0 00000040:00080000:3.0:1762166850.126902:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1762166850.126911:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 470919148402ns, next at 0ns, rc = 0 00000040:00080000:3.0:1762166850.126947:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3, 88 off8432 00000004:00080000:3.0:1762166850.126953:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 470919190362ns, next at 0ns, rc = 0 00000040:00080000:3.0:1762166850.126983:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 88 off8496 00000004:00080000:3.0:1762166850.126988:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 470919225739ns, next at 467115847658ns, rc = 0 00000001:00080000:2.0:1762166850.138929:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934619 is committed 00000001:00080000:2.0:1762166850.138958:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000001:00080000:2.0:1762166850.138972:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934625 is committed 00000004:00080000:2.0:1762166850.138977:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00010000:00010000:3.0:1762166850.138991:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d3e0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91014 expref: 25 pid: 30819 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166850.138991:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:3.0:1762166850.139008:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960200) 00000004:00080000:2.0:1762166850.139010:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1762166850.139012:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:2.0:1762166850.139025:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00010000:00010000:3.0:1762166850.139041:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d3d9 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91014 expref: 24 pid: 30819 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1762166850.139067:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d3e0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91014 expref: 18 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.139117:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960200) 00000100:00100000:2.0:1762166850.139119:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451949824:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1762166850.139123:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762166850.139130:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216c400, rc 0) 00000100:00100000:1.0:1762166850.139149:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451949696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166850.139214:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166850.139237:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:47947:x1847765444358400:12345-192.168.203.35@tcp:101:dd.0 Request processed in 13150us (13254us total) trans 8589934625 rc 0/0 00000100:00100000:1.0:1762166850.139237:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451950080:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166850.139256:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 58 00000100:00100000:1.0:1762166850.139273:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166850.139281:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1762166850.139289:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451949824 00000100:00100000:0.0:1762166850.139297:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451949824 00000100:00100000:2.0:1762166850.139298:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451949952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166850.139338:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451950080 00000100:00100000:2.0:1762166850.139340:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166850.139345:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451950080 00000100:00080000:3.0:1762166850.139376:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1762166850.139387:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166850.139388:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451949952 00000100:00100000:0.0:1762166850.139396:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451949952 00000100:00100000:1.0:1762166850.139416:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:1.0:1762166850.139440:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765451949824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166850.139441:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:0.0:1762166850.139457:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:2.0:1762166850.139462:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765451950080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166850.139465:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765451949952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166850.139957:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765451950080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 493us (682us total) trans 21474836754 rc 0/0 00000100:00100000:2.0:1762166850.139969:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:0.0:1762166850.139987:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765451949952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 519us (646us total) trans 17179869425 rc 0/0 00000100:00100000:0.0:1762166850.139996:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1762166850.140005:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765451949824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 574us (787us total) trans 17179869426 rc 0/0 00000100:00100000:1.0:1762166850.140018:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000004:00080000:0.0:1762166850.140046:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f2d1180/2, rc 0, transno 17179869425 00000100:00100000:0.0:1762166850.140058:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451949952:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762166850.140089:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242ce9f80/2, rc 0, transno 17179869426 00000004:00080000:1.0:1762166850.140092:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a9f80/2, rc 0, transno 21474836754 00000100:00100000:0.0:1762166850.140093:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451949824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166850.140109:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451950080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166850.140135:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166850.140172:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451949696 00000100:00100000:0.0:1762166850.140177:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451949696 00000100:00100000:0.0:1762166850.140209:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:0.0:1762166850.140220:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765451949696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166850.140360:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765451949696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 141us (224us total) trans 21474836755 rc 0/0 00000100:00100000:0.0:1762166850.140368:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000004:00080000:1.0:1762166850.140405:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435aaa00/2, rc 0, transno 21474836755 00000100:00100000:1.0:1762166850.140410:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451949696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166850.141876:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166850.141949:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444358528 00000100:00100000:1.0:1762166850.141957:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444358528 00000100:00080000:3.0:1762166850.142003:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166850.142017:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 991 00000100:00100000:1.0:1762166850.142027:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:47947:x1847765444358528:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:1.0:1762166850.142054:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166850.142073:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d3e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9101b expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166850.142107:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166850.142125:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166850.142127:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166850.142135:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d3e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9101b expref: 7 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166850.142150:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d3e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9101b expref: 7 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166850.142161:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473a00, rc 0) 00000100:00100000:1.0:1762166850.142213:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:47947:x1847765444358528:12345-192.168.203.35@tcp:101:dd.0 Request processed in 188us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166850.142220:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 991 00000100:00100000:3.0:1762166850.143177:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166850.143223:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444358656 00000100:00100000:1.0:1762166850.143229:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444358656 00000100:00080000:3.0:1762166850.143270:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166850.143279:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 992 00000100:00100000:1.0:1762166850.143288:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:47947:x1847765444358656:12345-192.168.203.35@tcp:101:dd.0 00010000:00010000:1.0:1762166850.143298:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166850.143312:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d3ee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91022 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166850.143330:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166850.143343:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166850.143354:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166850.143359:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d3ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91022 expref: 8 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166850.143372:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d3ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91022 expref: 8 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166850.143381:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472800, rc 0) 00000100:00100000:1.0:1762166850.143418:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:47947:x1847765444358656:12345-192.168.203.35@tcp:101:dd.0 Request processed in 131us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166850.143424:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 992 00000100:00100000:0.0:1762166850.144383:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166850.144443:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444358784 00000100:00100000:1.0:1762166850.144450:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444358784 00002000:00010000:1.0:1762166850.144489:0:26247:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/130 (0->18446744073709551615) 00002000:00100000:1.0:1762166850.144494:0:26247:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435a9180 with x1847765444358784 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166850.144502:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:1.0:1762166850.144503:0:26247:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2435a9180. 00000100:00100000:1.0:1762166850.144542:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444358912 00000100:00100000:1.0:1762166850.144546:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444358912 00002000:00010000:1.0:1762166850.144558:0:26247:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/130 (0->18446744073709551615) 00002000:00100000:1.0:1762166850.144561:0:26247:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374ab3100 with x1847765444358912 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166850.144567:0:26247:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee374ab3100. 00000100:00100000:1.0:1762166850.144596:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 972 00000100:00100000:2.0:1762166850.144608:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 973 00000100:00100000:1.0:1762166850.144609:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:2361:x1847765444358784:12345-192.168.203.35@tcp:10:dd.0 00000100:00100000:2.0:1762166850.144626:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444358912:12345-192.168.203.35@tcp:10:dd.0 00002000:00010000:2.0:1762166850.144953:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166850.144954:0:26247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166850.144961:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb mtime from disk: 0 -> 1762166850 00002000:00010000:1.0:1762166850.144961:0:26247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb mtime from disk: 0 -> 1762166850 00002000:00010000:2.0:1762166850.144968:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166850.144969:0:26247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166850.144975:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb ctime from disk: 0 -> 1762166850 00002000:00010000:1.0:1762166850.144976:0:26247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb ctime from disk: 0 -> 1762166850 00002000:00010000:2.0:1762166850.144991:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1762166850.144992:0:26247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166850.145033:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444358912:12345-192.168.203.35@tcp:10:dd.0 Request processed in 413us (532us total) trans 17179869427 rc 0/0 00000100:00100000:1.0:1762166850.145037:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2361:x1847765444358784:12345-192.168.203.35@tcp:10:dd.0 Request processed in 430us (653us total) trans 21474836756 rc 0/0 00000100:00100000:2.0:1762166850.145041:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 973 00002000:00010000:2.0:1762166850.145046:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/130 (0->18446744073709551615) 00002000:00100000:2.0:1762166850.145050:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374ab3100 with x1847765444358912 ext(0->18446744073709551615) 00000100:00100000:1.0:1762166850.145054:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 972 00002000:00010000:2.0:1762166850.145056:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee374ab3100. 00002000:00010000:1.0:1762166850.145068:0:26247:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/130 (0->18446744073709551615) 00002000:00100000:1.0:1762166850.145073:0:26247:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435a9180 with x1847765444358784 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166850.145082:0:26247:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2435a9180. 00000100:00100000:0.0:1762166850.147537:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.147628:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444359168 00000100:00100000:2.0:1762166850.147640:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444359168 00000100:00100000:2.0:1762166850.147709:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 12 00000100:00100000:2.0:1762166850.147720:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:47947:x1847765444359168:12345-192.168.203.35@tcp:35:dd.0 00000100:00100000:2.0:1762166850.148106:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:47947:x1847765444359168:12345-192.168.203.35@tcp:35:dd.0 Request processed in 387us (583us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1762166850.148113:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 12 00000100:00100000:0.0:1762166850.155390:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.155448:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444359296 00000100:00100000:3.0:1762166850.155457:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444359296 00000100:00100000:3.0:1762166850.155516:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 59 00000100:00100000:3.0:1762166850.155525:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:47948:x1847765444359296:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166850.155543:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166850.155561:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d3f5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91029 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.155623:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d3fc lrc: 3/1,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155637:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d3fc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155648:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d3fc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155662:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d403 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155669:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d403 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155675:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d403 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155811:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d40a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155835:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d40a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155841:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d40a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762166850.155875:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a:0x0]: returning size 16384 00000004:00200000:3.0:1762166850.155879:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166850.155895:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d40a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155907:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d40a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155916:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d3fc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155922:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d3fc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155928:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d3fc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155933:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216d000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166850.155937:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d3fc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155944:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d3fc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155956:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:3.0:1762166850.155960:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166850.155964:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d3fc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155975:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d3fc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155987:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d403 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155991:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d403 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155994:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d403 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.155997:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166850.155999:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d403 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.156002:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d403 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.156006:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x98a5b8df (ffff9ee363960800) 00010000:00010000:3.0:1762166850.156007:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166850.156009:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d403 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.156012:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d403 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.156036:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d3f5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91029 expref: 21 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.156044:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d40a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91029 expref: 20 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.156056:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960200) 00010000:00010000:3.0:1762166850.156058:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166850.156060:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216ca00, rc 0) 00000100:00100000:3.0:1762166850.156124:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:47948:x1847765444359296:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 599us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166850.156132:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 59 00000100:00100000:3.0:1762166850.158104:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166850.158168:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444359552 00000100:00100000:0.0:1762166850.158177:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444359552 00000100:00100000:0.0:1762166850.158233:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 60 00000100:00100000:0.0:1762166850.158243:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:47948:x1847765444359552:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166850.158270:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166850.158286:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfc00/0xf915a5bdf3c9d411 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91030 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166850.158372:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d418 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762166850.158385:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d40a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91029 expref: 21 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166850.158394:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d418 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762166850.158424:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d40a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91029 expref: 21 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166850.158437:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d40a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91029 expref: 21 pid: 30819 timeout: 570 lvb_type: 0 00000100:00100000:0.0:1762166850.158451:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765451950208:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166850.158536:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fca8000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166850.159653:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765451950208:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166850.159737:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d418 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762166850.159858:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.159945:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444359680 00000100:00100000:2.0:1762166850.159952:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444359680 00010000:00010000:2.0:1762166850.159979:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d40a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91029 expref: 22 pid: 30819 timeout: 570 lvb_type: 0 00000100:00100000:2.0:1762166850.160010:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 607 00000100:00100000:2.0:1762166850.160018:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444359680:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166850.160033:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166850.160039:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d40a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91029 expref: 22 pid: 30819 timeout: 570 lvb_type: 0 00010000:00010000:2.0:1762166850.160050:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d40a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91029 expref: 22 pid: 30819 timeout: 570 lvb_type: 0 00010000:00010000:2.0:1762166850.160081:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d40a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91029 expref: 22 pid: 30819 timeout: 570 lvb_type: 0 00010000:00010000:2.0:1762166850.160098:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960200) 00010000:00010000:2.0:1762166850.160103:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d418 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.160111:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d418 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.160117:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d418 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.160140:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166850.160157:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d418 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.160166:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d418 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762166850.160185:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a:0x0]: returning size 16384 00000100:00100000:2.0:1762166850.160186:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765444359680:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 168us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166850.160196:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 607 00010000:00010000:3.0:1762166850.160359:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfc00/0xf915a5bdf3c9d411 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91030 expref: 22 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.160374:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d418 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91030 expref: 21 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.160381:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960200) 00010000:00010000:3.0:1762166850.160384:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166850.160386:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2439bfe00, rc 0) 00000100:00100000:3.0:1762166850.160424:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:47948:x1847765444359552:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2180us (2324us total) trans 8589934627 rc 0/0 00000100:00100000:3.0:1762166850.160438:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 60 00000100:00100000:1.0:1762166850.161604:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.161649:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444359808 00000100:00100000:3.0:1762166850.161656:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444359808 00000100:00100000:3.0:1762166850.161694:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 61 00000100:00100000:3.0:1762166850.161701:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:47948:x1847765444359808:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166850.161717:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166850.161730:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d426 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91037 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.161824:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d42d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.161837:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d418 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91030 expref: 22 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.161844:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d42d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.161870:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d418 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91030 expref: 22 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.161881:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d418 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91030 expref: 22 pid: 30819 timeout: 570 lvb_type: 0 00000100:00100000:3.0:1762166850.161893:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765451950336:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166850.161953:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34a6e4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166850.162860:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765451950336:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166850.162937:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d42d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762166850.163146:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.163209:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444359936 00000100:00100000:2.0:1762166850.163217:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444359936 00010000:00010000:2.0:1762166850.163250:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d418 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91030 expref: 23 pid: 30819 timeout: 570 lvb_type: 0 00000100:00100000:2.0:1762166850.163280:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 608 00000100:00100000:2.0:1762166850.163288:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444359936:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166850.163301:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166850.163307:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d418 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91030 expref: 23 pid: 30819 timeout: 570 lvb_type: 0 00010000:00010000:2.0:1762166850.163329:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d418 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91030 expref: 23 pid: 30819 timeout: 570 lvb_type: 0 00010000:00010000:2.0:1762166850.163344:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d418 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91030 expref: 23 pid: 30819 timeout: 570 lvb_type: 0 00010000:00010000:2.0:1762166850.163358:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960200) 00010000:00010000:2.0:1762166850.163362:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d42d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.163369:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d42d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.163376:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d42d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762166850.163398:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166850.163423:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d42d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.163433:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d42d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762166850.163437:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765444359936:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 148us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166850.163450:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 608 00000004:00200000:3.0:1762166850.163485:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a:0x0]: returning size 16384 00000004:00200000:3.0:1762166850.163490:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166850.163507:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d42d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.163534:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d426 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91037 expref: 22 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.163549:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d42d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91037 expref: 21 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.163556:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960200) 00010000:00010000:3.0:1762166850.163559:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166850.163562:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216c600, rc 0) 00000100:00100000:3.0:1762166850.163628:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:47948:x1847765444359808:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1928us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166850.163634:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 61 00000100:00100000:1.0:1762166850.165390:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.165466:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444360192 00000100:00100000:3.0:1762166850.165486:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444360192 00000100:00100000:3.0:1762166850.165537:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 62 00000100:00100000:3.0:1762166850.165545:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:47948:x1847765444360192:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166850.165562:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166850.165577:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d434 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9103e expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.165669:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d43b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.165681:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d43b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.165689:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d43b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762166850.165698:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a:0x0]: returning size 16384 00010000:00010000:3.0:1762166850.165837:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d434 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9103e expref: 24 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.165852:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d43b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9103e expref: 23 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.165859:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960200) 00010000:00010000:3.0:1762166850.165862:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166850.165865:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216d000, rc 0) 00000100:00100000:3.0:1762166850.165928:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:47948:x1847765444360192:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 383us (547us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1762166850.165934:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 62 00000100:00100000:0.0:1762166850.167076:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166850.167123:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166850.167156:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444360320 00000100:00100000:1.0:1762166850.167170:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444360320 00000100:00100000:2.0:1762166850.167182:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444360448 00000100:00100000:2.0:1762166850.167194:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444360448 00000100:00100000:1.0:1762166850.167243:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 993 00000100:00100000:1.0:1762166850.167259:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2361:x1847765444360320:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:2.0:1762166850.167277:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 994 00000100:00100000:2.0:1762166850.167294:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444360448:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762166850.167323:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d449 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.167330:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d450 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166850.167362:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d3e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9101b expref: 8 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.167363:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d3ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91022 expref: 9 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166850.167374:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166850.167382:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166850.167384:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166850.167389:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d449 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.167390:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166850.167400:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d450 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166850.167449:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d3e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9101b expref: 8 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.167451:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d3ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91022 expref: 9 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.167497:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d3ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91022 expref: 9 pid: 12400 timeout: 570 lvb_type: 0 00010000:00010000:1.0:1762166850.167545:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d3e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9101b expref: 8 pid: 12400 timeout: 570 lvb_type: 0 00000100:00100000:2.0:1762166850.167549:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451950592:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166850.167583:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765451950464:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166850.167637:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855b40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166850.167642:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166850.168967:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451950592:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166850.168998:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d450 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166850.169207:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765451950464:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166850.169270:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166850.169274:0:12400:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d449 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166850.169283:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.169337:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444360576 00000100:00100000:1.0:1762166850.169338:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444360704 00000100:00100000:1.0:1762166850.169349:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444360704 00000100:00100000:2.0:1762166850.169350:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444360576 00010000:00010000:2.0:1762166850.169387:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d3ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91022 expref: 10 pid: 12400 timeout: 570 lvb_type: 0 00002000:00100000:1.0:1762166850.169416:0:26247:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x82:0x0] (0->16383) req@ffff9ee24550e680 x1847765444360704/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:636/0 lens 16872/0 e 0 to 0 dl 1762166861 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1762166850.169435:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 609 00002000:00100000:1.0:1762166850.169436:0:26247:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24550e680 with x1847765444360704 ext(0->16383) 00010000:00010000:1.0:1762166850.169454:0:26247:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d3e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9101b expref: 9 pid: 12400 timeout: 570 lvb_type: 0 00000100:00100000:2.0:1762166850.169463:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3456e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444360576:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166850.169489:0:26247:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d3e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9101b expref: 9 pid: 12400 timeout: 570 lvb_type: 0 00010000:00010000:2.0:1762166850.169496:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1762166850.169501:0:26247:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ee24550e680 00010000:00010000:2.0:1762166850.169525:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d3ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91022 expref: 10 pid: 12400 timeout: 570 lvb_type: 0 00010000:00010000:2.0:1762166850.169543:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d3ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91022 expref: 10 pid: 12400 timeout: 570 lvb_type: 0 00000100:00100000:1.0:1762166850.169545:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 8 00000100:00100000:1.0:1762166850.169569:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444360704:12345-192.168.203.35@tcp:4:dd.0 00010000:00010000:2.0:1762166850.169573:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d3ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91022 expref: 10 pid: 12400 timeout: 570 lvb_type: 0 00010000:00010000:2.0:1762166850.169592:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166850.169594:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166850.169599:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d450 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.169609:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d450 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.169641:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166850.169667:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d450 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.169694:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d450 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166850.169697:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3456e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2361:x1847765444360576:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 243us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166850.169712:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 609 00010000:00010000:3.0:1762166850.169727:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d450 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.169737:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d450 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.169745:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.169755:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166850.169802:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.169811:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d450 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.169824:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d450 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.169832:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d450 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166850.169944:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444360448:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2654us (2819us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166850.169959:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 994 00000100:00100000:1.0:1762166850.170233:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765444360704:12345-192.168.203.35@tcp:4:dd.0 Request processed in 668us (953us total) trans 21474836757 rc 0/0 00000100:00100000:1.0:1762166850.170243:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 8 00002000:00100000:1.0:1762166850.170252:0:26247:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x82:0x0] (0->16383) req@ffff9ee24550e680 x1847765444360704/t21474836757(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:636/0 lens 16872/448 e 0 to 0 dl 1762166861 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166850.170273:0:26247:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24550e680 with x1847765444360704 ext(0->16383) 00010000:00010000:1.0:1762166850.170281:0:26247:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d3e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9101b expref: 11 pid: 12400 timeout: 570 lvb_type: 0 00010000:00010000:1.0:1762166850.170292:0:26247:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d3e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9101b expref: 11 pid: 12400 timeout: 570 lvb_type: 0 00002000:00010000:1.0:1762166850.170298:0:26247:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ee24550e680 00000100:00100000:0.0:1762166850.171197:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.171239:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444360832 00000100:00100000:2.0:1762166850.171246:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444360832 00010000:00010000:2.0:1762166850.171271:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d3e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9101b expref: 11 pid: 12400 timeout: 570 lvb_type: 0 00000100:00100000:2.0:1762166850.171304:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 610 00000100:00100000:2.0:1762166850.171314:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765444360832:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166850.171335:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1762166850.171346:0:5741:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb size from disk: 0 -> 16384 00010000:00010000:2.0:1762166850.171350:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d3e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9101b expref: 11 pid: 12400 timeout: 570 lvb_type: 0 00010000:00010000:2.0:1762166850.171358:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d3e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9101b expref: 11 pid: 12400 timeout: 570 lvb_type: 0 00010000:00010000:2.0:1762166850.171372:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d3e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9101b expref: 11 pid: 12400 timeout: 570 lvb_type: 0 00010000:00010000:2.0:1762166850.171384:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166850.171386:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166850.171389:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.171396:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d449 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.171427:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166850.171463:0:12400:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166850.171480:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2360:x1847765444360832:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 155us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166850.171495:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 610 00010000:00010000:3.0:1762166850.171496:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.171522:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.171534:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d449 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.171541:0:12400:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d449 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.171548:0:12400:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244472e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166850.171552:0:12400:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d449 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.171563:0:12400:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d449 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.171575:0:12400:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d449 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.171582:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d449 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166850.171673:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2361:x1847765444360320:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 4421us (4604us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166850.171679:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 993 00000100:00100000:0.0:1762166850.172704:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.172755:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444361088 00000100:00100000:3.0:1762166850.172801:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444361088 00000100:00100000:3.0:1762166850.172845:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 63 00000100:00100000:3.0:1762166850.172857:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:47948:x1847765444361088:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166850.172912:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1762166850.172935:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d42d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91037 expref: 23 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.172958:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d3e0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91014 expref: 22 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.172967:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960200) 00010000:00010000:3.0:1762166850.172970:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166850.172992:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d457 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.173001:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d457 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762166850.173006:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d457 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000040:00080000:3.0:1762166850.173315:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 88 off8584 00000004:00080000:3.0:1762166850.173321:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 470965558540ns, next at 467115847658ns, rc = 0 00000040:00080000:3.0:1762166850.173365:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4, 88 off8520 00000004:00080000:3.0:1762166850.173377:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 470965614481ns, next at 0ns, rc = 0 00000040:00080000:3.0:1762166850.173405:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5, 88 off8608 00000004:00080000:3.0:1762166850.173407:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 470965644853ns, next at 0ns, rc = 0 00000040:00080000:3.0:1762166850.173419:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 88 off8672 00000004:00080000:3.0:1762166850.173422:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 470965659348ns, next at 467115847658ns, rc = 0 00000001:00080000:2.0:1762166850.183125:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000001:00080000:2.0:1762166850.183144:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934629 is committed 00000004:00080000:2.0:1762166850.183149:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1762166850.183164:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1762166850.183177:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:2.0:1762166850.183190:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00010000:3.0:1762166850.183222:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000031f22944 reply state 00000000a6c7cc5a transno 8589934629 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d457 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762166850.183248:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166850.183267:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451950720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166850.183276:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451950976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166850.183346:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451951104:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166850.183361:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166850.183390:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1762166850.183401:0:30819:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1762166850.183433:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:47948:x1847765444361088:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 10571us (10725us total) trans 8589934629 rc 0/0 00000100:00100000:1.0:1762166850.183445:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451950848:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166850.183447:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451950720 00000100:00100000:3.0:1762166850.183449:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 63 00000100:00100000:2.0:1762166850.183461:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451950720 00000100:00100000:1.0:1762166850.183503:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166850.183550:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451951104 00000100:00100000:2.0:1762166850.183551:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451950848 00000100:00100000:2.0:1762166850.183557:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451950848 00000100:00100000:3.0:1762166850.183561:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451951104 00000100:00100000:0.0:1762166850.183570:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:0.0:1762166850.183586:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765451950720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166850.183597:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1762166850.183607:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3293:x1847765451950848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166850.183614:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:3.0:1762166850.183631:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765451951104:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1762166850.183887:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d457 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762166850.183899:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765451950848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 287us (394us total) trans 17179869428 rc 0/0 00010000:00010000:1.0:1762166850.183908:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d457 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762166850.183910:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:0.0:1762166850.183920:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765451950720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 336us (578us total) trans 21474836758 rc 0/0 00010000:00010000:1.0:1762166850.183924:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d457 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762166850.183942:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216ca00 already unused, calling callback (ffffffffc2129310) 00000100:00100000:0.0:1762166850.183947:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00010000:00010000:1.0:1762166850.183951:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d457 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762166850.183963:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166850.183965:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d457 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762166850.183979:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451950976 00000100:00100000:3.0:1762166850.183982:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765451951104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 353us (589us total) trans 21474836759 rc 0/0 00000100:00100000:0.0:1762166850.183987:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451950976 00000100:00100000:3.0:1762166850.184019:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00010000:00010000:1.0:1762166850.184032:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960200) 00000100:00100000:0.0:1762166850.184033:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000004:00080000:2.0:1762166850.184040:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550f800/2, rc 0, transno 21474836758 00010000:00010000:1.0:1762166850.184041:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166850.184049:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d457 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762166850.184049:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3294:x1847765451950976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166850.184053:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451950720:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1762166850.184067:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d457 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000004:00080000:3.0:1762166850.184083:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550ea00/2, rc 0, transno 21474836759 00000100:00100000:3.0:1762166850.184093:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451951104:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762166850.184104:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f2d3480/2, rc 0, transno 17179869428 00000100:00100000:2.0:1762166850.184112:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451950848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166850.184209:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765451950976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 164us (253us total) trans 17179869429 rc 0/0 00000100:00100000:0.0:1762166850.184217:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000004:00080000:2.0:1762166850.184222:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f2d3100/2, rc 0, transno 17179869429 00000100:00100000:2.0:1762166850.184227:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451950976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166850.185706:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.185787:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444361216 00000100:00100000:3.0:1762166850.185795:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444361216 00000100:00100000:2.0:1762166850.185886:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 64 00000100:00100000:2.0:1762166850.185898:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:47948:x1847765444361216:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166850.185915:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166850.185933:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d45e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91045 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.185989:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d45e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91045 expref: 19 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.186015:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d45e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91045 expref: 19 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.186035:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960200) 00010000:00010000:2.0:1762166850.186038:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166850.186041:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686000, rc 0) 00000100:00100000:2.0:1762166850.186098:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:47948:x1847765444361216:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 202us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166850.186105:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 64 00000100:00100000:0.0:1762166850.188049:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.188106:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444361344 00000100:00100000:2.0:1762166850.188114:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444361344 00000100:00100000:2.0:1762166850.188159:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 65 00000100:00100000:2.0:1762166850.188166:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:47948:x1847765444361344:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166850.188180:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166850.188193:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d465 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9104c expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.188246:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d46c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.188254:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d46c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.188261:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d46c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166850.188280:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a:0x0]: returning size 16384 00000004:00200000:2.0:1762166850.188283:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166850.188305:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d46c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.188323:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d465 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9104c expref: 21 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.188335:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d46c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9104c expref: 20 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.188340:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960200) 00010000:00010000:2.0:1762166850.188342:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166850.188344:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687000, rc 0) 00000100:00100000:2.0:1762166850.188381:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:47948:x1847765444361344:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 216us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166850.188387:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 65 00000100:00100000:1.0:1762166850.190022:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166850.190093:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166850.190128:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444361472 00000100:00100000:0.0:1762166850.190139:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444361472 00000100:00100000:0.0:1762166850.190188:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444361600 00000100:00100000:0.0:1762166850.190192:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444361600 00000100:00100000:2.0:1762166850.190200:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 999 00000100:00100000:2.0:1762166850.190210:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2361:x1847765444361472:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166850.190225:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762166850.190226:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1000 00000100:00100000:0.0:1762166850.190236:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444361600:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166850.190244:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d473 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91053 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166850.190244:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166850.190256:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d47a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9105a expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166850.190268:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x82:0x0] initial LVB size: 16384, mtime: 0x69088842, atime: 0x0, ctime: 0x69088842, blocks: 0x1 00002000:00010000:0.0:1762166850.190270:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x82:0x0] initial LVB size: 0, mtime: 0x69088842, atime: 0x0, ctime: 0x69088842, blocks: 0x1 00010000:00010000:2.0:1762166850.190283:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166850.190283:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166850.190286:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166850.190286:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166850.190294:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d473 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91053 expref: 10 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166850.190294:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d47a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9105a expref: 9 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166850.190309:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d473 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91053 expref: 10 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166850.190309:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2439bf800/0xf915a5bdf3c9d47a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9105a expref: 9 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166850.190332:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686800, rc 0) 00010000:00010000:0.0:1762166850.190332:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2439bf800, rc 0) 00000100:00100000:2.0:1762166850.190383:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444361472:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 173us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166850.190383:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444361600:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 148us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166850.190390:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 999 00000100:00100000:0.0:1762166850.190396:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1000 00000100:00100000:0.0:1762166850.217993:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166850.218101:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444361728 00000100:00100000:1.0:1762166850.218120:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444361728 00000100:00100000:1.0:1762166850.218216:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 974 00000100:00100000:1.0:1762166850.218225:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2359:x1847765444361728:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762166850.218304:0:26247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d481 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166850.218323:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166850.218326:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166850.218333:0:26247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d481 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166850.218351:0:26247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d481 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166850.218557:0:26247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d481 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166850.218567:0:26247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d481 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166850.218583:0:26247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d481 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166850.218590:0:26247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166850.218595:0:26247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d481 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166850.218605:0:26247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d481 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166850.218623:0:26247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d481 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166850.218631:0:26247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d481 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166850.218730:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2359:x1847765444361728:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 504us (745us total) trans 0 rc 16384/16384 00000100:00100000:1.0:1762166850.218738:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 974 00000100:00100000:1.0:1762166850.221530:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.221687:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444361856 00000100:00100000:2.0:1762166850.221698:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444361856 00000100:00100000:2.0:1762166850.221817:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 975 00000100:00100000:2.0:1762166850.221830:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2358:x1847765444361856:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:2.0:1762166850.221904:0:26247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166850.221915:0:26247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d488 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.221930:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166850.221933:0:26247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166850.221939:0:26247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d488 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.221958:0:26247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d488 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762166850.235464:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869429 is committed 00002000:00010000:3.0:1762166850.235508:0:26247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb size from disk: 0 -> 16384 00002000:00010000:3.0:1762166850.235515:0:26247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb mtime from disk: 0 -> 1762166850 00002000:00010000:3.0:1762166850.235518:0:26247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb ctime from disk: 0 -> 1762166850 00000001:00080000:0.0:1762166850.235519:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869430 is committed 00002000:00010000:3.0:1762166850.235522:0:26247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb blocks from disk: 1 -> 35 00010000:00010000:3.0:1762166850.235550:0:26247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d488 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.235563:0:26247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d488 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.235573:0:26247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d488 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.235580:0:26247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166850.235585:0:26247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d488 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.235595:0:26247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d488 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.235618:0:26247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d488 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166850.235625:0:26247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d488 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26247 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166850.235738:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2358:x1847765444361856:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 13904us (14214us total) trans 17179869430 rc 0/0 00000100:00100000:3.0:1762166850.235751:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 975 00000100:00100000:0.0:1762166850.244222:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.244318:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444362112 00000100:00100000:2.0:1762166850.244333:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444362112 00000100:00100000:2.0:1762166850.244403:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 66 00000100:00100000:2.0:1762166850.244413:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:47948:x1847765444362112:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762166850.244488:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166850.244521:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d46c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9104c expref: 20 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.244559:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960200) 00010000:00010000:2.0:1762166850.244564:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166850.244910:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d48f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.244926:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d48f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.244936:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d48f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:2.0:1762166850.245019:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934630 00000004:00010000:2.0:1762166850.245045:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009bb83d7d reply state 000000002e95f738 transno 8589934631 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d48f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166850.245055:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166850.245158:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:47948:x1847765444362112:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 745us (948us total) trans 8589934631 rc 0/0 00000100:00100000:2.0:1762166850.245166:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 66 00000020:00080000:2.0:1762166850.245173:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762166850.246324:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d48f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166850.246340:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d48f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166850.246347:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d48f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166850.246380:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166850.246385:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d48f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166850.246394:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d48f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166850.246411:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960200) 00010000:00010000:1.0:1762166850.246414:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166850.246419:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d48f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166850.246426:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d48f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166850.246878:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.246918:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444362240 00000100:00100000:2.0:1762166850.246925:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444362240 00000100:00100000:2.0:1762166850.246967:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1001 00000100:00100000:2.0:1762166850.246977:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:47948:x1847765444362240:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166850.246990:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166850.247007:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9d496 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91061 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166850.247029:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x83:0x0] initial LVB size: 16384, mtime: 0x69088842, atime: 0x0, ctime: 0x69088842, blocks: 0x23 00010000:00010000:2.0:1762166850.247055:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166850.247056:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166850.247062:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9d496 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91061 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.247078:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee245686e00/0xf915a5bdf3c9d496 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91061 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.247089:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686e00, rc 0) 00000100:00100000:2.0:1762166850.247132:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:47948:x1847765444362240:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 158us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166850.247137:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1001 00000100:00100000:0.0:1762166850.248104:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.248146:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444362368 00000100:00100000:2.0:1762166850.248152:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444362368 00000100:00100000:2.0:1762166850.248184:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1002 00000100:00100000:2.0:1762166850.248191:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:47948:x1847765444362368:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166850.248199:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166850.248211:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee245686400/0xf915a5bdf3c9d49d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91068 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166850.248225:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166850.248234:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166850.248235:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166850.248238:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245686400/0xf915a5bdf3c9d49d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91068 expref: 11 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.248247:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee245686400/0xf915a5bdf3c9d49d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91068 expref: 11 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.248262:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686400, rc 0) 00000100:00100000:2.0:1762166850.248292:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:47948:x1847765444362368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 102us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166850.248296:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1002 00000100:00100000:1.0:1762166850.249187:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166850.249235:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.249276:0:26247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444362496 00000100:00100000:3.0:1762166850.249283:0:26247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444362496 00000100:00100000:2.0:1762166850.249296:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444362624 00000100:00100000:2.0:1762166850.249301:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444362624 00002000:00010000:3.0:1762166850.249306:0:26247:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/131 (16384->18446744073709551615) 00002000:00010000:2.0:1762166850.249316:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/131 (0->18446744073709551615) 00002000:00100000:3.0:1762166850.249317:0:26247:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354f480 with x1847765444362496 ext(16384->18446744073709551615) 00002000:00100000:2.0:1762166850.249321:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354ed80 with x1847765444362624 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166850.249331:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24354ed80. 00002000:00010000:3.0:1762166850.249341:0:26247:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24354f480. 00000100:00100000:2.0:1762166850.249372:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 976 00000100:00100000:2.0:1762166850.249381:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444362624:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762166850.249389:0:26247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 977 00000100:00100000:3.0:1762166850.249400:0:26247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444362496:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762166850.249686:0:26247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb size from disk: 16384 -> 16384 00002000:00010000:3.0:1762166850.249690:0:26247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb mtime from disk: 1762166850 -> 1762166850 00002000:00010000:2.0:1762166850.249692:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x83:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166850.249693:0:26247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166850.249697:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x83:0x0] updating lvb mtime from disk: 0 -> 1762166850 00002000:00010000:3.0:1762166850.249698:0:26247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb ctime from disk: 1762166850 -> 1762166850 00002000:00010000:2.0:1762166850.249701:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x83:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166850.249703:0:26247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb blocks from disk: 35 -> 35 00002000:00010000:2.0:1762166850.249705:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x83:0x0] updating lvb ctime from disk: 0 -> 1762166850 00002000:00010000:2.0:1762166850.249710:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x83:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762166850.249744:0:26247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2360:x1847765444362496:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 347us (564us total) trans 17179869431 rc 0/0 00000100:00100000:3.0:1762166850.249752:0:26247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 977 00000100:00100000:2.0:1762166850.249753:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444362624:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 370us (515us total) trans 21474836760 rc 0/0 00002000:00010000:3.0:1762166850.249755:0:26247:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/131 (16384->18446744073709551615) 00002000:00100000:3.0:1762166850.249789:0:26247:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354f480 with x1847765444362496 ext(16384->18446744073709551615) 00002000:00010000:3.0:1762166850.249796:0:26247:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24354f480. 00000100:00100000:2.0:1762166850.249797:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 976 00002000:00010000:2.0:1762166850.249804:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/131 (0->18446744073709551615) 00002000:00100000:2.0:1762166850.249807:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354ed80 with x1847765444362624 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166850.249813:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24354ed80. 00000100:00100000:0.0:1762166850.250874:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.250923:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444362880 00000100:00100000:2.0:1762166850.250929:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444362880 00000100:00100000:2.0:1762166850.250978:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 67 00000100:00100000:2.0:1762166850.250987:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:47948:x1847765444362880:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762166850.251068:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4a4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.251084:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4a4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.251095:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4a4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:2.0:1762166850.251184:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006f39f622 reply state 000000005efe48e4 transno 8589934632 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4a4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166850.251190:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166850.251245:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:47948:x1847765444362880:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 257us (372us total) trans 8589934632 rc 0/0 00000100:00100000:2.0:1762166850.251252:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 67 00010000:00010000:3.0:1762166850.251884:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4a4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166850.251894:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4a4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166850.251900:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4a4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166850.251905:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166850.251909:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4a4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166850.251916:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4a4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166850.251943:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960200) 00010000:00010000:3.0:1762166850.251945:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166850.251949:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4a4 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166850.251953:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4a4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166850.252149:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.252195:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444363008 00000100:00100000:2.0:1762166850.252202:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444363008 00000100:00100000:2.0:1762166850.252235:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1003 00000100:00100000:2.0:1762166850.252246:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444363008:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762166850.252261:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166850.252286:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444363136 00000100:00100000:0.0:1762166850.252294:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444363136 00000100:00100000:0.0:1762166850.252330:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1004 00000100:00100000:0.0:1762166850.252340:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444363136:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166850.252361:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb size from disk: 16384 -> 16384 00002000:00010000:2.0:1762166850.252364:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb mtime from disk: 1762166850 -> 1762166850 00002000:00010000:2.0:1762166850.252366:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb atime from disk: 0 -> 1762166850 00002000:00010000:2.0:1762166850.252368:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb ctime from disk: 1762166850 -> 1762166850 00002000:00010000:2.0:1762166850.252370:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166850.252410:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765444363008:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 166us (261us total) trans 21474836761 rc 0/0 00000100:00100000:2.0:1762166850.252427:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1003 00002000:00010000:0.0:1762166850.252455:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166850.252459:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb mtime from disk: 1762166850 -> 1762166850 00002000:00010000:0.0:1762166850.252462:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb atime from disk: 0 -> 1762166850 00002000:00010000:0.0:1762166850.252464:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb ctime from disk: 1762166850 -> 1762166850 00002000:00010000:0.0:1762166850.252479:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:0.0:1762166850.252516:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444363136:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 179us (257us total) trans 17179869432 rc 0/0 00000100:00100000:0.0:1762166850.252524:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1004 00000100:00100000:1.0:1762166850.253464:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.253509:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444363392 00000100:00100000:2.0:1762166850.253514:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444363392 00000100:00100000:2.0:1762166850.253545:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 13 00000100:00100000:2.0:1762166850.253551:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:47948:x1847765444363392:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166850.253587:0:31351:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x1a:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d43b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9103e expref: 22 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.253625:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4ab lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166850.253639:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d45e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91045 expref: 22 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.253647:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4ab lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166850.253674:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d45e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91045 expref: 22 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.253686:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d45e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91045 expref: 22 pid: 30817 timeout: 571 lvb_type: 0 00000100:00100000:2.0:1762166850.253699:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451951232:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166850.253753:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166850.254639:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451951232:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166850.254659:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4ab lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166850.254867:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.254956:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444363520 00000100:00100000:2.0:1762166850.254961:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444363520 00010000:00010000:2.0:1762166850.254983:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d45e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91045 expref: 23 pid: 30817 timeout: 571 lvb_type: 0 00000100:00100000:2.0:1762166850.255016:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 611 00000100:00100000:2.0:1762166850.255026:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444363520:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166850.255038:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166850.255044:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d45e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91045 expref: 23 pid: 30817 timeout: 571 lvb_type: 0 00010000:00010000:2.0:1762166850.255054:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d45e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91045 expref: 23 pid: 30817 timeout: 571 lvb_type: 0 00010000:00010000:2.0:1762166850.255068:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d45e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91045 expref: 23 pid: 30817 timeout: 571 lvb_type: 0 00010000:00010000:2.0:1762166850.255081:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960200) 00010000:00010000:2.0:1762166850.255085:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4ab lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166850.255093:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4ab lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166850.255099:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4ab lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166850.255132:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166850.255165:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4ab lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166850.255170:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444363520:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 145us (303us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166850.255185:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4ab lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166850.255190:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 611 00000040:00080000:0.0:1762166850.255548:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].7, 88 off8760 00000004:00080000:0.0:1762166850.255557:0:31351:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 471047794203ns, next at 467115847658ns, rc = 0 00000040:00080000:0.0:1762166850.255635:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].6, 88 off8696 00000004:00080000:0.0:1762166850.255641:0:31351:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 471047878487ns, next at 0ns, rc = 0 00000040:00080000:0.0:1762166850.255672:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].7, 88 off8784 00000004:00080000:0.0:1762166850.255677:0:31351:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 471047913972ns, next at 0ns, rc = 0 00000040:00080000:0.0:1762166850.255702:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].8, 88 off8848 00000004:00080000:0.0:1762166850.255707:0:31351:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 471047944341ns, next at 467115847658ns, rc = 0 00000004:00010000:2.0:1762166850.264206:0:31351:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c39532bf reply state 00000000d06195a9 transno 8589934633 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4ab lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000001:00080000:3.0:1762166850.264217:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934633 is committed 00000100:00100000:2.0:1762166850.264226:0:31351:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00080000:3.0:1762166850.264227:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00010000:00010000:2.0:1762166850.264237:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960200) 00010000:00010000:2.0:1762166850.264242:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:3.0:1762166850.264247:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00010000:00010000:2.0:1762166850.264250:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d43b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9103e expref: 21 pid: 30819 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762166850.264266:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:3.0:1762166850.264271:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:3.0:1762166850.264342:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee3819bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451951360:0@lo:2:osp-syn-0-0.0 00010000:00080000:2.0:1762166850.264352:0:31351:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1762166850.264371:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:47948:x1847765444363392:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 10818us (10907us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1762166850.264384:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 13 00000100:00100000:3.0:1762166850.264400:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166850.264434:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451951360 00000100:00100000:0.0:1762166850.264443:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451951360 00000100:00100000:0.0:1762166850.264502:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00010000:00010000:1.0:1762166850.264509:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4ab lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166850.264516:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765451951360:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1762166850.264522:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4ab lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166850.264530:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4ab lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166850.264536:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166850.264541:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4ab lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166850.264556:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4ab lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166850.264569:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee363960200) 00010000:00010000:1.0:1762166850.264572:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166850.264575:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4ab lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166850.264581:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4ab lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166850.264613:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451951744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166850.264643:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166850.264668:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451951744 00000100:00100000:1.0:1762166850.264669:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee3819bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451951616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166850.264676:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451951744 00002000:00010000:0.0:1762166850.264697:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb size from disk: 16384 -> 16384 00000100:00100000:1.0:1762166850.264704:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762166850.264705:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb mtime from disk: 1762166850 -> 1762166850 00002000:00010000:0.0:1762166850.264710:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb atime from disk: 1762166850 -> 1762166850 00002000:00010000:0.0:1762166850.264712:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb ctime from disk: 1762166850 -> 1762166850 00002000:00010000:0.0:1762166850.264715:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166850.264732:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451951616 00000100:00100000:2.0:1762166850.264738:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451951616 00000100:00100000:1.0:1762166850.264751:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1762166850.264781:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765451951360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 249us (362us total) trans 21474836762 rc 0/0 00000100:00100000:0.0:1762166850.264790:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:3.0:1762166850.264797:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:1.0:1762166850.264799:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451951488:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166850.264806:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:3.0:1762166850.264807:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3294:x1847765451951744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166850.264821:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765451951616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166850.264838:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762166850.264846:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee3819bb480/2, rc 0, transno 21474836762 00000100:00100000:0.0:1762166850.264854:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee3819bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451951360:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166850.264873:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451951488 00000100:00100000:1.0:1762166850.264878:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451951488 00000100:00100000:1.0:1762166850.264912:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:1.0:1762166850.264922:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765451951488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762166850.264963:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb size from disk: 16384 -> 16384 00002000:00010000:3.0:1762166850.264967:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb mtime from disk: 1762166850 -> 1762166850 00002000:00010000:3.0:1762166850.264970:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166850.264973:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb ctime from disk: 1762166850 -> 1762166850 00002000:00010000:2.0:1762166850.264974:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x83:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166850.264976:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb blocks from disk: 35 -> 35 00002000:00010000:2.0:1762166850.264981:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x83:0x0] updating lvb mtime from disk: 1762166850 -> 1762166850 00002000:00010000:2.0:1762166850.264985:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x83:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166850.264988:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x83:0x0] updating lvb ctime from disk: 1762166850 -> 1762166850 00002000:00010000:2.0:1762166850.264990:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x83:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166850.265036:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765451951616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 218us (334us total) trans 21474836763 rc 0/0 00000100:00100000:2.0:1762166850.265044:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00002000:00010000:1.0:1762166850.265052:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166850.265057:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb mtime from disk: 1762166850 -> 1762166850 00002000:00010000:1.0:1762166850.265064:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb atime from disk: 1762166850 -> 1762166850 00000004:00080000:0.0:1762166850.265064:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee3819bbb80/2, rc 0, transno 21474836763 00002000:00010000:1.0:1762166850.265067:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb ctime from disk: 1762166850 -> 1762166850 00002000:00010000:1.0:1762166850.265070:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762166850.265079:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee3819bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451951616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166850.265113:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3294:x1847765451951488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 192us (274us total) trans 17179869434 rc 0/0 00000100:00100000:3.0:1762166850.265115:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3294:x1847765451951744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 309us (470us total) trans 17179869433 rc 0/0 00000100:00100000:0.0:1762166850.265124:0:3294:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869429 gen 2 00000100:00100000:3.0:1762166850.265126:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000004:00080000:0.0:1762166850.265130:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f2d1180, transno 17179869425 00000100:00100000:1.0:1762166850.265134:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000004:00080000:0.0:1762166850.265144:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242ce9f80, transno 17179869426 00000004:00080000:0.0:1762166850.265149:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f2d3480, transno 17179869428 00000004:00080000:0.0:1762166850.265154:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f2d3100, transno 17179869429 00000100:00100000:0.0:1762166850.265162:0:3294:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee24354c700 x1847765451951488/t17179869434(17179869434) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166866 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1762166850.265172:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24354c700/2, rc 0, transno 17179869434 00000100:00100000:0.0:1762166850.265176:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451951488:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762166850.265190:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24354fb80/2, rc 0, transno 17179869433 00000100:00100000:0.0:1762166850.265195:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451951744:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762166850.265315:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 3 in progress, 0 in flight, 3 done 00000100:00100000:3.0:1762166850.265564:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.265605:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444363648 00000100:00100000:2.0:1762166850.265611:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444363648 00000100:00100000:2.0:1762166850.265643:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 68 00000100:00100000:2.0:1762166850.265651:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:47948:x1847765444363648:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166850.265661:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166850.265674:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d4b2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9106f expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.265715:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d4b2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9106f expref: 18 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.265728:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d4b2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9106f expref: 18 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.265744:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee343a13d00) 00010000:00010000:2.0:1762166850.265747:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166850.265750:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245686000, rc 0) 00000100:00100000:2.0:1762166850.265808:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:47948:x1847765444363648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 157us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166850.265815:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 68 00000100:00100000:1.0:1762166850.267014:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.267051:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444363904 00000100:00100000:2.0:1762166850.267056:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444363904 00000100:00100000:2.0:1762166850.267087:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 14 00000100:00100000:2.0:1762166850.267094:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:47948:x1847765444363904:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166850.267288:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:47948:x1847765444363904:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 192us (278us total) trans 8589934634 rc 0/0 00000100:00100000:2.0:1762166850.267307:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 14 00000100:00100000:1.0:1762166850.277669:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.277734:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444364160 00000100:00100000:2.0:1762166850.277744:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444364160 00000100:00100000:2.0:1762166850.277838:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 69 00000100:00100000:2.0:1762166850.277848:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:47950:x1847765444364160:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166850.277869:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166850.277890:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d4b9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91076 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.277958:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4c0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.277968:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4c0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.277976:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4c0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.277985:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4c7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.277989:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.277993:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.278078:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4c0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.278082:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4c0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.278099:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4c0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.278104:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.278106:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4c0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.278111:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4c0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.278120:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:2.0:1762166850.278122:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.278125:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4c0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.278128:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4c0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.278137:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.278140:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4c7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.278143:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4c7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.278146:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.278148:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4c7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.278151:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4c7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.278159:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x98a5b8df (ffff9ee343a13800) 00010000:00010000:2.0:1762166850.278160:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.278162:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4c7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.278165:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4c7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.278191:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d4b9 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91076 expref: 20 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.278197:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:2.0:1762166850.278198:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166850.278200:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d4b9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91076 expref: 20 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.278206:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687000, rc 0) 00000100:00100000:2.0:1762166850.278250:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:47950:x1847765444364160:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 405us (591us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166850.278255:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 69 00000100:00100000:3.0:1762166850.279457:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.279509:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444364416 00000100:00100000:2.0:1762166850.279515:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444364416 00000100:00100000:2.0:1762166850.279553:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 70 00000100:00100000:2.0:1762166850.279562:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:47950:x1847765444364416:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166850.279574:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166850.279585:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9d4ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9107d expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1762166850.279692:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19:0x0]: returning size 11776 00010000:00010000:2.0:1762166850.279816:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9d4ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9107d expref: 21 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.279826:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee360714500) 00010000:00010000:2.0:1762166850.279828:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166850.279831:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687e00/0xf915a5bdf3c9d4ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9107d expref: 21 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.279838:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee245687e00, rc 0) 00000100:00100000:2.0:1762166850.279869:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:47950:x1847765444364416:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 310us (422us total) trans 8589934635 rc 301/301 00000100:00100000:2.0:1762166850.279874:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 70 00000100:00100000:1.0:1762166850.280852:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.280889:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444364544 00000100:00100000:2.0:1762166850.280895:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444364544 00000100:00100000:2.0:1762166850.280931:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 71 00000100:00100000:2.0:1762166850.280940:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:47950:x1847765444364544:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166850.280984:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4dc lrc: 3/1,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.280997:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4dc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281006:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4dc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281018:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4e3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281038:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281046:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281122:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d4ea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281130:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d4ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281137:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d4ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166850.281162:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a:0x0]: returning size 16384 00000004:00200000:2.0:1762166850.281166:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166850.281174:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d4ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281184:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4dc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281190:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4dc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281197:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4dc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281204:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.281207:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4dc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281214:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4dc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281230:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:2.0:1762166850.281233:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.281246:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4dc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281254:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687400/0xf915a5bdf3c9d4dc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281265:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281270:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4e3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281275:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281279:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.281282:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281287:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4e3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281293:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x98a5b8df (ffff9ee343a13900) 00010000:00010000:2.0:1762166850.281296:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.281298:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4e3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281303:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686a00/0xf915a5bdf3c9d4e3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281314:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d4ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281327:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d4ea lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281332:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d4ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281337:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.281339:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d4ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281345:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d4ea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281352:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee343a13d00) 00010000:00010000:2.0:1762166850.281354:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.281356:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d4ea lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.281362:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687800/0xf915a5bdf3c9d4ea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166850.281414:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:47950:x1847765444364544:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 475us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166850.281421:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 71 00000100:00100000:1.0:1762166850.282461:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.282517:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444364800 00000100:00100000:2.0:1762166850.282523:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444364800 00000100:00100000:2.0:1762166850.282554:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 15 00000100:00100000:2.0:1762166850.282559:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:47950:x1847765444364800:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166850.282719:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:47950:x1847765444364800:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 157us (259us total) trans 8589934636 rc 0/0 00000100:00100000:2.0:1762166850.282738:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 15 00000100:00100000:3.0:1762166850.290724:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.290813:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444365056 00000100:00100000:2.0:1762166850.290824:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444365056 00000100:00100000:2.0:1762166850.290880:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 72 00000100:00100000:2.0:1762166850.290891:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:47952:x1847765444365056:12345-192.168.203.35@tcp:101:multiop.0 00010000:00010000:2.0:1762166850.290912:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166850.290930:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d4f1 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91084 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.291060:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4f8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291071:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4f8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291082:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4f8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291097:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4ff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291103:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291109:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291184:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9d506 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291193:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9d506 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291209:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9d506 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166850.291220:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a:0x0]: returning size 16384 00010000:00010000:2.0:1762166850.291294:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4f8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291299:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4f8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291303:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291307:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245687600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.291310:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291316:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4f8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291326:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:2.0:1762166850.291329:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.291333:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4f8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291339:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687600/0xf915a5bdf3c9d4f8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291351:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291357:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4ff lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291387:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291392:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee245686c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.291395:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291401:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4ff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291409:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x98a5b8df (ffff9ee343a13800) 00010000:00010000:2.0:1762166850.291411:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.291414:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4ff lrc: 2/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291419:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686c00/0xf915a5bdf3c9d4ff lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.291491:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687000/0xf915a5bdf3c9d4f1 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91084 expref: 24 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.291505:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9d506 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91084 expref: 23 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.291513:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee343a13d00) 00010000:00010000:2.0:1762166850.291515:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166850.291518:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2e00, rc 0) 00000100:00100000:2.0:1762166850.291575:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:47952:x1847765444365056:12345-192.168.203.35@tcp:101:multiop.0 Request processed in 685us (858us total) trans 8589934637 rc 0/0 00000100:00100000:2.0:1762166850.291582:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 72 00000100:00100000:1.0:1762166850.293429:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.293481:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444365184 00000100:00100000:2.0:1762166850.293489:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444365184 00002000:00100000:2.0:1762166850.293524:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x83:0x0] (0->4095) req@ffff9ee24354d500 x1847765444365184/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:636/0 lens 488/0 e 0 to 0 dl 1762166861 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166850.293535:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354d500 with x1847765444365184 ext(0->4095) 00002000:00010000:2.0:1762166850.293540:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24354d500 00000100:00100000:2.0:1762166850.293568:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 978 00000100:00100000:2.0:1762166850.293578:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765444365184:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:2.0:1762166850.293747:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765444365184:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 171us (322us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166850.293755:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 978 00002000:00100000:2.0:1762166850.293822:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x83:0x0] (0->4095) req@ffff9ee24354d500 x1847765444365184/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:636/0 lens 488/4536 e 0 to 0 dl 1762166861 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166850.293831:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354d500 with x1847765444365184 ext(0->4095) 00002000:00010000:2.0:1762166850.293834:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24354d500 00000100:00100000:1.0:1762166850.295134:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.295181:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444365440 00000100:00100000:2.0:1762166850.295189:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444365440 00000100:00100000:2.0:1762166850.295230:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 73 00000100:00100000:2.0:1762166850.295239:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:47952:x1847765444365440:12345-192.168.203.35@tcp:101:multiop.0 00010000:00010000:2.0:1762166850.295254:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166850.295257:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762166850.295281:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9d506 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91084 expref: 23 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.295297:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686000/0xf915a5bdf3c9d4b2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9106f expref: 22 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.295322:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee343a13d00) 00010000:00010000:2.0:1762166850.295332:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166850.295352:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9d514 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9108b expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.295406:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9d51b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.295418:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9d51b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.295426:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9d51b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000040:00080000:2.0:1762166850.295853:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].9, 88 off8936 00000004:00080000:2.0:1762166850.295862:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 471088098594ns, next at 467115847658ns, rc = 0 00000040:00080000:2.0:1762166850.295913:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].8, 88 off8872 00000004:00080000:2.0:1762166850.295919:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 471088156397ns, next at 0ns, rc = 0 00000040:00080000:2.0:1762166850.295963:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].9, 88 off8960 00000004:00080000:2.0:1762166850.295970:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 471088206997ns, next at 0ns, rc = 0 00000040:00080000:2.0:1762166850.296001:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].10, 88 off9024 00000004:00080000:2.0:1762166850.296006:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 471088243642ns, next at 467115847658ns, rc = 0 00010000:00010000:2.0:1762166850.304926:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9d51b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9108b expref: 24 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.304945:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:2.0:1762166850.304949:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000001:00080000:3.0:1762166850.304968:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00010000:00010000:2.0:1762166850.304971:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9d514 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9108b expref: 24 pid: 30817 timeout: 0 lvb_type: 3 00000004:00080000:3.0:1762166850.304985:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000004:00080000:3.0:1762166850.305007:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00010000:00010000:2.0:1762166850.305018:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9d51b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9108b expref: 22 pid: 30817 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762166850.305024:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:3.0:1762166850.305030:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00010000:00010000:2.0:1762166850.305054:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:2.0:1762166850.305061:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1762166850.305066:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3600, rc 0) 00000100:00100000:3.0:1762166850.305129:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee3819bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451951872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166850.305152:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:47952:x1847765444365440:12345-192.168.203.35@tcp:101:multiop.0 Request processed in 9910us (10017us total) trans 8589934638 rc 0/0 00000100:00100000:1.0:1762166850.305160:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451952128:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166850.305167:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 73 00000100:00100000:0.0:1762166850.305231:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451952000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166850.305236:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166850.305283:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451951872 00000100:00100000:1.0:1762166850.305293:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451951872 00000100:00100000:0.0:1762166850.305299:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166850.305337:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166850.305368:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451952000 00000100:00100000:2.0:1762166850.305377:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451952128 00000100:00100000:1.0:1762166850.305377:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451952000 00000100:00100000:3.0:1762166850.305381:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1762166850.305386:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451952128 00000100:00100000:0.0:1762166850.305398:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:0.0:1762166850.305418:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765451951872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166850.305426:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:2.0:1762166850.305433:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:1.0:1762166850.305435:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765451952000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166850.305447:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765451952128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166850.305478:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee3819b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451952256:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166850.305522:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166850.305576:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451952256 00000100:00100000:3.0:1762166850.305582:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451952256 00000100:00100000:3.0:1762166850.305620:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:3.0:1762166850.305628:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765451952256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762166850.305754:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb size from disk: 16384 -> 16384 00002000:00010000:0.0:1762166850.305759:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb mtime from disk: 1762166850 -> 1762166850 00002000:00010000:0.0:1762166850.305798:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb atime from disk: 1762166850 -> 1762166850 00002000:00010000:2.0:1762166850.305802:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb size from disk: 16384 -> 16384 00002000:00010000:0.0:1762166850.305802:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb ctime from disk: 1762166850 -> 1762166850 00002000:00010000:1.0:1762166850.305813:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166850.305817:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb mtime from disk: 1762166850 -> 1762166850 00002000:00010000:0.0:1762166850.305817:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1762166850.305822:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb mtime from disk: 1762166850 -> 1762166850 00002000:00010000:3.0:1762166850.305827:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x83:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166850.305832:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb atime from disk: 1762166850 -> 1762166850 00002000:00010000:2.0:1762166850.305833:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166850.305834:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x83:0x0] updating lvb mtime from disk: 1762166850 -> 1762166850 00002000:00010000:3.0:1762166850.305847:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x83:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166850.305848:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb ctime from disk: 1762166850 -> 1762166850 00002000:00010000:2.0:1762166850.305851:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb ctime from disk: 1762166850 -> 1762166850 00002000:00010000:3.0:1762166850.305858:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x83:0x0] updating lvb ctime from disk: 1762166850 -> 1762166850 00002000:00010000:3.0:1762166850.305865:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x83:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:2.0:1762166850.305865:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x83:0x0] updating lvb blocks from disk: 35 -> 35 00002000:00010000:1.0:1762166850.305865:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x82:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762166850.305879:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765451951872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 459us (639us total) trans 21474836764 rc 0/0 00000100:00100000:0.0:1762166850.305895:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:3.0:1762166850.305927:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765451952256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 297us (406us total) trans 21474836765 rc 0/0 00000100:00100000:3.0:1762166850.305937:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:2.0:1762166850.305970:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765451952128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 516us (624us total) trans 17179869435 rc 0/0 00000100:00100000:1.0:1762166850.305970:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765451952000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 528us (664us total) trans 17179869436 rc 0/0 00000100:00100000:1.0:1762166850.305986:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000004:00080000:3.0:1762166850.305994:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee3819b8e00/2, rc 0, transno 21474836765 00000004:00080000:0.0:1762166850.305994:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee3819bad80/2, rc 0, transno 21474836764 00000100:00100000:2.0:1762166850.305995:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:3.0:1762166850.306008:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee3819b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451952256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166850.306014:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee3819bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451951872:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762166850.306038:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f286300/2, rc 0, transno 17179869435 00000100:00100000:3.0:1762166850.306045:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451952128:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762166850.306074:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24354ce00/2, rc 0, transno 17179869436 00000100:00100000:0.0:1762166850.306081:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451952000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166850.306958:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166850.307037:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444365568 00000100:00100000:0.0:1762166850.307043:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444365568 00000100:00100000:0.0:1762166850.307089:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1013 00000100:00100000:0.0:1762166850.307098:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:47952:x1847765444365568:12345-192.168.203.35@tcp:101:multiop.0 00010000:00010000:0.0:1762166850.307114:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166850.307134:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d522 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91092 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166850.307170:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d473 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91053 expref: 14 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166850.307180:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166850.307182:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166850.307186:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d522 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91092 expref: 14 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166850.307219:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d473 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91053 expref: 14 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166850.307235:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d473 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91053 expref: 14 pid: 6533 timeout: 571 lvb_type: 1 00000100:00100000:0.0:1762166850.307248:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee3819bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451952384:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166850.307330:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fca8240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166850.308485:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee3819bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451952384:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166850.308514:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d522 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91092 expref: 14 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166850.308532:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2439bec00, rc 0) 00000100:00100000:0.0:1762166850.308584:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:47952:x1847765444365568:12345-192.168.203.35@tcp:101:multiop.0 Request processed in 1487us (1628us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166850.308592:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1013 00000100:00100000:1.0:1762166850.308823:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166850.308895:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444365696 00000100:00100000:0.0:1762166850.308902:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444365696 00010000:00010000:0.0:1762166850.308934:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d473 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91053 expref: 14 pid: 6533 timeout: 571 lvb_type: 1 00000100:00100000:0.0:1762166850.308969:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 612 00000100:00100000:0.0:1762166850.308980:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2361:x1847765444365696:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166850.308998:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166850.309020:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d473 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91053 expref: 14 pid: 6533 timeout: 571 lvb_type: 1 00010000:00010000:0.0:1762166850.309034:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d473 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91053 expref: 14 pid: 6533 timeout: 571 lvb_type: 1 00010000:00010000:0.0:1762166850.309059:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee245686800/0xf915a5bdf3c9d473 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91053 expref: 14 pid: 6533 timeout: 571 lvb_type: 1 00010000:00010000:0.0:1762166850.309073:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166850.309087:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166850.309096:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d522 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91092 expref: 13 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166850.309107:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d522 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91092 expref: 13 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166850.309139:0:5741:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2439bec00/0xf915a5bdf3c9d522 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91092 expref: 13 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166850.309152:0:5741:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee3819bb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5741:1847765451952512:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762166850.309209:0:5741:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fca8240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166850.310022:0:5741:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee3819bb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5741:1847765451952512:192.168.203.35@tcp:105: 00010000:00010000:0.0:1762166850.310038:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166850.310083:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444365696:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1105us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166850.310092:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 612 00000100:00100000:2.0:1762166850.322480:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.322535:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444365824 00000100:00100000:3.0:1762166850.322545:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444365824 00002000:00100000:3.0:1762166850.322591:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x82:0x0] (0->4095) req@ffff9ee36e3b3b80 x1847765444365824/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:636/0 lens 488/0 e 0 to 0 dl 1762166861 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166850.322615:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b3b80 with x1847765444365824 ext(0->4095) 00002000:00010000:3.0:1762166850.322621:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b3b80 00000100:00100000:3.0:1762166850.322651:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 979 00000100:00100000:3.0:1762166850.322662:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444365824:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:3.0:1762166850.322895:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444365824:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 235us (437us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166850.322904:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 979 00002000:00100000:3.0:1762166850.322911:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x82:0x0] (0->4095) req@ffff9ee36e3b3b80 x1847765444365824/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:636/0 lens 488/4536 e 0 to 0 dl 1762166861 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166850.322919:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b3b80 with x1847765444365824 ext(0->4095) 00002000:00010000:3.0:1762166850.322923:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b3b80 00000100:00100000:1.0:1762166850.324489:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.324587:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444365952 00000100:00100000:3.0:1762166850.324595:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444365952 00002000:00100000:3.0:1762166850.324622:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x82:0x0] (4096->8191) req@ffff9ee36f284a80 x1847765444365952/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:636/0 lens 488/0 e 0 to 0 dl 1762166861 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166850.324630:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f284a80 with x1847765444365952 ext(4096->8191) 00002000:00010000:3.0:1762166850.324633:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f284a80 00000100:00100000:3.0:1762166850.324652:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 980 00000100:00100000:3.0:1762166850.324658:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765444365952:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:3.0:1762166850.324852:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765444365952:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 193us (366us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166850.324860:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 980 00002000:00100000:3.0:1762166850.324867:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x82:0x0] (4096->8191) req@ffff9ee36f284a80 x1847765444365952/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:636/0 lens 488/4536 e 0 to 0 dl 1762166861 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166850.324876:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f284a80 with x1847765444365952 ext(4096->8191) 00002000:00010000:3.0:1762166850.324880:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f284a80 00000100:00100000:0.0:1762166850.326276:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.326328:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444366080 00000100:00100000:3.0:1762166850.326336:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444366080 00002000:00100000:3.0:1762166850.326367:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x82:0x0] (8192->12287) req@ffff9ee3819bb800 x1847765444366080/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:636/0 lens 488/0 e 0 to 0 dl 1762166861 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166850.326377:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee3819bb800 with x1847765444366080 ext(8192->12287) 00002000:00010000:3.0:1762166850.326382:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee3819bb800 00000100:00100000:3.0:1762166850.326417:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 981 00000100:00100000:3.0:1762166850.326426:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444366080:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:3.0:1762166850.326578:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444366080:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 153us (307us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166850.326586:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 981 00002000:00100000:3.0:1762166850.326593:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x82:0x0] (8192->12287) req@ffff9ee3819bb800 x1847765444366080/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:636/0 lens 488/4536 e 0 to 0 dl 1762166861 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166850.326602:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee3819bb800 with x1847765444366080 ext(8192->12287) 00002000:00010000:3.0:1762166850.326605:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee3819bb800 00000100:00100000:2.0:1762166850.328352:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166850.328410:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444366208 00000100:00100000:3.0:1762166850.328438:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444366208 00002000:00100000:3.0:1762166850.328505:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x82:0x0] (12288->16383) req@ffff9ee36e3b2a00 x1847765444366208/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:636/0 lens 488/0 e 0 to 0 dl 1762166861 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166850.328517:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b2a00 with x1847765444366208 ext(12288->16383) 00002000:00010000:3.0:1762166850.328523:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b2a00 00000100:00100000:3.0:1762166850.328556:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 982 00000100:00100000:3.0:1762166850.328565:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765444366208:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:3.0:1762166850.328760:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765444366208:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 195us (419us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166850.328803:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 982 00002000:00100000:3.0:1762166850.328812:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x82:0x0] (12288->16383) req@ffff9ee36e3b2a00 x1847765444366208/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:636/0 lens 488/4536 e 0 to 0 dl 1762166861 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166850.328821:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b2a00 with x1847765444366208 ext(12288->16383) 00002000:00010000:3.0:1762166850.328824:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b2a00 00000100:00100000:1.0:1762166850.330273:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.330325:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444366464 00000100:00100000:2.0:1762166850.330331:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444366464 00000100:00100000:2.0:1762166850.330370:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16 00000100:00100000:2.0:1762166850.330387:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:47952:x1847765444366464:12345-192.168.203.35@tcp:35:multiop.0 00000100:00100000:2.0:1762166850.330816:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:47952:x1847765444366464:12345-192.168.203.35@tcp:35:multiop.0 Request processed in 429us (547us total) trans 8589934639 rc 0/0 00000100:00100000:2.0:1762166850.330821:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16 00000100:00100000:0.0:1762166850.340676:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.340757:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444366720 00000100:00100000:2.0:1762166850.340793:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444366720 00000100:00100000:2.0:1762166850.340858:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 74 00000100:00100000:2.0:1762166850.340868:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:47954:x1847765444366720:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166850.340896:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166850.340921:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9d529 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91099 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.340986:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9d530 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.340997:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9d530 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341004:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9d530 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341015:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9d537 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341021:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9d537 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341028:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9d537 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341150:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9d530 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341170:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9d530 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341177:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9d530 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341183:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.341187:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9d530 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341194:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9d530 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341206:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:2.0:1762166850.341209:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.341213:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9d530 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341219:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9d530 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341232:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9d537 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341237:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9d537 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341243:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9d537 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341249:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.341251:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9d537 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341266:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9d537 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341273:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x98a5b8df (ffff9ee343a13200) 00010000:00010000:2.0:1762166850.341276:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.341279:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9d537 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341284:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9d537 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.341325:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9d529 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91099 expref: 20 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.341336:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:2.0:1762166850.341338:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166850.341342:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9d529 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91099 expref: 20 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.341351:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2800, rc 0) 00000100:00100000:2.0:1762166850.341409:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:47954:x1847765444366720:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 543us (740us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166850.341416:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 74 00000100:00100000:1.0:1762166850.343234:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.343331:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444366976 00000100:00100000:2.0:1762166850.343338:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444366976 00000100:00100000:2.0:1762166850.343389:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 75 00000100:00100000:2.0:1762166850.343397:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:47954:x1847765444366976:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166850.343412:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166850.343433:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9d53e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f910a0 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.343548:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9d545 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.343561:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9d545 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.343570:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9d545 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166850.343579:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19:0x0]: returning size 11776 00010000:00010000:2.0:1762166850.343686:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9d53e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910a0 expref: 22 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.343700:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9d545 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910a0 expref: 21 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166850.343707:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:2.0:1762166850.343709:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166850.343712:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2a00, rc 0) 00000100:00100000:2.0:1762166850.343758:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:47954:x1847765444366976:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 362us (531us total) trans 8589934640 rc 0/0 00000100:00100000:2.0:1762166850.343793:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 75 00000100:00100000:1.0:1762166850.345061:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166850.345095:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444367104 00000100:00100000:2.0:1762166850.345100:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444367104 00000100:00100000:2.0:1762166850.345131:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 76 00000100:00100000:2.0:1762166850.345137:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:47954:x1847765444367104:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166850.345175:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9d553 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345192:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9d553 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345199:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9d553 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345208:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d55a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345212:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d55a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345216:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d55a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345291:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9d561 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345298:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9d561 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345305:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9d561 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166850.345332:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a:0x0]: returning size 16384 00000004:00200000:2.0:1762166850.345336:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166850.345346:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9d561 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345357:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9d553 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345363:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9d553 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345378:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9d553 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345383:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.345386:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9d553 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345392:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9d553 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345400:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:2.0:1762166850.345402:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.345405:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9d553 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345409:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9d553 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345417:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d55a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345420:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d55a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345423:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d55a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345426:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.345427:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d55a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345430:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d55a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345439:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x98a5b8df (ffff9ee343a13500) 00010000:00010000:2.0:1762166850.345440:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.345442:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d55a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345445:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d55a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345454:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9d561 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345457:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9d561 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345460:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9d561 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345463:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166850.345464:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9d561 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345482:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9d561 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345487:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:2.0:1762166850.345489:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166850.345490:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9d561 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166850.345494:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9d561 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166850.345541:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:47954:x1847765444367104:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 403us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166850.345554:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 76 00010000:00010000:1.0:1762166850.983976:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166852.008622:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1762166852.274383:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836764 is committed 00000001:00080000:1.0:1762166852.274418:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836757 is committed 00000001:00080000:1.0:1762166852.274439:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836761 is committed 00000001:00080000:1.0:1762166852.274450:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836765 is committed 00000001:02000400:1.0:1762166852.620510:0:31928:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 50d: mirror rsync keep holes ========== 05:47:32 (1762166852) 00000100:00100000:0.0:1762166852.709089:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166852.709146:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166852.709174:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444367232 00000100:00100000:3.0:1762166852.709187:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444367232 00000100:00100000:0.0:1762166852.709187:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166852.709212:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444367360 00000100:00100000:2.0:1762166852.709221:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444367360 00000100:00100000:0.0:1762166852.709259:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166852.709271:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 59 00000100:00100000:1.0:1762166852.709277:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444367616 00000100:00100000:3.0:1762166852.709283:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2360:x1847765444367232:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:1.0:1762166852.709293:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444367616 00000100:00100000:2.0:1762166852.709302:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 5 00000100:00100000:2.0:1762166852.709328:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765444367360:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:0.0:1762166852.709356:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444367488 00000100:00100000:0.0:1762166852.709362:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444367488 00000100:00100000:3.0:1762166852.709373:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2360:x1847765444367232:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 93us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166852.709383:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765444367360:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 68us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166852.709393:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 59 00000100:00100000:1.0:1762166852.709394:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 197 00000100:00100000:2.0:1762166852.709409:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 5 00000100:00100000:1.0:1762166852.709426:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444367616:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:0.0:1762166852.709441:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 198 00000100:00100000:0.0:1762166852.709470:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444367488:12345-192.168.203.35@tcp:400:kworker.0 00000100:00080000:2.0:1762166852.709511:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166852.709516:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444367616:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 97us (326us total) trans 0 rc 0/0 00000100:00080000:2.0:1762166852.709520:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1762166852.709529:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166852.709531:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 197 00000100:00100000:0.0:1762166852.709541:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444367488:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 90us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166852.709551:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 198 00010000:00010000:2.0:1762166853.031870:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1762166853.123603:0:31976:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-flr test_50d OST does not support SEEK_HOLE 00000100:00000400:0.0:1762166853.416044:0:3296:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1762166837/real 1762166837] req@ffff9ee343719880 x1847765451938176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1762166853 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1762166853.427121:0:3296:0:(client.c:2512:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9ee343719880 x1847765451938176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1762166853 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000400:0.0:1762166853.427138:0:3296:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1762166837/real 1762166837] req@ffff9ee343719180 x1847765451938304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1762166853 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1762166853.427151:0:3296:0:(client.c:2512:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9ee343719180 x1847765451938304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1762166853 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1762166853.427171:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1847765451938176:0@lo:400:kworker.0 00000100:00100000:0.0:1762166853.427176:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1847765451938304:0@lo:400:kworker.0 00000001:02000400:3.0:1762166853.695002:0:32024:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 60a: mirror extend sets correct size on sparse file ========================================================== 05:47:33 (1762166853) 00000100:00100000:3.0:1762166853.799994:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451952896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1762166853.800015:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451952640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762166853.800031:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1847765451953024:0@lo:400:kworker.0 00000100:00100000:0.0:1762166853.800050:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451952768:0@lo:400:kworker.0 00000100:00100000:2.0:1762166853.800090:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166853.800133:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166853.800133:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166853.800159:0:6537:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451952640 00000100:00100000:3.0:1762166853.800183:0:6537:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451952640 00000100:00100000:1.0:1762166853.800202:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1847765451953536:0@lo:400:kworker.0 00000100:00100000:2.0:1762166853.800204:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451953280:0@lo:400:kworker.0 00000100:00100000:0.0:1762166853.800208:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1847765451953152:0@lo:400:kworker.0 00000100:00100000:3.0:1762166853.800237:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1762166853.800245:0:6537:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765451952640:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166853.800260:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1762166853.800282:0:6537:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 61014016 pending 0 free 3856662528 avail 3854565376 00000100:00100000:2.0:1762166853.800304:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166853.800314:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166853.800334:0:6537:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765451952640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166853.800345:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1762166853.800351:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451952768 00000100:00100000:0.0:1762166853.800357:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451952768 00000100:00100000:1.0:1762166853.800365:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1762166853.800383:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451953408:0@lo:400:kworker.0 00000100:00100000:3.0:1762166853.800387:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451953024 00000100:00100000:2.0:1762166853.800391:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451952640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166853.800392:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451953024 00000100:00100000:0.0:1762166853.800403:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1762166853.800418:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765451952768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166853.800427:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166853.800440:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451953152 00000100:00100000:2.0:1762166853.800455:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451953536 00000100:00100000:3.0:1762166853.800457:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451953152 00000100:00100000:2.0:1762166853.800462:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451953536 00000100:00100000:0.0:1762166853.800495:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765451952768:12345-0@lo:400:kworker.0 Request processed in 81us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166853.800500:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1762166853.800511:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451953280 00000100:00100000:3.0:1762166853.800512:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1847765451953024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166853.800514:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1762166853.800521:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1762166853.800525:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451953280 00000100:00100000:2.0:1762166853.800533:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1847765451953152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166853.800582:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1847765451953024:12345-0@lo:400:kworker.0 Request processed in 71us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166853.800588:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765451952768:0@lo:400:kworker.0 00000100:00100000:3.0:1762166853.800596:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1762166853.800598:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1847765451953152:12345-0@lo:400:kworker.0 Request processed in 67us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166853.800608:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451953408 00000100:00100000:2.0:1762166853.800613:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1762166853.800614:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451953408 00000100:00100000:0.0:1762166853.800618:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1847765451953152:0@lo:400:kworker.0 00000100:00100000:3.0:1762166853.800630:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1762166853.800642:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1847765451953536:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1762166853.800654:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166853.800663:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00080000:2.0:1762166853.800668:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1762166853.800672:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166853.800687:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1762166853.800693:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765451953280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166853.800704:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1847765451953536:12345-0@lo:400:kworker.0 Request processed in 60us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166853.800704:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765451953408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166853.800717:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1762166853.800722:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1847765451953024:0@lo:400:kworker.0 00000100:00100000:2.0:1762166853.800747:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1847765451953536:0@lo:400:kworker.0 00000100:00100000:0.0:1762166853.800797:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765451953408:12345-0@lo:400:kworker.0 Request processed in 99us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166853.800806:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1762166853.800813:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765451953280:12345-0@lo:400:kworker.0 Request processed in 123us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166853.800820:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451953408:0@lo:400:kworker.0 00000100:00100000:1.0:1762166853.800828:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1762166853.800856:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166853.800858:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836765 gen 2 00000004:00080000:2.0:1762166853.800863:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435ab480, transno 21474836753 00000004:00080000:2.0:1762166853.800877:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a9f80, transno 21474836754 00000004:00080000:2.0:1762166853.800881:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435aaa00, transno 21474836755 00000004:00080000:2.0:1762166853.800885:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550f800, transno 21474836758 00000004:00080000:2.0:1762166853.800890:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550ea00, transno 21474836759 00000100:00100000:3.0:1762166853.800894:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451952896 00000004:00080000:2.0:1762166853.800895:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee3819bb480, transno 21474836762 00000100:00100000:3.0:1762166853.800904:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451952896 00000004:00080000:2.0:1762166853.800904:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee3819bbb80, transno 21474836763 00000004:00080000:2.0:1762166853.800910:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee3819bad80, transno 21474836764 00000004:00080000:2.0:1762166853.800913:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee3819b8e00, transno 21474836765 00000100:00100000:2.0:1762166853.800917:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451953280:0@lo:400:kworker.0 00000100:00100000:3.0:1762166853.800951:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1762166853.800963:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451952896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1762166853.800986:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 56033280 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1762166853.801027:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765451952896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166853.801043:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1762166853.801069:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451952896:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1762166853.801213:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 3 in progress, 0 in flight, 6 done 00000004:00080000:1.0:1762166853.801288:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00010000:00010000:2.0:1762166854.056972:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1762166854.236278:0:32072:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-flr test_60a OST does not support SEEK_HOLE 00000001:02000400:0.0:1762166854.834455:0:32121:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 60b: mirror merge/split cancel client's in-memory layout gen ========================================================== 05:47:34 (1762166854) 00000100:00100000:1.0:1762166854.866990:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166854.867058:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444367872 00000100:00100000:0.0:1762166854.867074:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444367872 00000100:00080000:2.0:1762166854.867151:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762166854.867187:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 77 00000100:00100000:0.0:1762166854.867206:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:49103:x1847765444367872:12345-192.168.203.35@tcp:36:mkdir.0 00010000:00010000:0.0:1762166854.867284:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166854.867323:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245687c00/0xf915a5bdf3c9d2c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fc0 expref: 21 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.867349:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee360714500) 00010000:00010000:0.0:1762166854.867366:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166854.867548:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d568 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.867564:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d568 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.867588:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d568 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.867605:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d56f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.867613:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d56f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.867620:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d56f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166854.868587:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1d:0x0]: returning size 512 00010000:00010000:0.0:1762166854.868599:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d568 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.868607:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d568 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.868614:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d568 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.868620:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439bee00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166854.868625:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d568 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.868633:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d568 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.868645:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166854.868648:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166854.868652:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d568 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.868673:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d568 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762166854.868688:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000004e1bccc reply state 00000000144e7e0c transno 8589934641 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d56f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166854.868696:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166854.868848:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:49103:x1847765444367872:12345-192.168.203.35@tcp:36:mkdir.0 Request processed in 1648us (1866us total) trans 8589934641 rc 0/0 00000100:00100000:0.0:1762166854.868856:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 77 00010000:00010000:0.0:1762166854.869855:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d56f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.869882:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d56f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.869890:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d56f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.869897:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439be400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166854.869902:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d56f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.869910:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d56f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.869927:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe1895f91 (ffff9ee34bdb4f00) 00010000:00010000:0.0:1762166854.869931:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166854.869935:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d56f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.869942:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d56f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166854.877239:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166854.877289:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444368000 00000100:00100000:0.0:1762166854.877298:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444368000 00000100:00100000:0.0:1762166854.877363:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 78 00000100:00100000:0.0:1762166854.877376:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:49106:x1847765444368000:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166854.877401:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166854.877427:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d576 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f910a7 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.877523:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d57d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.877538:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d57d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.877548:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d57d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166854.877606:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:0.0:1762166854.877611:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 25 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166854.877632:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d57d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.877655:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d576 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910a7 expref: 23 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.877676:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d57d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910a7 expref: 22 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.877697:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34bdb4f00) 00010000:00010000:0.0:1762166854.877700:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166854.877710:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2439bee00, rc 0) 00000100:00100000:0.0:1762166854.877803:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:49106:x1847765444368000:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 427us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166854.877813:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 78 00000100:00100000:1.0:1762166854.878969:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166854.879016:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444368128 00000100:00100000:0.0:1762166854.879022:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444368128 00000100:00100000:0.0:1762166854.879074:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 79 00000100:00100000:0.0:1762166854.879086:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:49106:x1847765444368128:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166854.879102:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166854.879114:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d584 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f910ae expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.879155:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d58b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879165:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d58b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879174:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d58b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879190:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d592 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879197:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d592 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879204:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d592 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879307:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d599 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879322:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d599 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879327:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d599 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166854.879355:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1d:0x0]: returning size 512 00000004:00200000:0.0:1762166854.879358:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166854.879378:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d599 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879389:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d58b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879395:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d58b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879401:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d58b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879407:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439be000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166854.879411:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d58b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879416:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d58b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879428:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34bdb4f00) 00010000:00010000:0.0:1762166854.879430:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166854.879434:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d58b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879454:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be000/0xf915a5bdf3c9d58b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879474:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d592 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879480:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d592 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879487:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d592 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879492:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439be200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166854.879495:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d592 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879501:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d592 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879509:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe1895f91 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166854.879511:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166854.879515:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d592 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879520:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be200/0xf915a5bdf3c9d592 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.879547:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfe00/0xf915a5bdf3c9d584 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910ae expref: 24 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.879560:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d599 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910ae expref: 23 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.879567:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166854.879575:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1762166854.879578:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2439bf000, rc 0) 00000100:00100000:0.0:1762166854.879631:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:49106:x1847765444368128:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 548us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166854.879638:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 79 00000100:00100000:2.0:1762166854.880876:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166854.880948:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444368256 00000100:00100000:0.0:1762166854.880955:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444368256 00000100:00100000:0.0:1762166854.880999:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 80 00000100:00100000:0.0:1762166854.881014:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:49106:x1847765444368256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166854.881030:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166854.881045:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d5a0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f910b5 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.881094:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d5a7 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881105:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d5a7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881114:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d5a7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881126:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfc00/0xf915a5bdf3c9d5ae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881132:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfc00/0xf915a5bdf3c9d5ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881138:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfc00/0xf915a5bdf3c9d5ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881200:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d5a7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881215:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d5a7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881221:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d5a7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881226:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439bf200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166854.881230:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d5a7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881236:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d5a7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881246:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166854.881249:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166854.881252:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d5a7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881258:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf200/0xf915a5bdf3c9d5a7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881268:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfc00/0xf915a5bdf3c9d5ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881273:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfc00/0xf915a5bdf3c9d5ae lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881278:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfc00/0xf915a5bdf3c9d5ae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881284:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439bfc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166854.881287:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfc00/0xf915a5bdf3c9d5ae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881302:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfc00/0xf915a5bdf3c9d5ae lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881310:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4200) 00010000:00010000:0.0:1762166854.881313:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166854.881316:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfc00/0xf915a5bdf3c9d5ae lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881321:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfc00/0xf915a5bdf3c9d5ae lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.881349:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d5a0 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910b5 expref: 24 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.881358:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166854.881361:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166854.881364:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf400/0xf915a5bdf3c9d5a0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910b5 expref: 24 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.881373:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2439bf400, rc 0) 00000100:00100000:0.0:1762166854.881419:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:49106:x1847765444368256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 412us (548us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166854.881427:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 80 00000100:00100000:1.0:1762166854.883002:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166854.883068:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444368512 00000100:00100000:0.0:1762166854.883078:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444368512 00000100:00100000:0.0:1762166854.883120:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 81 00000100:00100000:0.0:1762166854.883129:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:49106:x1847765444368512:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166854.883142:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166854.883161:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d5b5 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f910bc expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.883253:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d5bc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.883264:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d5bc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.883272:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d5bc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.883284:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be800/0xf915a5bdf3c9d5c3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.883290:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be800/0xf915a5bdf3c9d5c3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.883303:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be800/0xf915a5bdf3c9d5c3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.883836:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9d5ca lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.883847:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9d5ca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.883855:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9d5ca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166854.883865:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166854.883888:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d5bc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.883894:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d5bc lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.883906:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d5bc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.883910:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439bfa00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166854.883913:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d5bc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.883919:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d5bc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.883931:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166854.883934:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166854.883938:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d5bc lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.883944:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bfa00/0xf915a5bdf3c9d5bc lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762166854.883957:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d17ceda4 reply state 00000000cc239f37 transno 8589934642 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be800/0xf915a5bdf3c9d5c3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166854.883964:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762166854.883989:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be400/0xf915a5bdf3c9d5b5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910bc expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.884010:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9d5ca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910bc expref: 25 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.884017:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4700) 00010000:00010000:0.0:1762166854.884019:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166854.884022:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198a00, rc 0) 00000100:00100000:0.0:1762166854.884089:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49106:x1847765444368512:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 960us (1089us total) trans 8589934642 rc 0/0 00000100:00100000:0.0:1762166854.884096:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 81 00010000:00010000:2.0:1762166854.885268:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be800/0xf915a5bdf3c9d5c3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166854.885279:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be800/0xf915a5bdf3c9d5c3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166854.885286:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be800/0xf915a5bdf3c9d5c3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166854.885301:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2439be800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166854.885305:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be800/0xf915a5bdf3c9d5c3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166854.885313:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be800/0xf915a5bdf3c9d5c3 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166854.885325:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4400) 00010000:00010000:2.0:1762166854.885328:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166854.885331:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be800/0xf915a5bdf3c9d5c3 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166854.885337:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439be800/0xf915a5bdf3c9d5c3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166854.886158:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166854.886212:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444368768 00000100:00100000:0.0:1762166854.886223:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444368768 00000100:00100000:0.0:1762166854.886283:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 82 00000100:00100000:0.0:1762166854.886294:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:49106:x1847765444368768:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166854.886316:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166854.886331:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9d5d8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f910c3 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.886411:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9d5df lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.886425:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9d5ca lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910bc expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.886448:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9d5df lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.886482:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9d5ca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910bc expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.886496:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9d5ca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910bc expref: 26 pid: 30817 timeout: 575 lvb_type: 0 00000100:00100000:0.0:1762166854.886510:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451953664:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166854.886588:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c59d80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166854.887414:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451953664:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166854.887446:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9d5df lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166854.888167:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166854.888263:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444368896 00000100:00100000:0.0:1762166854.888274:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444368896 00010000:00010000:0.0:1762166854.888303:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9d5ca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910bc expref: 27 pid: 30817 timeout: 575 lvb_type: 0 00000100:00100000:0.0:1762166854.888341:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 613 00000100:00100000:0.0:1762166854.888351:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444368896:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166854.888365:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166854.888372:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9d5ca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910bc expref: 27 pid: 30817 timeout: 575 lvb_type: 0 00010000:00010000:0.0:1762166854.888385:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9d5ca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910bc expref: 27 pid: 30817 timeout: 575 lvb_type: 0 00010000:00010000:0.0:1762166854.888406:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9d5ca lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910bc expref: 27 pid: 30817 timeout: 575 lvb_type: 0 00010000:00010000:0.0:1762166854.888422:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4700) 00010000:00010000:0.0:1762166854.888427:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9d5df lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.888449:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9d5df lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.888456:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9d5df lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166854.888481:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166854.888502:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9d5df lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166854.888512:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9d5df lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166854.888528:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000100:00100000:0.0:1762166854.888544:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444368896:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 193us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166854.888554:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 613 00000004:00080000:2.0:1762166854.888882:0:30817:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x84:0x0], index 0: 0 00010000:00010000:2.0:1762166854.889012:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9d5df lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166854.889020:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9d5df lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166854.889026:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9d5df lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166854.889038:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166854.889042:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9d5df lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166854.889049:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9d5df lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166854.889059:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4700) 00010000:00010000:2.0:1762166854.889062:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166854.889066:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9d5df lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166854.889072:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9d5df lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166854.889117:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9d5d8 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910c3 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166854.889124:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166854.889126:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166854.889129:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9d5d8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910c3 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166854.889137:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198600, rc 0) 00000100:00100000:2.0:1762166854.889159:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:49106:x1847765444368768:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2868us (3004us total) trans 8589934643 rc 301/301 00000100:00100000:2.0:1762166854.889166:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 82 00000100:00100000:2.0:1762166854.891745:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166854.891813:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444369152 00000100:00100000:2.0:1762166854.891828:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444369152 00000100:00100000:2.0:1762166854.891878:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17 00000100:00100000:2.0:1762166854.891890:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:49106:x1847765444369152:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166854.892222:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49106:x1847765444369152:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 334us (482us total) trans 8589934644 rc 0/0 00000100:00100000:2.0:1762166854.892230:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17 00000100:00100000:2.0:1762166854.893726:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166854.893805:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444369408 00000100:00100000:1.0:1762166854.893813:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444369408 00000100:00100000:1.0:1762166854.893863:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 18 00000100:00100000:1.0:1762166854.893876:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49106:x1847765444369408:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166854.894052:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49106:x1847765444369408:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 179us (330us total) trans 8589934645 rc 0/0 00000100:00100000:1.0:1762166854.894061:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 18 00000100:00100000:2.0:1762166854.901644:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166854.901717:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444369664 00000100:00100000:3.0:1762166854.901729:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444369664 00000100:00100000:3.0:1762166854.901833:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 83 00000100:00100000:3.0:1762166854.901844:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49109:x1847765444369664:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166854.901867:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166854.901882:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d5ed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f910ca expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.901941:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d5f4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.901952:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d5f4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.901961:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d5f4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.901970:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d5fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.901974:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d5fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.901978:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d5fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.902090:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d602 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.902097:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d602 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.902117:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d602 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762166854.902128:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:3.0:1762166854.902242:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d5f4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.902252:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d5f4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.902258:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d5f4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.902264:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166854.902268:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d5f4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.902274:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d5f4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.902286:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:3.0:1762166854.902289:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166854.902293:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d5f4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.902299:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d5f4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.902311:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d5fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.902317:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d5fb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.902334:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d5fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.902338:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166854.902341:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d5fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.902347:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d5fb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.902354:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee363960800) 00010000:00010000:3.0:1762166854.902357:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166854.902360:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d5fb lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.902364:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d5fb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.902407:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d5ed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910ca expref: 30 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.902423:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d602 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910ca expref: 29 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.902444:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:3.0:1762166854.902446:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166854.902448:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216d400, rc 0) 00000100:00100000:3.0:1762166854.902514:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49109:x1847765444369664:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 671us (876us total) trans 8589934646 rc 0/0 00000100:00100000:3.0:1762166854.902523:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 83 00000100:00100000:3.0:1762166854.904781:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166854.904844:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444369792 00000100:00100000:1.0:1762166854.904861:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444369792 00000100:00080000:3.0:1762166854.904921:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166854.904942:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1014 00000100:00100000:1.0:1762166854.904953:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:2360:x1847765444369792:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166854.904969:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166854.904989:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee244472200/0xf915a5bdf3c9d610 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f910d1 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166854.905014:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166854.905047:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166854.905050:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166854.905063:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244472200/0xf915a5bdf3c9d610 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910d1 expref: 9 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166854.905089:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee244472200/0xf915a5bdf3c9d610 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910d1 expref: 9 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166854.905101:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472200, rc 0) 00000100:00100000:1.0:1762166854.905150:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2360:x1847765444369792:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 199us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166854.905158:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1014 00000100:00100000:1.0:1762166854.906370:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166854.906415:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444370048 00000100:00100000:2.0:1762166854.906422:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444370048 00000100:00100000:2.0:1762166854.906468:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19 00000100:00100000:2.0:1762166854.906476:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49109:x1847765444370048:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166854.906742:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49109:x1847765444370048:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 267us (377us total) trans 8589934647 rc 0/0 00000100:00100000:2.0:1762166854.906747:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19 00000100:00100000:3.0:1762166854.907917:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166854.907975:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444370304 00000100:00100000:0.0:1762166854.907984:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444370304 00000100:00100000:0.0:1762166854.908032:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 84 00000100:00100000:0.0:1762166854.908043:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49109:x1847765444370304:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166854.908070:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166854.908088:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9d617 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f910d8 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.908175:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9d61e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166854.908191:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d602 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910ca expref: 31 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.908201:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9d61e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166854.908241:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d602 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910ca expref: 31 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.908255:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d602 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910ca expref: 31 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:0.0:1762166854.908269:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451953792:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166854.908344:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c59600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166854.909301:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451953792:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166854.909336:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9d61e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166854.909941:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166854.909977:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444370432 00000100:00100000:0.0:1762166854.909984:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444370432 00010000:00010000:0.0:1762166854.910010:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d602 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910ca expref: 32 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:0.0:1762166854.910045:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 614 00000100:00100000:0.0:1762166854.910059:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765444370432:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166854.910072:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166854.910078:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d602 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910ca expref: 32 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:0.0:1762166854.910089:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d602 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910ca expref: 32 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:0.0:1762166854.910109:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d602 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910ca expref: 32 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:0.0:1762166854.910124:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:0.0:1762166854.910129:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9d61e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166854.910136:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9d61e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166854.910143:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9d61e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166854.910166:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166854.910182:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9d61e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.910192:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9d61e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762166854.910208:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000100:00100000:0.0:1762166854.910214:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765444370432:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 160us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166854.910224:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 614 00010000:00010000:3.0:1762166854.910379:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9d617 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910d8 expref: 32 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.910391:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9d61e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910d8 expref: 31 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.910396:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:3.0:1762166854.910398:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166854.910400:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198200, rc 0) 00000100:00100000:3.0:1762166854.910429:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49109:x1847765444370304:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2390us (2516us total) trans 8589934648 rc 0/0 00000100:00100000:3.0:1762166854.910433:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 84 00000100:00100000:3.0:1762166854.911730:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166854.911798:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444370688 00000100:00100000:0.0:1762166854.911804:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444370688 00000100:00100000:0.0:1762166854.911846:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 85 00000100:00100000:0.0:1762166854.911857:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49109:x1847765444370688:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166854.911879:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166854.911894:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d62c lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f910df expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.912403:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9d633 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166854.912413:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9d633 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166854.912420:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9d633 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762166854.912429:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166854.912472:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d62c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910df expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.912483:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9d633 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910df expref: 33 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.912489:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1f:0x0].0x0 (ffff9ee34bdb4200) 00010000:00010000:0.0:1762166854.912491:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166854.912492:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198800, rc 0) 00000100:00100000:0.0:1762166854.912543:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49109:x1847765444370688:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 690us (817us total) trans 8589934649 rc 0/0 00000100:00100000:0.0:1762166854.912549:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 85 00000100:00100000:0.0:1762166854.914296:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166854.914362:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444370944 00000100:00100000:3.0:1762166854.914377:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444370944 00000100:00100000:3.0:1762166854.914453:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 86 00000100:00100000:3.0:1762166854.914473:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49109:x1847765444370944:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166854.914503:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166854.914543:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d641 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f910e6 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.914654:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d648 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.914670:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9d633 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910df expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.914680:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d648 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.914721:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9d633 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910df expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.914736:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9d633 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910df expref: 34 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:3.0:1762166854.914752:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451953920:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166854.914943:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166854.916193:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451953920:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166854.916223:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d648 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166854.916499:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166854.916556:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444371072 00000100:00100000:2.0:1762166854.916568:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444371072 00010000:00010000:2.0:1762166854.916611:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9d633 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910df expref: 35 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:2.0:1762166854.916655:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 615 00000100:00100000:2.0:1762166854.916667:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444371072:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166854.916695:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166854.916703:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9d633 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910df expref: 35 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:2.0:1762166854.916716:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9d633 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910df expref: 35 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:2.0:1762166854.916751:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9d633 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910df expref: 35 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:2.0:1762166854.916816:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1f:0x0].0x0 (ffff9ee34bdb4200) 00010000:00010000:2.0:1762166854.916822:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d648 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166854.916831:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d648 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166854.916840:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d648 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166854.916873:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166854.916886:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d648 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.916897:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d648 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762166854.916917:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1f:0x0]: returning size 0 00000100:00100000:2.0:1762166854.916936:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765444371072:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 267us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166854.916947:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 615 00000004:00080000:3.0:1762166854.917229:0:30818:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x84:0x0], index 1: 0 00010000:00010000:3.0:1762166854.917422:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d648 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.917428:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d648 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.917433:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d648 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.917450:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166854.917453:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d648 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.917459:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d648 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.917470:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1f:0x0].0x0 (ffff9ee34bdb4200) 00010000:00010000:3.0:1762166854.917473:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166854.917476:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d648 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.917480:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9d648 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.917533:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d641 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910e6 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.917539:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:3.0:1762166854.917541:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166854.917543:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9d641 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910e6 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.917558:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216c400, rc 0) 00000100:00100000:3.0:1762166854.917603:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49109:x1847765444370944:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3142us (3314us total) trans 8589934650 rc 301/301 00000100:00100000:3.0:1762166854.917610:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 86 00000100:00100000:0.0:1762166854.919227:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166854.919276:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444371328 00000100:00100000:2.0:1762166854.919285:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444371328 00000100:00100000:2.0:1762166854.919334:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20 00000100:00100000:2.0:1762166854.919343:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49109:x1847765444371328:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166854.919670:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49109:x1847765444371328:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 327us (450us total) trans 8589934651 rc 0/0 00000100:00100000:2.0:1762166854.919678:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20 00000100:00100000:1.0:1762166854.920946:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166854.920995:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444371456 00000100:00100000:3.0:1762166854.921003:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444371456 00000100:00100000:3.0:1762166854.921044:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 87 00000100:00100000:3.0:1762166854.921054:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49109:x1847765444371456:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166854.921069:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166854.921086:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d656 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f910ed expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.921170:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d65d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.921185:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9d61e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910d8 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.921192:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d65d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.921224:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9d61e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910d8 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.921236:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9d61e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910d8 expref: 35 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:3.0:1762166854.921250:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451954048:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166854.921342:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166854.922420:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451954048:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166854.922448:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d65d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166854.922621:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166854.922661:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444371584 00000100:00100000:2.0:1762166854.922667:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444371584 00010000:00010000:2.0:1762166854.922687:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9d61e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910d8 expref: 36 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:2.0:1762166854.922734:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 616 00000100:00100000:2.0:1762166854.922742:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3456e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765444371584:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166854.922752:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166854.922756:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9d61e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910d8 expref: 36 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:2.0:1762166854.922791:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9d61e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910d8 expref: 36 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:2.0:1762166854.922810:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9d61e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910d8 expref: 36 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:2.0:1762166854.922824:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:2.0:1762166854.922827:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d65d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166854.922833:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d65d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166854.922838:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d65d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166854.922860:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166854.922885:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d65d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.922893:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d65d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166854.922901:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3456e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444371584:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 159us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166854.922912:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 616 00000004:00200000:3.0:1762166854.922933:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:3.0:1762166854.922938:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166854.922951:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d65d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.922971:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9d656 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910ed expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.922983:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d65d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910ed expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.922988:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:3.0:1762166854.922990:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166854.922992:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216d000, rc 0) 00000100:00100000:3.0:1762166854.923056:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49109:x1847765444371456:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1969us (2077us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166854.923065:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 87 00000100:00100000:1.0:1762166854.924303:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166854.924343:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444371712 00000100:00100000:3.0:1762166854.924349:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444371712 00000100:00100000:3.0:1762166854.924397:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 88 00000100:00100000:3.0:1762166854.924405:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49109:x1847765444371712:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166854.924420:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166854.924448:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d664 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f910f4 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.924509:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d66b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.924519:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d66b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.924533:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d66b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762166854.924566:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166854.924569:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166854.924578:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d66b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.924593:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9d664 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910f4 expref: 36 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.924603:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d66b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910f4 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.924608:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1f:0x0].0x0 (ffff9ee363960800) 00010000:00010000:3.0:1762166854.924610:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762166854.924611:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216d400, rc 0) 00000100:00100000:3.0:1762166854.924641:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49109:x1847765444371712:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 239us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166854.924652:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 88 00000100:00100000:0.0:1762166854.926026:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166854.926082:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444371840 00000100:00100000:1.0:1762166854.926088:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444371840 00000100:00080000:3.0:1762166854.926137:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166854.926138:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1015 00000100:00100000:1.0:1762166854.926149:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765444371840:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166854.926161:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166854.926174:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee244473000/0xf915a5bdf3c9d672 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f910fb expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166854.926194:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166854.926208:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166854.926210:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166854.926216:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244473000/0xf915a5bdf3c9d672 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910fb expref: 12 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166854.926240:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee244473000/0xf915a5bdf3c9d672 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910fb expref: 12 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166854.926251:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473000, rc 0) 00000100:00100000:1.0:1762166854.926296:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444371840:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 149us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166854.926303:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1015 00000100:00100000:0.0:1762166854.927878:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166854.927923:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444372096 00000100:00100000:3.0:1762166854.927931:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444372096 00000100:00100000:3.0:1762166854.927975:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 89 00000100:00100000:3.0:1762166854.927984:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49109:x1847765444372096:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166854.928000:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166854.928019:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d679 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91102 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.928115:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d680 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.928128:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d680 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.928138:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d680 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762166854.928149:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:3.0:1762166854.928268:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d679 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91102 expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.928286:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d680 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91102 expref: 37 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166854.928294:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:3.0:1762166854.928297:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166854.928300:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382044a00, rc 0) 00000100:00100000:3.0:1762166854.928358:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49109:x1847765444372096:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 375us (483us total) trans 8589934652 rc 0/0 00000100:00100000:3.0:1762166854.928366:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 89 00000100:00100000:2.0:1762166854.930153:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166854.930223:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444372224 00000100:00100000:1.0:1762166854.930232:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444372224 00000100:00100000:1.0:1762166854.930277:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1016 00000100:00100000:1.0:1762166854.930286:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2361:x1847765444372224:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762166854.930324:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d68e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.930336:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166854.930338:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166854.930343:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d68e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.930353:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d68e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.930379:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d68e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.930387:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d68e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.930405:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d68e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.930417:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166854.930422:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d68e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.930431:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d68e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.930454:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d68e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.930460:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d68e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166854.930519:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2361:x1847765444372224:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 234us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166854.930526:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1016 00000100:00100000:0.0:1762166854.955251:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166854.955326:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444372352 00000100:00100000:3.0:1762166854.955342:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444372352 00000100:00100000:3.0:1762166854.955404:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 90 00000100:00100000:3.0:1762166854.955417:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49109:x1847765444372352:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:3.0:1762166854.969475:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934649 is committed 00000001:00080000:0.0:1762166854.969559:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934651 is committed 00000001:00080000:0.0:1762166854.969583:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934652 is committed 00000100:00100000:1.0:1762166854.969789:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:49109:x1847765444372352:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 14333us (14508us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166854.969808:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 90 00000100:00100000:0.0:1762166854.971141:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166854.971213:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444372480 00000100:00100000:1.0:1762166854.971226:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444372480 00000100:00100000:1.0:1762166854.971299:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1017 00000100:00100000:1.0:1762166854.971313:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444372480:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:1.0:1762166854.971471:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444372480:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 160us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166854.971479:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1017 00000100:00100000:2.0:1762166854.978304:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166854.978464:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444372608 00000100:00100000:1.0:1762166854.978482:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444372608 00000100:00100000:1.0:1762166854.978579:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1018 00000100:00100000:1.0:1762166854.978594:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2361:x1847765444372608:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762166854.978664:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d695 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.978682:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166854.978684:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166854.978690:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d695 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.978706:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d695 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.978745:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d695 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.978755:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d695 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.978800:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d695 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.978808:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166854.978829:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d695 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.978839:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d695 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.978858:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d695 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.978866:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d695 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166854.978998:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2361:x1847765444372608:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 397us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166854.979007:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1018 00000100:00100000:0.0:1762166854.980543:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166854.980616:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444372864 00000100:00100000:1.0:1762166854.980628:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444372864 00000100:00100000:1.0:1762166854.980700:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 91 00000100:00100000:1.0:1762166854.980709:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:49109:x1847765444372864:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762166854.980815:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166854.980847:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9d66b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910f4 expref: 23 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.980894:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1f:0x0].0x0 (ffff9ee363960800) 00010000:00010000:1.0:1762166854.980913:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166854.980964:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d69c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166854.981007:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d69c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166854.981019:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d69c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:1.0:1762166854.981295:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b9cb9ff9 reply state 00000000230328c4 transno 8589934653 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d69c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166854.981307:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166854.981422:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:49109:x1847765444372864:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 713us (887us total) trans 8589934653 rc 0/0 00000100:00100000:1.0:1762166854.981431:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 91 00010000:00010000:3.0:1762166854.982748:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d69c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.982812:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d69c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.982820:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d69c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.982827:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244472400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166854.982832:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d69c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.982840:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d69c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.982860:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1f:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:3.0:1762166854.982864:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166854.982869:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d69c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166854.982876:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d69c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166854.983060:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166854.983274:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444372992 00000100:00100000:1.0:1762166854.983289:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444372992 00000100:00100000:1.0:1762166854.983364:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 92 00000100:00100000:1.0:1762166854.983375:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:49109:x1847765444372992:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166854.983416:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166854.983452:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d6a3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91109 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.983526:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d6a3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91109 expref: 24 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.983546:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d6a3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91109 expref: 24 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.983568:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1f:0x0].0x0 (ffff9ee34ada3400) 00010000:00010000:1.0:1762166854.983571:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166854.983586:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473600, rc 0) 00000100:00100000:1.0:1762166854.983655:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:49109:x1847765444372992:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 281us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166854.983663:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 92 00000100:00100000:0.0:1762166854.985886:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166854.985951:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444373120 00000100:00100000:1.0:1762166854.985961:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444373120 00000100:00100000:1.0:1762166854.986035:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1019 00000100:00100000:1.0:1762166854.986048:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444373120:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762166854.986389:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x84:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166854.986394:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x84:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:1.0:1762166854.986397:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x84:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:1.0:1762166854.986400:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x84:0x0] updating lvb ctime from disk: 0 -> 1762166855 00002000:00010000:1.0:1762166854.986402:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x84:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762166854.986489:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765444373120:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 443us (615us total) trans 17179869437 rc 0/0 00000100:00100000:1.0:1762166854.986497:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1019 00000100:00100000:2.0:1762166854.988105:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166854.988160:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444373376 00000100:00100000:1.0:1762166854.988169:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444373376 00000100:00100000:1.0:1762166854.988221:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 93 00000100:00100000:1.0:1762166854.988232:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:49109:x1847765444373376:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762166854.988297:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166854.988330:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9d65d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910ed expref: 24 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.988363:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:1.0:1762166854.988368:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166854.988434:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d6aa lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166854.988476:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d6aa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166854.988485:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d6aa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:1.0:1762166854.988620:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007260cc77 reply state 00000000ef6381e3 transno 8589934654 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d6aa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166854.988630:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166854.988722:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:49109:x1847765444373376:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 493us (624us total) trans 8589934654 rc 0/0 00000100:00100000:1.0:1762166854.988728:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 93 00010000:00010000:2.0:1762166854.989796:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d6aa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166854.989809:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d6aa lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166854.989816:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d6aa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166854.989823:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244472c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166854.989827:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d6aa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166854.989835:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d6aa lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166854.989850:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:2.0:1762166854.989853:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166854.989857:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d6aa lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166854.989864:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d6aa lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166854.990487:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166854.990558:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444373504 00000100:00100000:0.0:1762166854.990569:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444373504 00000100:00100000:0.0:1762166854.990630:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 94 00000100:00100000:0.0:1762166854.990643:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:49109:x1847765444373504:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166854.990670:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166854.990690:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9d6b1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91110 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.990757:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9d6b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91110 expref: 25 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.990812:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9d6b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91110 expref: 25 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166854.990858:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:0.0:1762166854.990862:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166854.990865:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199800, rc 0) 00000100:00100000:0.0:1762166854.990938:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:49109:x1847765444373504:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 297us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166854.990945:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 94 00000100:00100000:0.0:1762166854.992492:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166854.992554:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444373632 00000100:00100000:1.0:1762166854.992566:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444373632 00000100:00100000:1.0:1762166854.992624:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1020 00000100:00100000:1.0:1762166854.992635:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2361:x1847765444373632:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762166854.993018:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x84:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166854.993022:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x84:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:1.0:1762166854.993023:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x84:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:1.0:1762166854.993025:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x84:0x0] updating lvb ctime from disk: 0 -> 1762166855 00002000:00010000:1.0:1762166854.993026:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x84:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762166854.993095:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444373632:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 461us (612us total) trans 21474836766 rc 0/0 00000100:00100000:1.0:1762166854.993102:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1020 00000100:00100000:3.0:1762166854.994201:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166854.994246:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444373888 00000100:00100000:2.0:1762166854.994252:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444373888 00000100:00100000:2.0:1762166854.994290:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 21 00000100:00100000:2.0:1762166854.994296:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342fe8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:49109:x1847765444373888:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166854.994352:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d680 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91102 expref: 25 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166854.994382:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d6b8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166854.994407:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9d6b1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91110 expref: 25 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166854.994415:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d6b8 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166854.994459:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9d6b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91110 expref: 25 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166854.994472:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9d6b1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91110 expref: 25 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:2.0:1762166854.994485:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451954176:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166854.994550:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166854.995447:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451954176:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166854.995476:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d6b8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166854.995711:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166854.995756:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444374016 00000100:00100000:2.0:1762166854.995789:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444374016 00010000:00010000:2.0:1762166854.995830:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9d6b1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91110 expref: 26 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:2.0:1762166854.995864:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 617 00000100:00100000:2.0:1762166854.995874:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444374016:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166854.995888:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166854.995896:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9d6b1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91110 expref: 26 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:2.0:1762166854.995908:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9d6b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91110 expref: 26 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:2.0:1762166854.995936:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9d6b1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91110 expref: 26 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:2.0:1762166854.995958:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:2.0:1762166854.995963:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d6b8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166854.995971:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d6b8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166854.995978:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d6b8 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166854.996001:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166854.996016:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d6b8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166854.996023:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d6b8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166854.996038:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6bf lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166854.996045:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444374016:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 172us (333us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166854.996048:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d6a3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91109 expref: 25 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.996060:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6bf lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166854.996064:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 617 00010000:00010000:1.0:1762166854.996084:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d6a3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91109 expref: 24 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166854.996096:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d6a3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91109 expref: 24 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:1.0:1762166854.996107:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee3819bad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451954304:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166854.996161:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3489aad80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166854.996862:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee3819bad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451954304:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166854.996877:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6bf lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166854.997092:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166854.997130:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444374144 00000100:00100000:2.0:1762166854.997135:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444374144 00010000:00010000:2.0:1762166854.997161:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d6a3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91109 expref: 25 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:2.0:1762166854.997189:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 618 00000100:00100000:2.0:1762166854.997198:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444374144:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166854.997207:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166854.997212:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d6a3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91109 expref: 25 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:2.0:1762166854.997235:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d6a3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91109 expref: 25 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:2.0:1762166854.997247:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d6a3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91109 expref: 25 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:2.0:1762166854.997258:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1f:0x0].0x0 (ffff9ee34ada3400) 00010000:00010000:2.0:1762166854.997262:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6bf lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166854.997268:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6bf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166854.997273:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6bf lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166854.997295:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166854.997322:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6bf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166854.997335:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765444374144:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 137us (242us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166854.997340:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6bf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166854.997346:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 618 00000100:00100000:1.0:1762166854.997748:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee3819bad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451954432:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166854.997813:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166854.997830:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2435c13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166854.997854:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451954432 00000100:00100000:2.0:1762166854.997860:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451954432 00000100:00100000:2.0:1762166854.997895:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1762166854.997902:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:31351:x1847765451954432:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166854.997988:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:31351:x1847765451954432:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 87us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166854.997995:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1762166854.998121:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee3819bad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451954432:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166854.998238:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee3819bad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451954560:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166854.998294:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166854.998333:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3489aa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166854.998351:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451954560 00000100:00100000:2.0:1762166854.998366:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451954560 00000100:00100000:2.0:1762166854.998399:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1762166854.998407:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:31351:x1847765451954560:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166854.998494:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:31351:x1847765451954560:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 88us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166854.998499:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1762166854.998532:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee3819bad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451954560:0@lo:1000:mdt_rdpg00_002.0 00000040:00080000:1.0:1762166855.001208:0:31351:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1762166855.001409:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x1:0x0].2, 64 off32896 00000040:00080000:1.0:1762166855.001561:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].1, 280 off33048 00000001:00080000:1.0:1762166855.001647:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934655 00000100:00100000:1.0:1762166855.001754:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee3819bad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451954688:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166855.001889:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166855.001927:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2435c1480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.001940:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451954688 00000100:00100000:2.0:1762166855.001952:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451954688 00000100:00080000:3.0:1762166855.001997:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166855.002019:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1762166855.002029:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:31351:x1847765451954688:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166855.002036:0:6543:0:(service.c:3434:ptlrpc_start_thread()) ost_out[0] started 2 min 2 max 16 00000100:00100000:1.0:1762166855.002046:0:6543:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'll_ost_out00_002' 00000100:00100000:2.0:1762166855.002293:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:31351:x1847765451954688:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 263us (401us total) trans 17179869438 rc 0/0 00000100:00100000:2.0:1762166855.002306:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1762166855.002316:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee3819bad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451954688:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166855.002343:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451954816:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166855.002376:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166855.002407:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2435c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.002415:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451954816 00000100:00100000:0.0:1762166855.002422:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451954816 00000100:00080000:3.0:1762166855.002462:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166855.002475:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1762166855.002483:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:31351:x1847765451954816:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166855.002609:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:31351:x1847765451954816:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 127us (235us total) trans 21474836767 rc 0/0 00000100:00100000:0.0:1762166855.002616:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1762166855.002653:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451954816:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1762166855.002801:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934656 00010000:00010000:1.0:1762166855.002839:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6bf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.002848:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6bf lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.002853:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6bf lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.002857:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.002860:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6bf lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.002866:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6bf lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.002881:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1f:0x0].0x0 (ffff9ee34ada3400) 00010000:00010000:1.0:1762166855.002883:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166855.002887:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6bf lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.002891:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6bf lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.002911:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d6b8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.002914:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d6b8 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.002918:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d6b8 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.002921:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.002928:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d6b8 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.002932:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d6b8 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.002937:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:1.0:1762166855.002938:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166855.002940:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d6b8 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.002943:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d6b8 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.002952:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:1.0:1762166855.002954:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166855.002959:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9d680 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91102 expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166855.003074:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342fe8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:49109:x1847765444373888:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 8775us (8873us total) trans 8589934657 rc 0/0 00000100:00100000:1.0:1762166855.003084:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 21 00000020:00080000:1.0:1762166855.003090:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166855.004133:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.004190:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444374272 00000100:00100000:1.0:1762166855.004199:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444374272 00000100:00100000:1.0:1762166855.004254:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 95 00000100:00100000:1.0:1762166855.004265:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:49109:x1847765444374272:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.004284:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.004302:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d6c6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91117 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.004379:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d6c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91117 expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.004395:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d6c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91117 expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.004414:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166855.004417:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166855.004420:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473400, rc 0) 00000100:00100000:1.0:1762166855.004472:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49109:x1847765444374272:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 208us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.004480:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 95 00000100:00100000:3.0:1762166855.005701:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.005751:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444374528 00000100:00100000:1.0:1762166855.005759:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444374528 00000100:00100000:1.0:1762166855.005841:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 22 00000100:00100000:1.0:1762166855.005854:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49109:x1847765444374528:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166855.006092:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49109:x1847765444374528:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 238us (389us total) trans 8589934658 rc 0/0 00000100:00100000:1.0:1762166855.006101:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 22 00000100:00100000:2.0:1762166855.007002:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.007068:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444374784 00000100:00100000:1.0:1762166855.007075:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444374784 00000100:00100000:1.0:1762166855.007107:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 23 00000100:00100000:1.0:1762166855.007112:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49109:x1847765444374784:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:1.0:1762166855.007321:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x1f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1762166855.007417:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d6cd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.007458:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d6cd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.007481:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d6cd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.007490:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d6cd lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.007497:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d6cd lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.007502:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d6cd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.007528:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166855.007582:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166855.007593:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d6cd lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.007617:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244472000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166855.007622:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d6cd lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166855.007631:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49109:x1847765444374784:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 515us (631us total) trans 8589934659 rc 0/0 00000100:00100000:1.0:1762166855.007641:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 23 00010000:00010000:2.0:1762166855.007646:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d6cd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.007686:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1f:0x0].0x0 (ffff9ee34ada3900) 00010000:00010000:2.0:1762166855.007690:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166855.007696:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d6cd lrc: 1/0,0 mode: --/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.007729:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d6cd lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.007836:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166855.007847:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166855.007849:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166855.018726:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.018811:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444374912 00000100:00100000:1.0:1762166855.018826:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444374912 00000100:00100000:1.0:1762166855.018903:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 96 00000100:00100000:1.0:1762166855.018913:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49111:x1847765444374912:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:1.0:1762166855.018945:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.018968:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6d4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9111e expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.019070:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d6db lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019093:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d6db lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019128:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d6db lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019146:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6e2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019153:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019160:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019305:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d6e9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019314:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019321:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.019374:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166855.019383:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166855.019430:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019457:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019467:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d6db lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019473:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d6db lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019491:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d6db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019497:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244472e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.019502:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d6db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019510:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d6db lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019525:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166855.019529:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.019534:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d6db lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019550:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d6db lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019568:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019574:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6e2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019579:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019584:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.019587:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019593:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6e2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019608:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3400) 00010000:00010000:1.0:1762166855.019610:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.019614:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6e2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019619:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6e2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.019665:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6d4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9111e expref: 30 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.019680:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d6e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9111e expref: 29 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.019686:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166855.019689:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166855.019691:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472800, rc 0) 00000100:00100000:1.0:1762166855.019837:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49111:x1847765444374912:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 924us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.019844:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 96 00000100:00100000:3.0:1762166855.031529:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.032369:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444375168 00000100:00100000:1.0:1762166855.032384:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444375168 00000100:00100000:1.0:1762166855.032473:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 97 00000100:00100000:1.0:1762166855.032485:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49115:x1847765444375168:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.032514:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.032540:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91125 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1762166855.032742:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1d:0x0]: returning size 11776 00010000:00010000:1.0:1762166855.032930:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91125 expref: 31 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.032947:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34bdb4f00) 00010000:00010000:1.0:1762166855.032950:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166855.032956:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d6f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91125 expref: 31 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.032974:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473800, rc 0) 00000100:00100000:1.0:1762166855.033054:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49115:x1847765444375168:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 571us (1543us total) trans 8589934660 rc 301/301 00000100:00100000:1.0:1762166855.033061:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 97 00000100:00100000:2.0:1762166855.034716:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.034816:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444375296 00000100:00100000:1.0:1762166855.034826:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444375296 00000100:00100000:1.0:1762166855.034892:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 98 00000100:00100000:1.0:1762166855.034904:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49115:x1847765444375296:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:1.0:1762166855.034998:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6fe lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035019:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6fe lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035033:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6fe lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035051:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d705 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035080:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d705 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035085:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d705 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035213:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d70c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035222:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d70c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035229:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d70c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.035270:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166855.035276:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166855.035290:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d70c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035307:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6fe lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035314:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6fe lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035322:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035328:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.035333:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035341:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6fe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035363:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166855.035366:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.035371:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6fe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035378:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d6fe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035393:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d705 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035399:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d705 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035405:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d705 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035410:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244472e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.035413:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d705 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035419:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d705 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035427:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3400) 00010000:00010000:1.0:1762166855.035429:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.035432:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d705 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035452:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d705 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035468:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d70c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035480:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d70c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035486:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d70c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035491:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244472000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.035493:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d70c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035499:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d70c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035507:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166855.035509:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.035512:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d70c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.035517:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d70c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.035594:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49115:x1847765444375296:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 693us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.035603:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 98 00000100:00100000:0.0:1762166855.036948:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.037003:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444375552 00000100:00100000:1.0:1762166855.037013:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444375552 00000100:00100000:1.0:1762166855.037057:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 24 00000100:00100000:1.0:1762166855.037065:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49115:x1847765444375552:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166855.037278:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49115:x1847765444375552:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 213us (339us total) trans 8589934661 rc 0/0 00000100:00100000:1.0:1762166855.037305:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 24 00000100:00100000:3.0:1762166855.047082:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.047197:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444375808 00000100:00100000:1.0:1762166855.047217:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444375808 00000100:00100000:1.0:1762166855.047311:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 99 00000100:00100000:1.0:1762166855.047327:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49117:x1847765444375808:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.047364:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.047396:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d713 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9112c expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.047559:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d71a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.047577:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d71a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.047592:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d71a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.047607:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166855.047819:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d713 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9112c expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.047841:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d71a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9112c expref: 33 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.047851:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166855.047854:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166855.047859:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472e00, rc 0) 00000100:00100000:1.0:1762166855.047942:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49117:x1847765444375808:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 619us (870us total) trans 8589934662 rc 0/0 00000100:00100000:1.0:1762166855.047968:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 99 00000100:00100000:2.0:1762166855.050523:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.050590:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444376064 00000100:00100000:1.0:1762166855.050601:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444376064 00000100:00100000:1.0:1762166855.050653:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 100 00000100:00100000:1.0:1762166855.050663:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49117:x1847765444376064:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.050691:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.050712:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d728 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91133 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.050839:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d72f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.050852:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d6e9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9111e expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.050860:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d72f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.050900:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d6e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9111e expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.050912:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d6e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9111e expref: 34 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:1.0:1762166855.050924:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451954944:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.051003:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3489aa180 going to sleep for 11 seconds 00000100:00100000:1.0:1762166855.052216:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451954944:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.052240:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d72f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166855.052413:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.052474:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444376192 00000100:00100000:1.0:1762166855.052482:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444376192 00010000:00010000:1.0:1762166855.052527:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d6e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9111e expref: 35 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:1.0:1762166855.052628:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 619 00000100:00100000:1.0:1762166855.052639:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444376192:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.052657:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.052665:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d6e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9111e expref: 35 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1762166855.052678:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d6e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9111e expref: 35 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1762166855.052700:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d6e9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9111e expref: 35 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1762166855.052717:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166855.052722:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d72f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.052732:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d72f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.052740:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d72f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.052803:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166855.052861:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d72f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.052874:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765444376192:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 231us (462us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166855.052882:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d72f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.052906:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 619 00000004:00200000:0.0:1762166855.052922:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166855.053099:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d728 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91133 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.053135:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d72f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91133 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.053143:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:0.0:1762166855.053146:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166855.053150:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473800, rc 0) 00000100:00100000:0.0:1762166855.053219:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49117:x1847765444376064:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2557us (2706us total) trans 8589934663 rc 0/0 00000100:00100000:0.0:1762166855.053228:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 100 00000100:00100000:2.0:1762166855.054452:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.054517:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444376320 00000100:00100000:1.0:1762166855.054527:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444376320 00000100:00100000:1.0:1762166855.054590:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 25 00000100:00100000:1.0:1762166855.054602:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49117:x1847765444376320:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:1.0:1762166855.054750:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49117:x1847765444376320:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 151us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.054758:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 25 00000100:00100000:2.0:1762166855.055691:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.055746:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444376576 00000100:00100000:1.0:1762166855.055752:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444376576 00000100:00100000:1.0:1762166855.055836:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 26 00000100:00100000:1.0:1762166855.055846:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49117:x1847765444376576:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166855.056070:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49117:x1847765444376576:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 225us (382us total) trans 8589934664 rc 0/0 00000100:00100000:1.0:1762166855.056079:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 26 00000100:00100000:2.0:1762166855.057125:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.057183:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444376832 00000100:00100000:0.0:1762166855.057192:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444376832 00000100:00100000:0.0:1762166855.057238:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 101 00000100:00100000:0.0:1762166855.057250:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49117:x1847765444376832:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.057272:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.057276:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166855.057300:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d72f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91133 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.057321:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d71a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9112c expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.057331:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:0.0:1762166855.057334:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166855.057347:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9d73d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9113a expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.057461:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d744 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.057473:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d744 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.057482:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d744 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762166855.057494:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166855.057581:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9d73d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9113a expref: 36 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.057590:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d744 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9113a expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.057594:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:0.0:1762166855.057596:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166855.057598:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199200, rc 0) 00000100:00100000:0.0:1762166855.057649:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49117:x1847765444376832:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 402us (526us total) trans 8589934665 rc 0/0 00000100:00100000:0.0:1762166855.057657:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 101 00000100:00100000:2.0:1762166855.058756:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.058841:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444377088 00000100:00100000:1.0:1762166855.058851:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444377088 00000100:00100000:1.0:1762166855.058904:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 27 00000100:00100000:1.0:1762166855.058919:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342fe8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49117:x1847765444377088:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166855.058980:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d744 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9113a expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.059016:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d752 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.059026:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d6c6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91117 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.059043:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d752 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.059074:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d6c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91117 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.059085:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d6c6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91117 expref: 35 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:1.0:1762166855.059098:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451955072:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.059182:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2435c1540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166855.060166:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451955072:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.060192:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d752 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166855.060268:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.060315:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444377216 00000100:00100000:1.0:1762166855.060320:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444377216 00010000:00010000:1.0:1762166855.060342:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d6c6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91117 expref: 36 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:1.0:1762166855.060366:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 620 00000100:00100000:1.0:1762166855.060373:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765444377216:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.060386:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.060390:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d6c6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91117 expref: 36 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1762166855.060398:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d6c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91117 expref: 36 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1762166855.060421:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d6c6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91117 expref: 36 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1762166855.060431:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166855.060443:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d752 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.060451:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d752 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.060456:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d752 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.060480:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.060505:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d752 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.060515:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d752 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166855.060526:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444377216:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 152us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.060534:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 620 00010000:00010000:2.0:1762166855.060733:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d752 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.060739:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d752 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.060743:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d752 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.060747:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244472000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.060750:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d752 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.060785:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d752 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.060794:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:2.0:1762166855.060796:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166855.060799:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d752 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.060803:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d752 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.060811:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:2.0:1762166855.060813:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166855.060816:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d744 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9113a expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166855.060918:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342fe8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49117:x1847765444377088:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2006us (2164us total) trans 8589934666 rc -22/-22 00000100:00100000:2.0:1762166855.060926:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 27 00000100:00100000:2.0:1762166855.065493:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.065560:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444377344 00000100:00100000:0.0:1762166855.065569:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444377344 00000100:00100000:0.0:1762166855.065620:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 102 00000100:00100000:0.0:1762166855.065630:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49117:x1847765444377344:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.065652:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.065671:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9d759 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91141 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.065733:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9d759 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91141 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.065745:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9d759 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91141 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.065791:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166855.065795:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166855.065799:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198000, rc 0) 00000100:00100000:0.0:1762166855.065848:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49117:x1847765444377344:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 219us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.065855:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 102 00000100:00100000:0.0:1762166855.067128:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.067178:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444377600 00000100:00100000:1.0:1762166855.067184:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444377600 00000100:00100000:1.0:1762166855.067220:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 103 00000100:00100000:1.0:1762166855.067228:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49117:x1847765444377600:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.067238:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.067250:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d760 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91148 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.067668:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d767 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.067682:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d767 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.067699:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d767 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.067710:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x20:0x0]: returning size 0 00010000:00010000:1.0:1762166855.067750:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d760 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91148 expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.067794:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d767 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91148 expref: 37 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.067803:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x20:0x0].0x0 (ffff9ee34ada3400) 00010000:00010000:1.0:1762166855.067806:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166855.067809:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472800, rc 0) 00000100:00100000:1.0:1762166855.067851:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49117:x1847765444377600:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 623us (726us total) trans 8589934667 rc 0/0 00000100:00100000:1.0:1762166855.067858:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 103 00000100:00100000:3.0:1762166855.069002:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.069043:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444377856 00000100:00100000:1.0:1762166855.069049:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444377856 00000100:00100000:1.0:1762166855.069083:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 104 00000100:00100000:1.0:1762166855.069092:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49117:x1847765444377856:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.069106:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.069116:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d775 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9114f expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.069160:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d77c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.069167:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d77c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.069179:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d77c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.069187:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166855.069241:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d775 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9114f expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.069250:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d77c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9114f expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.069255:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:1.0:1762166855.069257:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166855.069259:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472c00, rc 0) 00000100:00100000:1.0:1762166855.069289:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49117:x1847765444377856:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 200us (290us total) trans 8589934668 rc 0/0 00000100:00100000:1.0:1762166855.069293:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 104 00000100:00100000:2.0:1762166855.070237:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.070279:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444378112 00000100:00100000:1.0:1762166855.070285:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444378112 00000100:00100000:1.0:1762166855.070319:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 28 00000100:00100000:1.0:1762166855.070326:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49117:x1847765444378112:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166855.070369:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d77c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9114f expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.070390:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d78a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.070398:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9d759 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91141 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.070418:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d78a lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.070462:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9d759 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91141 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.070478:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9d759 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91141 expref: 39 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:1.0:1762166855.070492:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451955200:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.070553:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350460f00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166855.071324:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451955200:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.071338:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d78a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166855.071545:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.071592:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444378240 00000100:00100000:1.0:1762166855.071597:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444378240 00010000:00010000:1.0:1762166855.071617:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9d759 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91141 expref: 40 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:1.0:1762166855.071646:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 621 00000100:00100000:1.0:1762166855.071655:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2361:x1847765444378240:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.071668:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.071674:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9d759 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91141 expref: 40 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1762166855.071685:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9d759 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91141 expref: 40 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1762166855.071707:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9d759 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91141 expref: 40 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1762166855.071719:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:1.0:1762166855.071723:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d78a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.071731:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d78a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.071737:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d78a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.071760:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.071785:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d78a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.071793:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d78a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.071809:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9d791 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166855.071816:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444378240:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 162us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.071832:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 621 00010000:00010000:2.0:1762166855.071838:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d767 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91148 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.071846:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9d791 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.071867:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d767 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91148 expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.071878:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d767 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91148 expref: 38 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:2.0:1762166855.071888:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451955328:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.071936:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9af00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166855.072638:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451955328:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.072652:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9d791 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166855.072789:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.072814:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444378368 00000100:00100000:1.0:1762166855.072820:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444378368 00010000:00010000:1.0:1762166855.072838:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d767 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91148 expref: 39 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:1.0:1762166855.072867:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 622 00000100:00100000:1.0:1762166855.072876:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444378368:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.072895:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.072902:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d767 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91148 expref: 39 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1762166855.072913:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d767 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91148 expref: 39 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1762166855.072927:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d767 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91148 expref: 39 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1762166855.072937:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x20:0x0].0x0 (ffff9ee34ada3400) 00010000:00010000:1.0:1762166855.072941:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9d791 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.072947:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9d791 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.072953:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9d791 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.072974:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.072999:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9d791 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x20:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.073008:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9d791 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x20:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166855.073009:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2360:x1847765444378368:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 132us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.073025:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 622 00000100:00100000:2.0:1762166855.073351:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de00700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451955456:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166855.073383:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166855.073405:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9af00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.073428:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451955456 00000100:00100000:0.0:1762166855.073432:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451955456 00000100:00100000:0.0:1762166855.073472:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1762166855.073480:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:31351:x1847765451955456:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166855.073532:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:31351:x1847765451955456:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 53us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.073537:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1762166855.073561:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de00700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451955456:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166855.073596:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934669 00000001:00080000:2.0:1762166855.073635:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934670 00010000:00010000:2.0:1762166855.073647:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9d791 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x20:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.073659:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9d791 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x20:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.073663:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9d791 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x20:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.073666:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.073669:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9d791 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x20:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.073673:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9d791 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x20:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.073679:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x20:0x0].0x0 (ffff9ee34ada3400) 00010000:00010000:2.0:1762166855.073681:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166855.073684:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9d791 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x20:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.073687:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9d791 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x20:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.073697:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d78a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.073700:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d78a lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.073703:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d78a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.073706:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244472400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.073707:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d78a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.073718:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d78a lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.073722:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166855.073724:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166855.073725:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d78a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.073728:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d78a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.073734:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166855.073736:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166855.073739:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d77c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9114f expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166855.073805:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49117:x1847765444378112:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 3479us (3569us total) trans 8589934671 rc 0/0 00000100:00100000:2.0:1762166855.073810:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 28 00000020:00080000:2.0:1762166855.073813:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166855.074538:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.074577:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444378496 00000100:00100000:1.0:1762166855.074581:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444378496 00000100:00100000:1.0:1762166855.074608:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 105 00000100:00100000:1.0:1762166855.074613:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49117:x1847765444378496:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.074623:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.074639:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9d798 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91156 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.074679:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9d798 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91156 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.074690:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9d798 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91156 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.074706:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:1.0:1762166855.074709:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166855.074711:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473200, rc 0) 00000100:00100000:1.0:1762166855.074743:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49117:x1847765444378496:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 129us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.074749:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 105 00000100:00100000:3.0:1762166855.075881:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.075926:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444378752 00000100:00100000:2.0:1762166855.075932:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444378752 00000100:00100000:2.0:1762166855.075968:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 29 00000100:00100000:2.0:1762166855.075975:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49117:x1847765444378752:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762166855.076293:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x20:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166855.076362:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].11, 64 off9088 00000004:00080000:2.0:1762166855.076370:0:31351:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 475868606593ns, next at 476868605363ns, rc = 0 00000001:00080000:2.0:1762166855.076374:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934672 00010000:00010000:2.0:1762166855.076411:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9d79f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.076420:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9d79f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.076426:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9d79f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.076431:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9d79f lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.076448:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9d79f lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.076452:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9d79f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.076467:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166855.076490:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166855.076496:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9d79f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.076502:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166855.076506:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9d79f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.076511:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9d79f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.076520:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x20:0x0].0x0 (ffff9ee343a13500) 00010000:00010000:1.0:1762166855.076523:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166855.076525:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9d79f lrc: 1/0,0 mode: --/PW res: [0x200000404:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.076529:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9d79f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166855.076539:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49117:x1847765444378752:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 565us (660us total) trans 8589934673 rc 0/0 00000100:00100000:2.0:1762166855.076546:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 29 00010000:00010000:1.0:1762166855.076549:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1762166855.076550:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762166855.076552:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166855.076554:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166855.077377:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.077422:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444379008 00000100:00100000:2.0:1762166855.077427:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444379008 00000100:00100000:2.0:1762166855.077464:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 30 00000100:00100000:2.0:1762166855.077469:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49117:x1847765444379008:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166855.077588:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49117:x1847765444379008:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 119us (214us total) trans 8589934674 rc 0/0 00000100:00100000:2.0:1762166855.077593:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 30 00010000:00010000:1.0:1762166855.079907:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166855.085207:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.085273:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444379136 00000100:00100000:1.0:1762166855.085283:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444379136 00000100:00100000:1.0:1762166855.085333:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 106 00000100:00100000:1.0:1762166855.085340:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49119:x1847765444379136:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:1.0:1762166855.085367:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.085387:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d7a6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9115d expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.085462:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7ad lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085476:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7ad lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085487:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7ad lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085501:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d7b4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085507:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085513:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085611:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d7bb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085635:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d7bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085643:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d7bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.085674:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166855.085678:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166855.085694:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d7bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085705:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d7bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085713:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7ad lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085719:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7ad lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085725:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7ad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085737:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.085741:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7ad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085748:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7ad lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085792:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166855.085796:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.085801:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7ad lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085814:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7ad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085828:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085833:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d7b4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085838:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d7b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085843:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.085846:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d7b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085852:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d7b4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085859:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3c00) 00010000:00010000:1.0:1762166855.085862:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.085865:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d7b4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085869:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d7b4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.085901:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d7a6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9115d expref: 45 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.085914:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d7bb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9115d expref: 44 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.085936:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:1.0:1762166855.085939:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166855.085941:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472a00, rc 0) 00000100:00100000:1.0:1762166855.086013:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49119:x1847765444379136:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 672us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.086021:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 106 00000100:00100000:3.0:1762166855.087343:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.087385:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444379264 00000100:00100000:1.0:1762166855.087392:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444379264 00000100:00100000:1.0:1762166855.087446:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1021 00000100:00100000:1.0:1762166855.087457:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444379264:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:1.0:1762166855.087470:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.087483:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee244472600/0xf915a5bdf3c9d7c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91164 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.087498:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.087499:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.087505:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244472600/0xf915a5bdf3c9d7c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91164 expref: 14 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.087514:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee244472600/0xf915a5bdf3c9d7c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91164 expref: 14 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.087522:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472600, rc 0) 00000100:00100000:1.0:1762166855.087552:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2361:x1847765444379264:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 98us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.087559:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1021 00000100:00100000:0.0:1762166855.099631:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.099711:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444379520 00000100:00100000:1.0:1762166855.099720:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444379520 00000100:00100000:1.0:1762166855.099787:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 107 00000100:00100000:1.0:1762166855.099795:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49123:x1847765444379520:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.099813:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.099832:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d7c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9116b expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.099955:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d7d0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.099969:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d7d0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.099985:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d7d0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.099995:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1d:0x0]: returning size 11776 00010000:00010000:1.0:1762166855.100116:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d7c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9116b expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.100133:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d7d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9116b expref: 46 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.100139:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166855.100141:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166855.100143:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473400, rc 0) 00000100:00100000:1.0:1762166855.100186:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49123:x1847765444379520:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 393us (565us total) trans 8589934675 rc 0/0 00000100:00100000:1.0:1762166855.100191:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 107 00000100:00100000:3.0:1762166855.101346:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.101417:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444379648 00000100:00100000:1.0:1762166855.101423:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444379648 00000100:00100000:1.0:1762166855.101472:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 108 00000100:00100000:1.0:1762166855.101481:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49123:x1847765444379648:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:1.0:1762166855.101532:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7de lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101544:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7de lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101552:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7de lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101564:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101570:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101576:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101662:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d7ec lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101670:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d7ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101675:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d7ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.101696:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166855.101699:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166855.101705:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d7ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101723:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7de lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101729:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7de lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101735:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7de lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101741:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.101745:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7de lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101751:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7de lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101782:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166855.101784:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.101787:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7de lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101791:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d7de lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101799:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101804:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7e5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101809:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101814:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.101823:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101829:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7e5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101837:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3c00) 00010000:00010000:1.0:1762166855.101840:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.101842:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7e5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101848:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7e5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101874:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d7ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101880:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d7ec lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101885:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d7ec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101890:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244472c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.101893:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d7ec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101898:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d7ec lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101904:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:1.0:1762166855.101907:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.101910:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d7ec lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.101924:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d7ec lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.101985:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49123:x1847765444379648:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 505us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.101993:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 108 00000100:00100000:3.0:1762166855.112095:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.112171:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444379904 00000100:00100000:1.0:1762166855.112182:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444379904 00000100:00100000:1.0:1762166855.112238:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 109 00000100:00100000:1.0:1762166855.112249:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49125:x1847765444379904:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.112271:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.112291:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d7f3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91172 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.112388:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7fa lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.112401:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7fa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.112412:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7fa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.112422:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166855.112552:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d7f3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91172 expref: 49 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.112569:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7fa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91172 expref: 48 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.112588:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:1.0:1762166855.112591:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166855.112594:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473c00, rc 0) 00000100:00100000:1.0:1762166855.112653:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:49125:x1847765444379904:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 407us (566us total) trans 8589934676 rc 0/0 00000100:00100000:1.0:1762166855.112660:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 109 00000100:00100000:0.0:1762166855.114324:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.114382:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444380032 00000100:00100000:1.0:1762166855.114389:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444380032 00000100:00100000:1.0:1762166855.114447:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1022 00000100:00100000:1.0:1762166855.114459:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765444380032:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.114472:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.114486:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d808 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91179 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.114511:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.114513:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.114520:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d808 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91179 expref: 15 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.114540:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d808 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91179 expref: 15 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.114551:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473600, rc 0) 00000100:00100000:1.0:1762166855.114599:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444380032:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 144us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.114606:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1022 00000100:00100000:3.0:1762166855.116028:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.116083:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444380288 00000100:00100000:1.0:1762166855.116092:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444380288 00000100:00100000:1.0:1762166855.116142:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 110 00000100:00100000:1.0:1762166855.116151:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:49125:x1847765444380288:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.116170:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.116184:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d80f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91180 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.116260:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d816 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.116273:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d7bb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9115d expref: 49 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.116281:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d816 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.116315:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d7bb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9115d expref: 49 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.116328:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d7bb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9115d expref: 49 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:1.0:1762166855.116341:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451955584:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.116409:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350460f00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166855.117481:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451955584:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.117514:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d816 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166855.118171:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.118238:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444380416 00000100:00100000:1.0:1762166855.118264:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444380416 00010000:00010000:1.0:1762166855.118304:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d7bb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9115d expref: 50 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:1.0:1762166855.118358:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 623 00000100:00100000:1.0:1762166855.118367:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2361:x1847765444380416:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.118382:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.118391:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d7bb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9115d expref: 50 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1762166855.118406:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d7bb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9115d expref: 50 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1762166855.118443:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d7bb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9115d expref: 50 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1762166855.118464:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:1.0:1762166855.118469:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d816 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.118479:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d816 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.118487:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d816 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.118516:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166855.118567:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:2361:x1847765444380416:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 201us (401us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166855.118574:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d816 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.118575:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 623 00010000:00010000:0.0:1762166855.118591:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d816 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762166855.118622:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166855.118803:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d80f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91180 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.118824:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d816 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91180 expref: 49 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.118832:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:0.0:1762166855.118834:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166855.118836:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472400, rc 0) 00000100:00100000:0.0:1762166855.118893:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49125:x1847765444380288:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2742us (2876us total) trans 8589934677 rc 0/0 00000100:00100000:0.0:1762166855.118900:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 110 00000100:00100000:3.0:1762166855.120715:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.120826:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444380672 00000100:00100000:0.0:1762166855.120842:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444380672 00000100:00100000:0.0:1762166855.120910:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 111 00000100:00100000:0.0:1762166855.120924:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49125:x1847765444380672:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.120954:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.120978:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9d824 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91187 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.121611:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9d82b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.121628:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9d82b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.121639:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9d82b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762166855.121667:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x21:0x0]: returning size 0 00010000:00010000:0.0:1762166855.121722:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9d824 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91187 expref: 52 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.121741:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9d82b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91187 expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.121749:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x21:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166855.121752:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166855.121756:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199c00, rc 0) 00000100:00100000:0.0:1762166855.121865:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49125:x1847765444380672:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 944us (1157us total) trans 8589934678 rc 0/0 00000100:00100000:0.0:1762166855.121874:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 111 00000100:00100000:3.0:1762166855.123510:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.123595:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444380928 00000100:00100000:0.0:1762166855.123606:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444380928 00000100:00100000:0.0:1762166855.123661:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 112 00000100:00100000:0.0:1762166855.123671:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49125:x1847765444380928:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.123694:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.123713:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9d839 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9118e expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.123818:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d840 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.123828:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9d82b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91187 expref: 52 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.123833:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d840 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.123873:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9d82b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91187 expref: 52 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.123885:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9d82b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91187 expref: 52 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:0.0:1762166855.123898:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451955712:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166855.123969:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.125142:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451955712:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166855.125167:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d840 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166855.125276:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.125354:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444381056 00000100:00100000:1.0:1762166855.125368:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444381056 00010000:00010000:1.0:1762166855.125418:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9d82b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91187 expref: 53 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:1.0:1762166855.125473:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 624 00000100:00100000:1.0:1762166855.125487:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:2360:x1847765444381056:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.125506:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.125514:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9d82b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91187 expref: 53 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1762166855.125528:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9d82b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91187 expref: 53 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1762166855.125552:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9d82b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91187 expref: 53 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1762166855.125571:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x21:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:1.0:1762166855.125576:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d840 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.125586:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d840 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.125593:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d840 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.125632:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166855.125694:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d840 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.125706:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d840 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.125707:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2360:x1847765444381056:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 221us (429us total) trans 0 rc 0/0 00000004:00200000:0.0:1762166855.125735:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x21:0x0]: returning size 0 00000100:00100000:1.0:1762166855.125752:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 624 00000004:00080000:0.0:1762166855.126069:0:30818:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x85:0x0], index 0: 0 00010000:00010000:0.0:1762166855.126207:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d840 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.126216:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d840 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.126222:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d840 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.126228:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166855.126243:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d840 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.126251:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d840 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.126266:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x21:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166855.126269:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166855.126273:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d840 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.126280:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d840 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.126328:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9d839 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9118e expref: 52 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.126338:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166855.126341:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166855.126345:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9d839 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9118e expref: 52 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.126355:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198a00, rc 0) 00000100:00100000:0.0:1762166855.126408:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49125:x1847765444380928:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2738us (2905us total) trans 8589934679 rc 301/301 00000100:00100000:0.0:1762166855.126416:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 112 00000100:00100000:3.0:1762166855.127626:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.127691:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444381312 00000100:00100000:2.0:1762166855.127699:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444381312 00000100:00100000:2.0:1762166855.128325:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 31 00000100:00100000:2.0:1762166855.128339:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49125:x1847765444381312:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166855.128616:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:49125:x1847765444381312:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 281us (993us total) trans 8589934680 rc 0/0 00000100:00100000:2.0:1762166855.128625:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 31 00000100:00100000:2.0:1762166855.130116:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.130165:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444381440 00000100:00100000:0.0:1762166855.130171:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444381440 00000100:00100000:0.0:1762166855.130213:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 113 00000100:00100000:0.0:1762166855.130223:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:49125:x1847765444381440:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.130252:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.130270:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9d84e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91195 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.130333:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9d855 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.130347:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d816 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91180 expref: 53 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.130356:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9d855 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.130389:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d816 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91180 expref: 53 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.130401:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d816 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91180 expref: 53 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:0.0:1762166855.130414:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451955840:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166855.130495:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c59540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.131520:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451955840:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166855.131541:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9d855 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166855.131844:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.131997:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444381568 00000100:00100000:3.0:1762166855.132004:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444381568 00010000:00010000:3.0:1762166855.132033:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d816 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91180 expref: 54 pid: 30818 timeout: 575 lvb_type: 0 00000100:00100000:3.0:1762166855.132064:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 625 00000100:00100000:3.0:1762166855.132072:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+54:2360:x1847765444381568:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166855.132094:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166855.132101:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d816 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91180 expref: 54 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:3.0:1762166855.132113:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d816 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91180 expref: 54 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:3.0:1762166855.132131:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d816 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91180 expref: 54 pid: 30818 timeout: 575 lvb_type: 0 00010000:00010000:3.0:1762166855.132146:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:3.0:1762166855.132151:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9d855 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.132159:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9d855 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.132167:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9d855 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.132192:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166855.132210:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9d855 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.132217:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9d855 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166855.132231:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:2360:x1847765444381568:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 160us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166855.132238:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 625 00000004:00200000:0.0:1762166855.132257:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166855.132261:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166855.132278:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9d855 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.132314:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9d84e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91195 expref: 53 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.132324:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9d855 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91195 expref: 52 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.132329:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:0.0:1762166855.132330:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166855.132332:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199e00, rc 0) 00000100:00100000:0.0:1762166855.132366:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:49125:x1847765444381440:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2145us (2256us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.132372:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 113 00000100:00100000:2.0:1762166855.133520:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.133743:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444381696 00000100:00100000:1.0:1762166855.133757:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444381696 00000100:00100000:1.0:1762166855.133871:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1023 00000100:00100000:1.0:1762166855.133886:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765444381696:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.133906:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.133927:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d85c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9119c expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.133953:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.133956:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.133964:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d85c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9119c expref: 16 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.133982:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d85c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9119c expref: 16 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.133997:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472a00, rc 0) 00000100:00100000:1.0:1762166855.134062:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444381696:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 180us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.134070:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1023 00000100:00100000:3.0:1762166855.135014:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.135058:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444381824 00000100:00100000:0.0:1762166855.135066:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444381824 00000100:00100000:0.0:1762166855.135118:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 114 00000100:00100000:0.0:1762166855.135129:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:49125:x1847765444381824:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.135147:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.135167:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9d863 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f911a3 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.135225:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9d86a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.135252:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9d86a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.135262:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9d86a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762166855.135293:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x21:0x0]: returning size 0 00000004:00200000:0.0:1762166855.135296:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166855.135310:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9d86a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.135334:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9d863 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911a3 expref: 54 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.135349:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9d86a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911a3 expref: 53 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.135356:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x21:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166855.135359:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762166855.135362:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198800, rc 0) 00000100:00100000:0.0:1762166855.135415:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49125:x1847765444381824:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 288us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.135422:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 114 00000100:00100000:2.0:1762166855.137076:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.137135:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444381952 00000100:00100000:1.0:1762166855.137144:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444381952 00000100:00100000:1.0:1762166855.137204:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1024 00000100:00100000:1.0:1762166855.137216:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2360:x1847765444381952:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.137233:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.137271:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d871 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f911aa expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166855.137300:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166855.137323:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.137326:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.137335:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d871 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911aa expref: 11 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.137350:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d871 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911aa expref: 11 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.137363:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472c00, rc 0) 00000100:00100000:1.0:1762166855.137421:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765444381952:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 207us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.137427:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1024 00000100:00100000:2.0:1762166855.139138:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.139198:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444382208 00000100:00100000:0.0:1762166855.139209:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444382208 00000100:00100000:0.0:1762166855.139260:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 115 00000100:00100000:0.0:1762166855.139267:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49125:x1847765444382208:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.139285:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.139300:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9d878 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f911b1 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.139404:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9d87f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.139420:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9d87f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.139431:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9d87f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762166855.139453:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166855.139569:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9d878 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911b1 expref: 56 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.139581:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9d87f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911b1 expref: 55 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.139587:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:0.0:1762166855.139589:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166855.139591:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198c00, rc 0) 00000100:00100000:0.0:1762166855.139640:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+55:49125:x1847765444382208:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 373us (510us total) trans 8589934681 rc 0/0 00000100:00100000:0.0:1762166855.139646:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 115 00000100:00100000:3.0:1762166855.141170:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.141217:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444382336 00000100:00100000:1.0:1762166855.141226:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444382336 00000100:00100000:1.0:1762166855.141279:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1025 00000100:00100000:1.0:1762166855.141287:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444382336:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.141305:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.141322:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d88d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f911b8 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.141348:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.141351:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.141360:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d88d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911b8 expref: 17 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.141400:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d88d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911b8 expref: 17 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.141414:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472000, rc 0) 00000100:00100000:1.0:1762166855.141493:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444382336:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 205us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.141500:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1025 00000100:00100000:2.0:1762166855.143021:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.143081:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444382464 00000100:00100000:1.0:1762166855.143089:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444382464 00000100:00100000:1.0:1762166855.143143:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1026 00000100:00100000:1.0:1762166855.143153:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444382464:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.143171:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.143188:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d894 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f911bf expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.143210:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.143212:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.143220:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d894 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911bf expref: 18 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.143236:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d894 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911bf expref: 18 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.143248:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472e00, rc 0) 00000100:00100000:1.0:1762166855.143305:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765444382464:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 153us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.143326:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1026 00000100:00100000:2.0:1762166855.144333:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.144385:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444382592 00000100:00100000:1.0:1762166855.144391:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444382592 00000100:00100000:1.0:1762166855.144429:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1027 00000100:00100000:1.0:1762166855.144446:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444382592:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762166855.144486:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d89b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.144501:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.144503:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.144509:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d89b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.144520:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d89b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.144548:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d89b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.144556:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d89b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.144561:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d89b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.144566:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166855.144569:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d89b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.144583:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d89b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.144598:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d89b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.144605:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d89b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166855.144665:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444382592:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 229us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.144673:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1027 00000100:00100000:3.0:1762166855.145844:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.145872:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444382720 00000100:00100000:1.0:1762166855.145878:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444382720 00000100:00100000:1.0:1762166855.145905:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1028 00000100:00100000:1.0:1762166855.145910:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765444382720:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.145919:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.145928:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d8a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f911c6 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.145943:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.145944:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.145948:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d8a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911c6 expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.145956:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d8a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911c6 expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.145972:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473a00, rc 0) 00000100:00100000:1.0:1762166855.146005:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765444382720:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 95us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.146009:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1028 00000100:00100000:2.0:1762166855.170406:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.170516:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444382848 00000100:00100000:1.0:1762166855.170533:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444382848 00000100:00100000:1.0:1762166855.170615:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1029 00000100:00100000:1.0:1762166855.170630:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765444382848:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.170658:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.170682:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d8a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f911cd expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.170715:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.170717:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.170737:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d8a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911cd expref: 20 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.170759:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d8a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911cd expref: 20 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.170816:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473800, rc 0) 00000100:00100000:1.0:1762166855.170910:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444382848:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 285us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.170917:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1029 00000100:00100000:2.0:1762166855.172341:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.172389:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444382976 00000100:00100000:1.0:1762166855.172409:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444382976 00000100:00100000:1.0:1762166855.172450:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1030 00000100:00100000:1.0:1762166855.172457:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:49125:x1847765444382976:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.172468:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.172483:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d8b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f911d4 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.172503:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.172505:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.172510:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d8b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911d4 expref: 21 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.172523:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d8b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911d4 expref: 21 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.172533:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472400, rc 0) 00000100:00100000:1.0:1762166855.172579:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:49125:x1847765444382976:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 122us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.172586:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1030 00000100:00100000:3.0:1762166855.173995:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.174066:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444383104 00000100:00100000:1.0:1762166855.174073:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444383104 00000100:00100000:1.0:1762166855.174118:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1031 00000100:00100000:1.0:1762166855.174128:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765444383104:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.174145:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.174161:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d8b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f911db expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.174183:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.174193:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.174200:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d8b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911db expref: 22 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.174217:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d8b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911db expref: 22 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.174229:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472800, rc 0) 00000100:00100000:1.0:1762166855.174276:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444383104:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 150us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.174283:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1031 00000100:00100000:2.0:1762166855.175619:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.175691:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444383232 00000100:00100000:0.0:1762166855.175699:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444383232 00000100:00100000:0.0:1762166855.175756:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 116 00000100:00100000:0.0:1762166855.175800:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+55:49125:x1847765444383232:12345-192.168.203.35@tcp:44:lfs.0 00000100:00100000:0.0:1762166855.193399:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+55:49125:x1847765444383232:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 17625us (17777us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.193425:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 116 00000001:00080000:0.0:1762166855.193480:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934681 is committed 00000020:00080000:0.0:1762166855.193544:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee2435c13c0 refcount 2 committed 0 result 0 batchid 4294969112 00000020:00080000:0.0:1762166855.193550:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee3638b1500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3489aa840 00000020:00080000:0.0:1762166855.193554:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee349de3400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee2435c1900 00000020:00080000:0.0:1762166855.193557:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2425f0300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee24baa0400 00000020:00080000:0.0:1762166855.193560:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].1 00000004:00080000:0.0:1762166855.193595:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000020:00080000:1.0:1762166855.193601:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969112 committed batchid 37 00000020:00080000:1.0:1762166855.193821:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 37 00000100:00100000:3.0:1762166855.193853:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1762166855.193870:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451955968:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166855.193929:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166855.193999:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451955968 00000100:00100000:1.0:1762166855.194007:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451955968 00000100:00100000:1.0:1762166855.194050:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:1.0:1762166855.194060:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765451955968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1762166855.194085:0:7858:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:132 count 1 00010000:00010000:1.0:1762166855.194110:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d8be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.194129:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee244472200/0xf915a5bdf3c9d610 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910d1 expref: 10 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.194137:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.194140:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.194143:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d8be lrc: 4/0,1 mode: --/PW res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.194179:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee244472200/0xf915a5bdf3c9d610 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910d1 expref: 10 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.194192:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee244472200/0xf915a5bdf3c9d610 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910d1 expref: 10 pid: 7858 timeout: 575 lvb_type: 1 00000100:00100000:1.0:1762166855.194204:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451956096:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.194258:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3504603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.194703:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.194785:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444383360 00000100:00100000:0.0:1762166855.194790:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444383360 00000100:00100000:0.0:1762166855.194825:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1033 00000100:00100000:0.0:1762166855.194833:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444383360:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:0.0:1762166855.194897:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444383360:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 60us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.194905:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1033 00000100:00100000:1.0:1762166855.195244:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451956096:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.195265:0:7858:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d8be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166855.195535:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.195580:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444383488 00000100:00100000:3.0:1762166855.195586:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444383488 00010000:00010000:3.0:1762166855.195609:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244472200/0xf915a5bdf3c9d610 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910d1 expref: 11 pid: 7858 timeout: 575 lvb_type: 1 00000100:00100000:2.0:1762166855.195678:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 626 00000100:00100000:2.0:1762166855.195689:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444383488:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166855.195700:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166855.195705:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee244472200/0xf915a5bdf3c9d610 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910d1 expref: 11 pid: 7858 timeout: 575 lvb_type: 1 00010000:00010000:2.0:1762166855.195714:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee244472200/0xf915a5bdf3c9d610 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910d1 expref: 11 pid: 7858 timeout: 575 lvb_type: 1 00010000:00010000:2.0:1762166855.195740:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee244472200/0xf915a5bdf3c9d610 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910d1 expref: 11 pid: 7858 timeout: 575 lvb_type: 1 00010000:00010000:2.0:1762166855.195750:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.195751:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.195754:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d8be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.195794:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d8be lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.195827:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166855.195862:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444383488:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 175us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.195868:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 626 00010000:00010000:3.0:1762166855.195876:0:7858:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d8be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.195889:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d8be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.195899:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d8be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.195907:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d8be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.195928:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166855.195943:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166855.195948:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d8be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.195954:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166855.195958:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d8be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.195964:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d8be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.195973:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d8be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.195982:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d8be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.195995:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166855.195997:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166855.195998:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166855.196447:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765451955968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2376us (2505us total) trans 21474836768 rc 0/0 00000100:00100000:3.0:1762166855.196456:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000004:00080000:2.0:1762166855.196476:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de00380/2, rc 0, transno 21474836768 00000100:00100000:2.0:1762166855.196484:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451955968:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762166855.202370:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.202416:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444383616 00000100:00100000:3.0:1762166855.202426:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444383616 00000100:00100000:3.0:1762166855.202488:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1034 00000100:00100000:3.0:1762166855.202499:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444383616:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762166855.202545:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d8c5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.202573:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166855.202576:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166855.202581:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d8c5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.202595:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d8c5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.202625:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d8c5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.202633:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d8c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.202641:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d8c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.202647:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166855.202652:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d8c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.202660:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d8c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.202674:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d8c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.202693:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d8c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166855.202813:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444383616:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 306us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166855.202822:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1034 00000100:00100000:0.0:1762166855.204046:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.204118:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444383872 00000100:00100000:1.0:1762166855.204129:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444383872 00000100:00100000:1.0:1762166855.204178:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 117 00000100:00100000:1.0:1762166855.204187:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49125:x1847765444383872:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762166855.204235:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.204256:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9d86a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911a3 expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.204271:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x21:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:1.0:1762166855.204281:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166855.204310:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d8cc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.204335:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d8cc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.204344:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d8cc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:1.0:1762166855.204522:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000578ece03 reply state 000000002a331b8f transno 8589934682 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d8cc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.204531:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166855.204601:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49125:x1847765444383872:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 416us (561us total) trans 8589934682 rc 0/0 00000100:00100000:1.0:1762166855.204606:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 117 00010000:00010000:3.0:1762166855.206021:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d8cc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.206038:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d8cc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.206045:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d8cc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.206052:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166855.206057:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d8cc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.206064:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d8cc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.206079:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x21:0x0].0x0 (ffff9ee34ada3a00) 00010000:00010000:3.0:1762166855.206082:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166855.206085:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d8cc lrc: 2/0,0 mode: --/PW res: [0x200000404:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.206092:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d8cc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166855.206121:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.206201:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444384000 00000100:00100000:1.0:1762166855.206216:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444384000 00000100:00100000:1.0:1762166855.206293:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 118 00000100:00100000:1.0:1762166855.206304:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49125:x1847765444384000:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.206332:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.206358:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d8d3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f911e2 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.206426:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d8d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911e2 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.206455:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d8d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911e2 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.206478:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x21:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:1.0:1762166855.206481:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166855.206500:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158a00, rc 0) 00000100:00100000:1.0:1762166855.206575:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49125:x1847765444384000:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 273us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.206583:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 118 00000100:00100000:2.0:1762166855.208057:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.208112:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444384128 00000100:00100000:3.0:1762166855.208134:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444384128 00000100:00100000:3.0:1762166855.208190:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1035 00000100:00100000:3.0:1762166855.208201:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444384128:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:3.0:1762166855.208465:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166855.208468:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x85:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:3.0:1762166855.208471:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x85:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:3.0:1762166855.208473:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x85:0x0] updating lvb ctime from disk: 0 -> 1762166855 00002000:00010000:3.0:1762166855.208476:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x85:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762166855.208537:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444384128:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 337us (487us total) trans 21474836769 rc 0/0 00000100:00100000:3.0:1762166855.208546:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1035 00000100:00100000:2.0:1762166855.209980:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.210158:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444384384 00000100:00100000:1.0:1762166855.210172:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444384384 00000100:00100000:1.0:1762166855.210248:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 119 00000100:00100000:1.0:1762166855.210261:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49125:x1847765444384384:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762166855.210333:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.210387:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9d855 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91195 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.210413:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:1.0:1762166855.210419:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166855.210481:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9d8da lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.210500:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9d8da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.210511:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9d8da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:1.0:1762166855.210685:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c441aa2e reply state 000000002042c9a6 transno 8589934683 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9d8da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.210696:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166855.210864:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49125:x1847765444384384:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 606us (889us total) trans 8589934683 rc 0/0 00000100:00100000:1.0:1762166855.210873:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 119 00010000:00010000:2.0:1762166855.211997:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9d8da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166855.212016:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9d8da lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166855.212025:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9d8da lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166855.212032:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.212037:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9d8da lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166855.212046:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9d8da lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166855.212064:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:2.0:1762166855.212068:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166855.212087:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9d8da lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166855.212095:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9d8da lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166855.212233:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.212735:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444384512 00000100:00100000:2.0:1762166855.212748:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444384512 00000100:00100000:2.0:1762166855.212850:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1036 00000100:00100000:2.0:1762166855.212861:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444384512:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166855.213121:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x84:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166855.213125:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x84:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:2.0:1762166855.213128:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x84:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:2.0:1762166855.213131:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x84:0x0] updating lvb ctime from disk: 1762166855 -> 1762166855 00002000:00010000:2.0:1762166855.213133:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x84:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166855.213217:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444384512:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 357us (991us total) trans 17179869439 rc 0/0 00000100:00100000:2.0:1762166855.213226:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1036 00000100:00100000:0.0:1762166855.214758:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.214874:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444384768 00000100:00100000:2.0:1762166855.214887:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444384768 00000100:00100000:2.0:1762166855.214963:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 32 00000100:00100000:2.0:1762166855.214977:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342fea050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49125:x1847765444384768:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166855.215071:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9d87f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911b1 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.215115:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d8e1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.215129:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9d798 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91156 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.215149:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7fa lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91172 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.215157:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d8e1 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.215192:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7fa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91172 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.215206:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7fa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91172 expref: 27 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.215220:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ce9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451956224:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.215322:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9d798 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91156 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.215332:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9d798 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91156 expref: 27 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.215342:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f402a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451956352:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.215371:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9af00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.216673:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ce9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451956224:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166855.216738:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.216826:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f402a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451956352:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.216851:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d8e1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166855.216962:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444385152 00000100:00100000:0.0:1762166855.216969:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444385152 00000100:00100000:0.0:1762166855.217014:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 33 00000100:00100000:0.0:1762166855.217023:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:43348:x1847765444385152:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1762166855.217261:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:43348:x1847765444385152:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 239us (523us total) trans 8589934684 rc 0/0 00000100:00100000:0.0:1762166855.217275:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 33 00000100:00100000:3.0:1762166855.217429:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.217484:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444384896 00000100:00100000:2.0:1762166855.217490:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444384896 00010000:00010000:2.0:1762166855.217514:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9d798 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91156 expref: 29 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.217546:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 627 00000100:00100000:2.0:1762166855.217554:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444384896:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166855.217566:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166855.217573:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9d798 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91156 expref: 29 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166855.217585:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9d798 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91156 expref: 29 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166855.217606:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9d798 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91156 expref: 29 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166855.217622:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:2.0:1762166855.217626:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d8e1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.217634:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d8e1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.217639:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166855.217676:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444384896:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 123us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.217684:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 627 00000100:00100000:0.0:1762166855.218616:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.218654:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444385280 00000100:00100000:2.0:1762166855.218659:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444385280 00010000:00010000:2.0:1762166855.218680:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7fa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91172 expref: 28 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.218713:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 628 00000100:00100000:2.0:1762166855.218721:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444385280:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166855.218732:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166855.218737:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7fa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91172 expref: 28 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166855.218747:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7fa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91172 expref: 28 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166855.218811:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9d7fa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91172 expref: 28 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166855.218827:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:2.0:1762166855.218832:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d8e1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.218840:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d8e1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.218848:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d8e1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.218884:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166855.218919:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444385280:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 199us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.218936:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 628 00010000:00010000:0.0:1762166855.218968:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d8e1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.218978:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d8e1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.218998:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d8e8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.219009:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d8d3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911e2 expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.219017:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d8e8 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x21:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.219046:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d8d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911e2 expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.219060:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d8d3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911e2 expref: 26 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166855.219073:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc29500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451956480:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166855.219134:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee351428300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.220174:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc29500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451956480:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166855.220189:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166855.220196:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d8e8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x21:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166855.220297:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444385408 00000100:00100000:1.0:1762166855.220311:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444385408 00010000:00010000:1.0:1762166855.220360:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d8d3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911e2 expref: 27 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.220403:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 629 00000100:00100000:1.0:1762166855.220413:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444385408:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.220445:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.220452:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d8d3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911e2 expref: 27 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.220465:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d8d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911e2 expref: 27 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.220489:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d8d3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911e2 expref: 27 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.220508:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x21:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:1.0:1762166855.220513:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d8e8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x21:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.220523:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d8e8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x21:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.220531:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d8e8 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x21:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.220565:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.220611:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d8e8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.220621:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d8e8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166855.220637:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444385408:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 224us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.220664:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 629 00000100:00100000:2.0:1762166855.221172:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f402a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451956608:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166855.221233:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166855.221270:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9af00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.221290:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451956608 00000100:00100000:0.0:1762166855.221296:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451956608 00000100:00100000:0.0:1762166855.221326:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1762166855.221332:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:31351:x1847765451956608:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166855.221428:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:31351:x1847765451956608:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 95us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.221446:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1762166855.221483:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f402a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451956608:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166855.221527:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f402a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451956736:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166855.221550:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166855.221568:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348626300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.221588:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451956736 00000100:00100000:0.0:1762166855.221593:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451956736 00000100:00100000:0.0:1762166855.221620:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1762166855.221626:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:31351:x1847765451956736:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166855.221688:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:31351:x1847765451956736:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 61us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.221694:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1762166855.221780:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f402a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451956736:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166855.222019:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934685 00000100:00100000:3.0:1762166855.222100:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff80700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451956864:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166855.222153:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166855.222189:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.222262:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451956864 00000100:00100000:0.0:1762166855.222269:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451956864 00000100:00100000:0.0:1762166855.222316:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1762166855.222327:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:31351:x1847765451956864:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166855.222493:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:31351:x1847765451956864:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 168us (339us total) trans 21474836770 rc 0/0 00000100:00100000:0.0:1762166855.222501:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1762166855.222531:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff80700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451956864:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166855.222603:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934686 00010000:00010000:3.0:1762166855.222628:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d8e8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.222636:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d8e8 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.222643:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d8e8 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.222658:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166855.222660:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d8e8 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.222666:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d8e8 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.222676:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x21:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:3.0:1762166855.222678:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166855.222683:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d8e8 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.222688:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9d8e8 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.222709:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d8e1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.222715:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d8e1 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.222720:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d8e1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.222725:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166855.222728:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d8e1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.222733:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d8e1 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.222741:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:3.0:1762166855.222743:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166855.222753:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d8e1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.222758:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9d8e1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.222801:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:3.0:1762166855.222804:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166855.222811:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9d87f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911b1 expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166855.222918:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342fea050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49125:x1847765444384768:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 7944us (8167us total) trans 8589934687 rc 0/0 00000100:00100000:3.0:1762166855.222926:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 32 00000020:00080000:3.0:1762166855.222929:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166855.224079:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.224162:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444385536 00000100:00100000:1.0:1762166855.224169:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444385536 00000100:00100000:1.0:1762166855.224210:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 120 00000100:00100000:1.0:1762166855.224217:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49125:x1847765444385536:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.224235:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.224256:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9d8ef lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f911e9 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.224309:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9d8ef lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911e9 expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.224323:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9d8ef lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911e9 expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.224342:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3100) 00010000:00010000:1.0:1762166855.224345:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166855.224348:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158000, rc 0) 00000100:00100000:1.0:1762166855.224392:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49125:x1847765444385536:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 175us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.224400:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 120 00000100:00100000:0.0:1762166855.226126:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.226192:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444385792 00000100:00100000:3.0:1762166855.226199:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444385792 00000100:00100000:3.0:1762166855.226241:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 34 00000100:00100000:3.0:1762166855.226252:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49125:x1847765444385792:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166855.226441:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49125:x1847765444385792:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 184us (322us total) trans 8589934688 rc 0/0 00000100:00100000:3.0:1762166855.226447:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 34 00000100:00100000:3.0:1762166855.227417:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.227462:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444386048 00000100:00100000:2.0:1762166855.227469:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444386048 00000100:00100000:2.0:1762166855.227503:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 35 00000100:00100000:2.0:1762166855.227511:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49125:x1847765444386048:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762166855.227719:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x21:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1762166855.227876:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9d8f6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.227891:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9d8f6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.227916:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9d8f6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.227924:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9d8f6 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.227930:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9d8f6 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.227937:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9d8f6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.227954:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166855.227988:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166855.227997:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9d8f6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.228006:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166855.228010:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9d8f6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.228026:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9d8f6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.228040:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x21:0x0].0x0 (ffff9ee343a13200) 00010000:00010000:1.0:1762166855.228044:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166855.228049:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9d8f6 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166855.228050:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49125:x1847765444386048:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 539us (635us total) trans 8589934689 rc 0/0 00010000:00010000:1.0:1762166855.228063:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9d8f6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166855.228067:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 35 00010000:00010000:1.0:1762166855.228088:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166855.228090:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166855.228092:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166855.235329:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.235400:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444386176 00000100:00100000:1.0:1762166855.235409:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444386176 00000100:00100000:1.0:1762166855.235465:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 121 00000100:00100000:1.0:1762166855.235473:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49127:x1847765444386176:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:1.0:1762166855.235495:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.235512:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d8fd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f911f0 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.235567:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d904 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235581:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d904 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235592:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d904 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235623:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d90b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235630:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d90b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235637:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d90b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235750:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9d912 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235758:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9d912 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235805:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9d912 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.235840:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166855.235845:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166855.235858:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9d912 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235878:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9d912 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235887:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d904 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235893:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d904 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235899:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d904 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235914:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.235918:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d904 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235929:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d904 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235943:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166855.235947:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.235951:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d904 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235958:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d904 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235970:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d90b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235974:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d90b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235978:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d90b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235981:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.235982:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d90b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235986:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d90b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.235990:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3600) 00010000:00010000:1.0:1762166855.235996:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.235998:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d90b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.236002:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d90b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.236029:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d8fd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911f0 expref: 32 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.236041:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9d912 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911f0 expref: 31 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.236048:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3100) 00010000:00010000:1.0:1762166855.236051:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166855.236053:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159a00, rc 0) 00000100:00100000:1.0:1762166855.236117:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49127:x1847765444386176:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 643us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.236125:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 121 00000100:00100000:0.0:1762166855.251875:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.251965:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444386304 00000100:00100000:1.0:1762166855.251982:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444386304 00000100:00100000:1.0:1762166855.252068:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 122 00000100:00100000:1.0:1762166855.252092:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49131:x1847765444386304:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:1.0:1762166855.252191:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d919 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252212:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d919 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252227:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d919 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252264:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d920 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252271:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d920 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252277:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d920 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252413:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d927 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252422:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d927 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252429:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d927 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.252480:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166855.252485:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166855.252498:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d927 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252512:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d919 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252519:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d919 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252526:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d919 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252532:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.252537:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d919 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252555:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d919 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252567:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166855.252571:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.252577:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d919 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252584:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d919 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252599:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d920 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252605:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d920 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252610:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d920 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252614:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.252617:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d920 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252622:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d920 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252628:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3600) 00010000:00010000:1.0:1762166855.252631:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.252633:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d920 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252638:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d920 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252659:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d927 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252664:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d927 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252670:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d927 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252675:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.252678:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d927 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252683:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d927 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252690:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3100) 00010000:00010000:1.0:1762166855.252692:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.252695:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d927 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.252700:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d927 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.252841:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49131:x1847765444386304:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 762us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.252848:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 122 00000100:00100000:3.0:1762166855.263982:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.264078:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444386560 00000100:00100000:1.0:1762166855.264088:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444386560 00000100:00100000:1.0:1762166855.264157:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 123 00000100:00100000:1.0:1762166855.264168:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49133:x1847765444386560:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.264207:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.264228:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d92e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f911f7 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.264341:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d935 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.264355:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d935 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.264366:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d935 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.264377:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166855.264515:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d92e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911f7 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.264533:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d935 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911f7 expref: 33 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.264542:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3100) 00010000:00010000:1.0:1762166855.264545:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166855.264549:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159600, rc 0) 00000100:00100000:1.0:1762166855.264609:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49133:x1847765444386560:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 443us (635us total) trans 8589934690 rc 0/0 00000100:00100000:1.0:1762166855.264616:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 123 00000100:00100000:0.0:1762166855.266885:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.266928:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444386816 00000100:00100000:1.0:1762166855.266935:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444386816 00000100:00100000:1.0:1762166855.266974:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 124 00000100:00100000:1.0:1762166855.266981:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49133:x1847765444386816:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.267008:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.267021:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d943 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f911fe expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.267087:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d94a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.267097:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9d912 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911f0 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.267102:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d94a lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.267127:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9d912 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911f0 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.267139:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9d912 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911f0 expref: 34 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.267152:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451956992:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.267218:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350460a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166855.268245:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451956992:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.268263:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d94a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166855.268377:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.268413:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444386944 00000100:00100000:1.0:1762166855.268418:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444386944 00010000:00010000:1.0:1762166855.268450:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9d912 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911f0 expref: 35 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.268491:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 630 00000100:00100000:1.0:1762166855.268501:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444386944:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.268512:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.268518:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9d912 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911f0 expref: 35 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.268529:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9d912 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911f0 expref: 35 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.268546:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9d912 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911f0 expref: 35 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.268559:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3100) 00010000:00010000:1.0:1762166855.268563:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d94a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.268571:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d94a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.268576:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d94a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.268597:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166855.268627:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d94a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.268635:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765444386944:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 134us (256us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166855.268637:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d94a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.268649:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 630 00000004:00200000:0.0:1762166855.268672:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166855.268819:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9d943 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911fe expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.268834:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d94a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911fe expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.268842:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3100) 00010000:00010000:0.0:1762166855.268846:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166855.268858:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159200, rc 0) 00000100:00100000:0.0:1762166855.268895:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49133:x1847765444386816:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1911us (2014us total) trans 8589934691 rc 0/0 00000100:00100000:0.0:1762166855.268900:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 124 00000100:00100000:0.0:1762166855.270318:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.270391:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444387072 00000100:00100000:2.0:1762166855.270396:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444387072 00000100:00100000:2.0:1762166855.270428:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 36 00000100:00100000:2.0:1762166855.270442:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49133:x1847765444387072:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:2.0:1762166855.270541:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49133:x1847765444387072:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 106us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.270551:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 36 00000100:00100000:2.0:1762166855.271290:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.271333:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444387328 00000100:00100000:3.0:1762166855.271338:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444387328 00000100:00100000:3.0:1762166855.271370:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 37 00000100:00100000:3.0:1762166855.271386:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49133:x1847765444387328:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166855.271560:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49133:x1847765444387328:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 183us (271us total) trans 8589934692 rc 0/0 00000100:00100000:3.0:1762166855.271568:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 37 00000100:00100000:3.0:1762166855.272343:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.272474:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444387584 00000100:00100000:0.0:1762166855.272480:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444387584 00000100:00100000:0.0:1762166855.272515:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 125 00000100:00100000:0.0:1762166855.272521:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49133:x1847765444387584:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.272534:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.272537:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166855.272559:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9d94a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911fe expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.272574:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9d935 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911f7 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.272581:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3100) 00010000:00010000:0.0:1762166855.272590:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166855.272601:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9d958 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91205 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.272655:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9d95f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.272665:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9d95f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.272671:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9d95f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762166855.272679:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166855.272742:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9d958 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91205 expref: 36 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.272752:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9d95f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91205 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.272756:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3100) 00010000:00010000:0.0:1762166855.272758:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166855.272782:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198400, rc 0) 00000100:00100000:0.0:1762166855.272835:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49133:x1847765444387584:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 313us (492us total) trans 8589934693 rc 0/0 00000100:00100000:0.0:1762166855.272842:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 125 00000100:00100000:0.0:1762166855.273960:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.274022:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444387840 00000100:00100000:3.0:1762166855.274028:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444387840 00000100:00100000:3.0:1762166855.274065:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 38 00000100:00100000:3.0:1762166855.274076:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342fea450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49133:x1847765444387840:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:3.0:1762166855.274119:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9d95f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91205 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.274142:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d96d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.274153:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9d8ef lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911e9 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.274161:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d96d lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.274191:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9d8ef lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911e9 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.274203:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9d8ef lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911e9 expref: 35 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166855.274221:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451957120:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166855.274288:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166855.275608:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451957120:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166855.275632:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d96d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166855.275653:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.275752:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444387968 00000100:00100000:1.0:1762166855.275819:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444387968 00010000:00010000:1.0:1762166855.275883:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9d8ef lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911e9 expref: 36 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.275935:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 631 00000100:00100000:1.0:1762166855.275946:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765444387968:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.275964:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.275972:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9d8ef lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911e9 expref: 36 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.275988:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9d8ef lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911e9 expref: 36 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.276015:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9d8ef lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911e9 expref: 36 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.276035:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3100) 00010000:00010000:1.0:1762166855.276041:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d96d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.276052:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d96d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.276060:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d96d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.276092:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166855.276127:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d96d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.276138:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d96d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166855.276166:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444387968:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 221us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.276175:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 631 00010000:00010000:3.0:1762166855.276512:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d96d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.276521:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d96d lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.276528:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d96d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.276536:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382044600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166855.276540:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d96d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.276549:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d96d lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.276559:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3100) 00010000:00010000:3.0:1762166855.276562:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166855.276566:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d96d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.276572:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d96d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.276599:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3100) 00010000:00010000:3.0:1762166855.276602:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166855.276607:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9d95f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91205 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166855.276790:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342fea450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49133:x1847765444387840:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2690us (2804us total) trans 8589934694 rc -22/-22 00000100:00100000:3.0:1762166855.276801:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 38 00000100:00100000:0.0:1762166855.277667:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.277759:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444388096 00000100:00100000:1.0:1762166855.277789:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444388096 00000100:00100000:1.0:1762166855.277843:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 126 00000100:00100000:1.0:1762166855.277853:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49133:x1847765444388096:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.277874:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.277896:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d974 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9120c expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.277946:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d974 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9120c expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.277956:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d974 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9120c expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.277969:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3600) 00010000:00010000:1.0:1762166855.277971:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166855.277973:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158200, rc 0) 00000100:00100000:1.0:1762166855.278012:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49133:x1847765444388096:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 161us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.278019:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 126 00000100:00100000:2.0:1762166855.279639:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.279697:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444388352 00000100:00100000:1.0:1762166855.279705:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444388352 00000100:00100000:1.0:1762166855.279751:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 127 00000100:00100000:1.0:1762166855.279782:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49133:x1847765444388352:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.279801:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.279820:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9d97b lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91213 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.280449:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d982 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.280478:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d982 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.280490:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d982 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.280502:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x22:0x0]: returning size 0 00010000:00010000:1.0:1762166855.280553:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9d97b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91213 expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.280574:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d982 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91213 expref: 37 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.280583:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x22:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:1.0:1762166855.280586:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166855.280589:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159800, rc 0) 00000100:00100000:1.0:1762166855.280654:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49133:x1847765444388352:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 894us (1022us total) trans 8589934695 rc 0/0 00000100:00100000:1.0:1762166855.280662:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 127 00000100:00100000:2.0:1762166855.282311:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.282375:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444388608 00000100:00100000:1.0:1762166855.282394:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444388608 00000100:00100000:1.0:1762166855.282472:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 128 00000100:00100000:1.0:1762166855.282488:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49133:x1847765444388608:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.282514:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.282531:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9d990 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9121a expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.282662:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9d997 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.282680:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9d997 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.282690:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9d997 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.282705:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166855.282864:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9d990 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9121a expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.282880:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9d997 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9121a expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.282889:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3600) 00010000:00010000:1.0:1762166855.282892:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166855.282895:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d400, rc 0) 00000100:00100000:1.0:1762166855.282965:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49133:x1847765444388608:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 484us (668us total) trans 8589934696 rc 0/0 00000100:00100000:1.0:1762166855.282973:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 128 00000100:00100000:0.0:1762166855.284318:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.284366:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444388864 00000100:00100000:3.0:1762166855.284376:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444388864 00000100:00100000:3.0:1762166855.284430:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 39 00000100:00100000:3.0:1762166855.284455:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49133:x1847765444388864:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:3.0:1762166855.284529:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9d997 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9121a expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.284569:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d9a5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.284581:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d974 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9120c expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.284590:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d9a5 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.284622:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d974 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9120c expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.284635:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d974 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9120c expref: 39 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166855.284662:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451957248:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166855.284748:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166855.285947:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451957248:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166855.285973:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d9a5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166855.286021:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.286078:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444388992 00000100:00100000:1.0:1762166855.286084:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444388992 00010000:00010000:1.0:1762166855.286110:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d974 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9120c expref: 40 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.286137:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 632 00000100:00100000:1.0:1762166855.286146:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2360:x1847765444388992:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.286157:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.286163:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d974 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9120c expref: 40 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.286179:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d974 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9120c expref: 40 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.286195:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9d974 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9120c expref: 40 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.286209:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3600) 00010000:00010000:1.0:1762166855.286214:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d9a5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.286221:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d9a5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.286228:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d9a5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.286266:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166855.286291:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d9a5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.286301:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d9a5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166855.286311:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444388992:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 163us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.286319:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 632 00010000:00010000:3.0:1762166855.286323:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d9ac lrc: 3/0,1 mode: --/EX res: [0x200000404:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.286336:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d982 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91213 expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.286345:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d9ac lrc: 4/0,1 mode: --/EX res: [0x200000404:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.286370:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d982 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91213 expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.286383:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d982 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91213 expref: 38 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166855.286396:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451957376:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166855.286509:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166855.287219:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451957376:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166855.287232:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d9ac lrc: 3/0,1 mode: --/EX res: [0x200000404:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166855.287406:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.287455:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444389120 00000100:00100000:1.0:1762166855.287461:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444389120 00010000:00010000:1.0:1762166855.287482:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d982 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91213 expref: 39 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.287509:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 633 00000100:00100000:1.0:1762166855.287517:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444389120:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.287526:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.287539:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d982 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91213 expref: 39 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.287549:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d982 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91213 expref: 39 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.287562:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9d982 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91213 expref: 39 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.287573:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x22:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:1.0:1762166855.287577:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d9ac lrc: 3/0,1 mode: --/EX res: [0x200000404:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.287584:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d9ac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.287588:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d9ac lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.287605:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166855.287613:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d9ac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x22:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.287621:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d9ac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x22:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166855.287632:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2360:x1847765444389120:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 117us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.287637:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 633 00000100:00100000:3.0:1762166855.288086:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451957504:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166855.288122:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166855.288146:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.288160:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451957504 00000100:00100000:0.0:1762166855.288165:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451957504 00000100:00100000:0.0:1762166855.288191:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1762166855.288197:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:31351:x1847765451957504:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166855.288257:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:31351:x1847765451957504:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 61us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.288263:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1762166855.288283:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451957504:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166855.288319:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934697 00000001:00080000:3.0:1762166855.288378:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934698 00010000:00010000:3.0:1762166855.288399:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d9ac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x22:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.288407:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d9ac lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x22:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.288412:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d9ac lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x22:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.288419:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382044200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166855.288423:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d9ac lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x22:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.288431:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d9ac lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x22:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.288472:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x22:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:3.0:1762166855.288475:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166855.288480:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d9ac lrc: 2/0,0 mode: --/EX res: [0x200000404:0x22:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.288486:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9d9ac lrc: 0/0,0 mode: --/EX res: [0x200000404:0x22:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.288508:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d9a5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.288514:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d9a5 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.288519:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d9a5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.288524:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166855.288527:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d9a5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.288532:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d9a5 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.288539:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3600) 00010000:00010000:3.0:1762166855.288542:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166855.288544:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d9a5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.288549:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9d9a5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.288562:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3600) 00010000:00010000:3.0:1762166855.288570:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166855.288576:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9d997 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9121a expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166855.288652:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49133:x1847765444388864:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 4199us (4341us total) trans 8589934699 rc 0/0 00000100:00100000:3.0:1762166855.288661:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 39 00000020:00080000:3.0:1762166855.288666:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166855.289662:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.289744:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444389248 00000100:00100000:1.0:1762166855.289760:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444389248 00000100:00100000:1.0:1762166855.289906:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 129 00000100:00100000:1.0:1762166855.289922:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49133:x1847765444389248:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.289951:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.289982:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9d9b3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91221 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.290071:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9d9b3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91221 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.290087:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9d9b3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91221 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.290106:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:1.0:1762166855.290110:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166855.290114:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7da00, rc 0) 00000100:00100000:1.0:1762166855.290182:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49133:x1847765444389248:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 265us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.290190:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 129 00000100:00100000:0.0:1762166855.291394:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.291441:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444389504 00000100:00100000:3.0:1762166855.291450:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444389504 00000100:00100000:3.0:1762166855.291504:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 40 00000100:00100000:3.0:1762166855.291514:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49133:x1847765444389504:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:3.0:1762166855.291920:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x22:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1762166855.292009:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].10, 64 off9024 00000004:00080000:3.0:1762166855.292019:0:31351:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 476084255882ns, next at 477084254105ns, rc = 0 00000001:00080000:3.0:1762166855.292025:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934700 00010000:00010000:3.0:1762166855.292067:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d9ba lrc: 3/0,1 mode: --/PW res: [0x200000404:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.292081:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d9ba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.292091:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d9ba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.292098:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d9ba lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.292104:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d9ba lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.292110:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d9ba lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.292148:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166855.292188:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166855.292197:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d9ba lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.292204:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382044600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166855.292209:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d9ba lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.292217:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d9ba lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.292228:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x22:0x0].0x0 (ffff9ee363960700) 00010000:00010000:1.0:1762166855.292231:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166855.292236:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d9ba lrc: 1/0,0 mode: --/PW res: [0x200000404:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.292242:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9d9ba lrc: 0/0,0 mode: --/PW res: [0x200000404:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166855.292250:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49133:x1847765444389504:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 736us (859us total) trans 8589934701 rc 0/0 00000100:00100000:3.0:1762166855.292266:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 40 00000020:00080000:3.0:1762166855.292272:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762166855.292276:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166855.292283:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166855.292285:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166855.293588:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.293657:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444389760 00000100:00100000:3.0:1762166855.293668:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444389760 00000100:00100000:3.0:1762166855.293713:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 41 00000100:00100000:3.0:1762166855.293727:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49133:x1847765444389760:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166855.293969:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49133:x1847765444389760:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 248us (393us total) trans 8589934702 rc 0/0 00000100:00100000:3.0:1762166855.293975:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 41 00000100:00100000:2.0:1762166855.302926:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.303072:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444389888 00000100:00100000:1.0:1762166855.303086:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444389888 00000100:00100000:1.0:1762166855.303168:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 130 00000100:00100000:1.0:1762166855.303181:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49135:x1847765444389888:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:1.0:1762166855.303215:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.303240:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9d9c1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91228 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.303324:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9c8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303342:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9c8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303357:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9c8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303373:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9cf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303380:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303387:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303539:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9d9d6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303566:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9d9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303574:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9d9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.303614:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166855.303619:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166855.303640:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9d9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303652:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9d9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303662:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9c8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303669:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9c8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303676:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303682:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7dc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.303687:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303695:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9c8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303709:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166855.303713:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.303717:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9c8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303733:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9c8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303749:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303755:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9cf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303801:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9cf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303811:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.303815:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9cf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303821:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9cf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303832:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3a00) 00010000:00010000:1.0:1762166855.303835:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.303840:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9cf lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303846:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9cf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.303880:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9d9c1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91228 expref: 45 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.303895:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9d9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91228 expref: 44 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.303917:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:1.0:1762166855.303920:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166855.303923:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c200, rc 0) 00000100:00100000:1.0:1762166855.304004:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49135:x1847765444389888:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 827us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.304014:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 130 00000100:00100000:0.0:1762166855.305654:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.305716:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444390016 00000100:00100000:2.0:1762166855.305727:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444390016 00000100:00100000:2.0:1762166855.305826:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1037 00000100:00100000:2.0:1762166855.305838:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765444390016:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166855.305856:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.305873:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d9dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9122f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.305899:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.305902:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.305912:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d9dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9122f expref: 12 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.305932:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d9dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9122f expref: 12 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.305946:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3000, rc 0) 00000100:00100000:2.0:1762166855.306003:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444390016:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 168us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.306010:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1037 00000100:00100000:2.0:1762166855.320160:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.320271:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444390144 00000100:00100000:1.0:1762166855.320286:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444390144 00000100:00100000:1.0:1762166855.320372:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 131 00000100:00100000:1.0:1762166855.320386:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49139:x1847765444390144:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:1.0:1762166855.320495:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9d9e4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320514:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9d9e4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320526:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9d9e4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320539:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9eb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320544:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9eb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320548:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9eb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320676:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9f2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320702:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320709:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.320748:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166855.320753:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166855.320802:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320816:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9d9e4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320822:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9d9e4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320829:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9d9e4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320843:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7d000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.320851:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9d9e4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320859:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9d9e4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320873:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166855.320876:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.320881:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9d9e4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320886:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9d9e4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320909:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9eb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320915:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9eb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320921:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9eb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320926:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.320929:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9eb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320935:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9eb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320943:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3a00) 00010000:00010000:1.0:1762166855.320945:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.320947:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9eb lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320950:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9d9eb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320962:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320965:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9f2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320968:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320978:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7dc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.320980:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320984:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9f2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320988:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:1.0:1762166855.320989:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.320990:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9f2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.320993:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9f2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.321086:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49139:x1847765444390144:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 703us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.321095:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 131 00000100:00100000:3.0:1762166855.331090:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.331187:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444390400 00000100:00100000:1.0:1762166855.331201:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444390400 00000100:00100000:1.0:1762166855.331280:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 132 00000100:00100000:1.0:1762166855.331293:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49141:x1847765444390400:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.331326:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.331355:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9f9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91236 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.331505:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9da00 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.331521:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9da00 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.331554:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9da00 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.331569:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166855.331726:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9d9f9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91236 expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.331749:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9da00 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91236 expref: 46 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.331758:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:1.0:1762166855.331821:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166855.331826:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7de00, rc 0) 00000100:00100000:1.0:1762166855.331915:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49141:x1847765444390400:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 623us (840us total) trans 8589934703 rc 0/0 00000100:00100000:1.0:1762166855.331923:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 132 00000100:00100000:0.0:1762166855.334133:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.334241:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444390528 00000100:00100000:2.0:1762166855.334252:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444390528 00000100:00100000:2.0:1762166855.334323:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1038 00000100:00100000:2.0:1762166855.334334:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444390528:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.334354:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.334391:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9da0e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9123d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.334427:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.334430:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.334451:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9da0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9123d expref: 13 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.334471:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9da0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9123d expref: 13 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.334486:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3c00, rc 0) 00000100:00100000:2.0:1762166855.334548:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444390528:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 216us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.334557:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1038 00000100:00100000:0.0:1762166855.336415:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.336487:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444390784 00000100:00100000:1.0:1762166855.336497:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444390784 00000100:00100000:1.0:1762166855.336558:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 133 00000100:00100000:1.0:1762166855.336573:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49141:x1847765444390784:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.336599:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.336620:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9da15 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91244 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.336750:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9da1c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.336798:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9d9d6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91228 expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.336840:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9da1c lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.336891:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9d9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91228 expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.336909:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9d9d6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91228 expref: 47 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.336927:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451957632:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.337024:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3504603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.339020:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.339176:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451957632:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.339215:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9da1c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166855.339282:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444390912 00000100:00100000:2.0:1762166855.339291:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444390912 00010000:00010000:2.0:1762166855.339340:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9d9d6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91228 expref: 48 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.339389:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 634 00000100:00100000:2.0:1762166855.339404:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2360:x1847765444390912:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166855.339422:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166855.339450:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9d9d6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91228 expref: 48 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166855.339465:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9d9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91228 expref: 48 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166855.339494:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9d9d6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91228 expref: 48 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166855.339522:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:2.0:1762166855.339528:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9da1c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166855.339539:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9da1c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166855.339549:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9da1c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166855.339582:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166855.339635:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9da1c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166855.339644:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:2360:x1847765444390912:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 242us (634us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166855.339649:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9da1c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166855.339661:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 634 00000004:00200000:1.0:1762166855.339673:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166855.339961:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9da15 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91244 expref: 48 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.339980:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9da1c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91244 expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.339988:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:1.0:1762166855.339991:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166855.339994:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d800, rc 0) 00000100:00100000:1.0:1762166855.340042:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49141:x1847765444390784:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3471us (3637us total) trans 8589934704 rc 0/0 00000100:00100000:1.0:1762166855.340064:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 133 00000100:00100000:2.0:1762166855.341638:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.341696:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444391168 00000100:00100000:3.0:1762166855.341711:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444391168 00000100:00100000:3.0:1762166855.341811:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 134 00000100:00100000:3.0:1762166855.341829:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49141:x1847765444391168:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166855.341856:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166855.341877:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9da2a lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9124b expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.342453:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9da31 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.342465:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9da31 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.342473:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9da31 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762166855.342493:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x23:0x0]: returning size 0 00010000:00010000:3.0:1762166855.342540:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9da2a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9124b expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.342561:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9da31 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9124b expref: 49 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.342570:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x23:0x0].0x0 (ffff9ee363960900) 00010000:00010000:3.0:1762166855.342574:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166855.342577:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382045800, rc 0) 00000100:00100000:3.0:1762166855.342655:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49141:x1847765444391168:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 832us (1024us total) trans 8589934705 rc 0/0 00000100:00100000:3.0:1762166855.342663:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 134 00000100:00100000:0.0:1762166855.344308:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.344337:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444391424 00000100:00100000:0.0:1762166855.344344:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444391424 00000100:00100000:0.0:1762166855.344379:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 135 00000100:00100000:0.0:1762166855.344386:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49141:x1847765444391424:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.344404:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.344418:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9da3f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91252 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.344503:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da46 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.344514:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9da31 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9124b expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.344520:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da46 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.344554:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9da31 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9124b expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.344565:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9da31 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9124b expref: 50 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166855.344576:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451957760:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166855.344640:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36cb75d80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.346475:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451957760:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166855.346504:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da46 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166855.346655:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.346692:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444391552 00000100:00100000:2.0:1762166855.346701:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444391552 00010000:00010000:2.0:1762166855.346729:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9da31 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9124b expref: 51 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.346759:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 635 00000100:00100000:2.0:1762166855.346801:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444391552:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166855.346822:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166855.346830:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9da31 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9124b expref: 51 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166855.346842:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9da31 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9124b expref: 51 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166855.346863:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9da31 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9124b expref: 51 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166855.346879:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x23:0x0].0x0 (ffff9ee363960900) 00010000:00010000:2.0:1762166855.346883:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da46 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166855.346891:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da46 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166855.346899:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da46 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166855.346921:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166855.346938:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da46 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.346947:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da46 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762166855.346964:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x23:0x0]: returning size 0 00000100:00100000:2.0:1762166855.346974:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2361:x1847765444391552:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 174us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.346985:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 635 00000004:00080000:0.0:1762166855.347464:0:30818:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x85:0x0], index 1: 0 00010000:00010000:0.0:1762166855.347611:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da46 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.347620:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da46 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.347627:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da46 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.347643:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166855.347647:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da46 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.347655:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da46 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.347666:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x23:0x0].0x0 (ffff9ee363960900) 00010000:00010000:0.0:1762166855.347670:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166855.347674:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da46 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.347680:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da46 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.347733:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9da3f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91252 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.347743:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166855.347745:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166855.347748:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9da3f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91252 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.347757:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199800, rc 0) 00000100:00100000:0.0:1762166855.347828:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49141:x1847765444391424:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3441us (3564us total) trans 8589934706 rc 301/301 00000100:00100000:0.0:1762166855.347836:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 135 00000100:00100000:0.0:1762166855.349076:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.349149:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444391808 00000100:00100000:3.0:1762166855.349156:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444391808 00000100:00100000:3.0:1762166855.349207:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 42 00000100:00100000:3.0:1762166855.349220:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49141:x1847765444391808:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166855.349520:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49141:x1847765444391808:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 304us (447us total) trans 8589934707 rc 0/0 00000100:00100000:3.0:1762166855.349525:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 42 00000001:00080000:3.0:1762166855.351673:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869432 is committed 00000001:00080000:3.0:1762166855.351698:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869437 is committed 00000001:00080000:3.0:1762166855.351715:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869436 is committed 00000001:00080000:3.0:1762166855.351729:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869439 is committed 00000001:00080000:3.0:1762166855.351734:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869438 is committed 00000100:00100000:1.0:1762166855.351949:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.352024:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444391936 00000100:00100000:0.0:1762166855.352053:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444391936 00000100:00100000:0.0:1762166855.352120:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 136 00000100:00100000:0.0:1762166855.352134:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49141:x1847765444391936:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.352162:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.352186:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9da54 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91259 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.352287:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9da5b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.352303:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9da1c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91244 expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.352313:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9da5b lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.352355:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9da1c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91244 expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.352382:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9da1c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91244 expref: 51 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166855.352402:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345731f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451957888:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166855.352507:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee351428480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.354683:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345731f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451957888:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.354702:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762166855.354718:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9da5b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166855.354860:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444392064 00000100:00100000:2.0:1762166855.354876:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444392064 00010000:00010000:2.0:1762166855.354916:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9da1c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91244 expref: 52 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.354959:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 636 00000100:00100000:2.0:1762166855.354981:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2360:x1847765444392064:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166855.354998:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166855.355005:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9da1c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91244 expref: 52 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166855.355019:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9da1c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91244 expref: 52 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166855.355042:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9da1c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91244 expref: 52 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166855.355057:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:2.0:1762166855.355062:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9da5b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166855.355071:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9da5b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166855.355078:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9da5b lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166855.355116:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166855.355174:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9da5b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166855.355180:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2360:x1847765444392064:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 199us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.355194:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 636 00010000:00010000:0.0:1762166855.355208:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9da5b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762166855.355260:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166855.355265:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166855.355288:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9da5b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.355327:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9da54 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91259 expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.355344:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9da5b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91259 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.355351:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:0.0:1762166855.355353:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166855.355355:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199400, rc 0) 00000100:00100000:0.0:1762166855.355398:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49141:x1847765444391936:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3267us (3455us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.355408:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 136 00000100:00100000:3.0:1762166855.356656:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.356716:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444392192 00000100:00100000:2.0:1762166855.356723:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444392192 00000100:00100000:2.0:1762166855.356795:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1039 00000100:00100000:2.0:1762166855.356809:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444392192:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.356832:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.356848:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9da62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91260 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.356872:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.356874:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.356882:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9da62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91260 expref: 14 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.356897:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9da62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91260 expref: 14 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.356908:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2800, rc 0) 00000100:00100000:2.0:1762166855.356953:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2361:x1847765444392192:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 148us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.356960:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1039 00000100:00100000:1.0:1762166855.358338:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.358424:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444392320 00000100:00100000:0.0:1762166855.358442:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444392320 00000100:00100000:0.0:1762166855.358493:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 137 00000100:00100000:0.0:1762166855.358503:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49141:x1847765444392320:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.358520:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.358540:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9da69 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91267 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.358624:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da70 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.358636:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.358645:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762166855.358680:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x23:0x0]: returning size 0 00000004:00200000:0.0:1762166855.358684:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166855.358700:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.358726:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9da69 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91267 expref: 52 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.358745:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da70 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91267 expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.358753:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x23:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166855.358757:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762166855.358759:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198a00, rc 0) 00000100:00100000:0.0:1762166855.358842:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49141:x1847765444392320:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 341us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.358848:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 137 00000100:00100000:1.0:1762166855.360365:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.360418:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444392448 00000100:00100000:2.0:1762166855.360425:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444392448 00000100:00100000:2.0:1762166855.360481:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1040 00000100:00100000:2.0:1762166855.360491:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765444392448:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.360504:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.360520:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9da77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9126e expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166855.360541:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166855.360556:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.360559:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.360577:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9da77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9126e expref: 20 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.360594:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9da77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9126e expref: 20 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.360605:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2c00, rc 0) 00000100:00100000:2.0:1762166855.360656:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444392448:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 166us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.360663:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1040 00000100:00100000:3.0:1762166855.362123:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.362172:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444392704 00000100:00100000:0.0:1762166855.362181:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444392704 00000100:00100000:0.0:1762166855.362226:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 138 00000100:00100000:0.0:1762166855.362236:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49141:x1847765444392704:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.362263:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.362281:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9da7e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91275 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.362364:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9da85 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.362377:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9da85 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.362387:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9da85 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762166855.362411:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166855.362547:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9da7e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91275 expref: 54 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.362560:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9da85 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91275 expref: 53 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.362566:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:0.0:1762166855.362569:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166855.362571:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198800, rc 0) 00000100:00100000:0.0:1762166855.362614:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49141:x1847765444392704:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 380us (498us total) trans 8589934708 rc 0/0 00000100:00100000:0.0:1762166855.362620:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 138 00000100:00100000:1.0:1762166855.365188:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.365261:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444392832 00000100:00100000:2.0:1762166855.365271:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444392832 00000100:00100000:2.0:1762166855.365329:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1041 00000100:00100000:2.0:1762166855.365339:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2361:x1847765444392832:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.365355:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.365371:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9da93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9127c expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.365394:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.365397:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.365405:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9da93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9127c expref: 15 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.365421:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9da93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9127c expref: 15 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.365444:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3800, rc 0) 00000100:00100000:2.0:1762166855.365504:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765444392832:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 166us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.365528:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1041 00000100:00100000:1.0:1762166855.369935:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.370000:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444392960 00000100:00100000:2.0:1762166855.370010:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444392960 00000100:00100000:2.0:1762166855.370073:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1042 00000100:00100000:2.0:1762166855.370084:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444392960:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.370100:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.370116:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9da9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91283 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.370139:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.370142:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.370150:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9da9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91283 expref: 16 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.370165:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9da9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91283 expref: 16 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.370177:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2000, rc 0) 00000100:00100000:2.0:1762166855.370241:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444392960:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 159us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.370248:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1042 00000100:00100000:3.0:1762166855.371957:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.372011:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444393088 00000100:00100000:2.0:1762166855.372019:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444393088 00000100:00100000:2.0:1762166855.372064:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1043 00000100:00100000:2.0:1762166855.372073:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765444393088:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166855.372112:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daa1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.372135:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.372138:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.372142:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daa1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.372153:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daa1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.372181:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daa1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.372189:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daa1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.372196:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.372202:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166855.372206:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.372214:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daa1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.372226:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daa1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.372242:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daa1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166855.372300:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765444393088:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 228us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.372307:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1043 00000100:00100000:1.0:1762166855.373845:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.373907:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444393216 00000100:00100000:2.0:1762166855.373915:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444393216 00000100:00100000:2.0:1762166855.373957:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1044 00000100:00100000:2.0:1762166855.373967:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2358:x1847765444393216:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.373982:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.373997:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9daa8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9128a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.374018:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.374020:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.374026:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9daa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9128a expref: 17 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.374041:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9daa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9128a expref: 17 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.374053:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3e00, rc 0) 00000100:00100000:2.0:1762166855.374101:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765444393216:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 136us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.374109:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1044 00000100:00100000:1.0:1762166855.401721:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.401834:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444393344 00000100:00100000:2.0:1762166855.401851:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444393344 00000100:00100000:2.0:1762166855.401909:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1045 00000100:00100000:2.0:1762166855.401920:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765444393344:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.401939:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.401956:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daaf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91291 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.401977:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.401979:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.401987:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91291 expref: 18 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.402002:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91291 expref: 18 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.402015:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3200, rc 0) 00000100:00100000:2.0:1762166855.402081:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765444393344:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 163us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.402094:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1045 00000100:00100000:3.0:1762166855.403589:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.403693:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444393472 00000100:00100000:2.0:1762166855.403700:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444393472 00000100:00100000:2.0:1762166855.403742:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1046 00000100:00100000:2.0:1762166855.403751:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:49141:x1847765444393472:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.403796:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.403810:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9dab6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91298 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.403852:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.403854:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.403860:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9dab6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91298 expref: 19 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.403873:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9dab6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91298 expref: 19 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.403883:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3a00, rc 0) 00000100:00100000:2.0:1762166855.403930:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:49141:x1847765444393472:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 180us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.403936:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1046 00000100:00100000:1.0:1762166855.405549:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.405634:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444393600 00000100:00100000:3.0:1762166855.405642:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444393600 00000100:00100000:3.0:1762166855.405688:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1047 00000100:00100000:3.0:1762166855.405696:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765444393600:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166855.405709:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166855.405722:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9dabd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9129f expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.405739:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166855.405742:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166855.405748:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9dabd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9129f expref: 20 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166855.405807:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9dabd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9129f expref: 20 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166855.405818:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382044200, rc 0) 00000100:00100000:3.0:1762166855.405865:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444393600:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 170us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166855.405873:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1047 00000100:00100000:1.0:1762166855.407197:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.407267:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444393728 00000100:00100000:0.0:1762166855.407274:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444393728 00000100:00100000:0.0:1762166855.407320:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 139 00000100:00100000:0.0:1762166855.407331:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49141:x1847765444393728:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:2.0:1762166855.420460:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934708 is committed 00000020:00080000:2.0:1762166855.420515:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969112 batchid updated 00000004:00080000:2.0:1762166855.420569:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000100:00100000:0.0:1762166855.420576:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49141:x1847765444393728:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 13239us (13374us total) trans 0 rc 0/0 00000020:00080000:1.0:1762166855.420578:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969112 00000100:00100000:0.0:1762166855.420594:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 139 00000020:00080000:2.0:1762166855.420627:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee2424b9b40 refcount 2 committed 0 result 0 batchid 4294969113 00000020:00080000:2.0:1762166855.420634:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435c0200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee2424b9000 00000020:00080000:2.0:1762166855.420638:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435c0300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee244454400 00000100:00100000:0.0:1762166855.420852:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1762166855.420873:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451958016:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762166855.420935:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1762166855.420966:0:30853:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969112 cancel update log [0x200000bd0:0x1:0x0].1: rc = 0 00000020:00080000:1.0:1762166855.420990:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969113 committed batchid 4294969112 00000100:00100000:2.0:1762166855.420996:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451958016 00000100:00100000:2.0:1762166855.421003:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451958016 00000100:00100000:2.0:1762166855.421045:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:2.0:1762166855.421053:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1847765451958016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1762166855.421076:0:7858:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:132 count 1 00010000:00010000:2.0:1762166855.421096:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dac4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.421131:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee244473000/0xf915a5bdf3c9d672 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910fb expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.421140:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d8b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911db expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.421151:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d8b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911d4 expref: 19 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.421159:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d8a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911cd expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.421168:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d8a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911c6 expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00000020:00080000:1.0:1762166855.421172:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969112 00010000:00010000:2.0:1762166855.421179:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d894 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911bf expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.421193:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d88d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911b8 expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.421205:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d85c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9119c expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.421213:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d808 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91179 expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.421229:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee244472600/0xf915a5bdf3c9d7c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91164 expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.421236:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.421238:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.421241:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dac4 lrc: 13/0,1 mode: --/PW res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.421269:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee244472600/0xf915a5bdf3c9d7c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91164 expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.421282:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee244472600/0xf915a5bdf3c9d7c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91164 expref: 19 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166855.421294:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f400380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451958144:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.421356:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d808 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91179 expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.421362:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d808 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91179 expref: 19 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166855.421369:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f400700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451958272:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.421389:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d85c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9119c expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.421411:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d85c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9119c expref: 19 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166855.421420:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f400e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451958400:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.421465:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d88d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911b8 expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.421474:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d88d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911b8 expref: 19 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166855.421483:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f401500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451958528:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.421510:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d894 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911bf expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.421517:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d894 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911bf expref: 19 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166855.421523:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f401880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451958656:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.421542:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d8a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911c6 expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.421551:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d8a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911c6 expref: 19 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166855.421572:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f402a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451958784:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.421603:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d8a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911cd expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.421609:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d8a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911cd expref: 19 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166855.421614:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ce9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451958912:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.421640:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d8b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911d4 expref: 19 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.421648:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d8b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911d4 expref: 19 pid: 7858 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.421657:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451959040:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.421686:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d8b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911db expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.421695:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d8b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911db expref: 19 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166855.421703:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451959168:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.421729:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee244473000/0xf915a5bdf3c9d672 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910fb expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.421744:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee244473000/0xf915a5bdf3c9d672 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910fb expref: 19 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166855.421753:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451959296:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.421806:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485d80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166855.422427:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.422513:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444393856 00000100:00100000:0.0:1762166855.422521:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444393856 00000100:00100000:0.0:1762166855.422580:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1049 00000100:00100000:0.0:1762166855.422588:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444393856:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:0.0:1762166855.422665:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444393856:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 77us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.422671:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1049 00000100:00100000:2.0:1762166855.423977:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f400380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451958144:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166855.423977:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.423990:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f400700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451958272:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.423999:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f400e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451958400:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.424007:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f401500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451958528:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.424014:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f401880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451958656:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.424021:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f402a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451958784:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166855.424021:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.424028:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ce9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451958912:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.424036:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451959040:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166855.424043:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.424044:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451959168:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.424051:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451959296:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166855.424064:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.424080:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166855.424090:0:7858:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dac4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166855.424099:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.424147:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444394880 00000100:00100000:0.0:1762166855.424149:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.424153:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444394880 00000100:00100000:3.0:1762166855.424154:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444393984 00000100:00100000:3.0:1762166855.424161:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444393984 00000100:00100000:0.0:1762166855.424168:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.424184:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166855.424198:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d8b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911d4 expref: 21 pid: 7858 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.424200:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d8a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911cd expref: 21 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:0.0:1762166855.424221:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.424234:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444394112 00000100:00100000:2.0:1762166855.424239:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444394112 00000100:00100000:3.0:1762166855.424252:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444394240 00000100:00100000:3.0:1762166855.424258:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444394240 00010000:00010000:2.0:1762166855.424260:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244472600/0xf915a5bdf3c9d7c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91164 expref: 22 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.424262:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444394496 00000100:00100000:1.0:1762166855.424276:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444394496 00000100:00100000:2.0:1762166855.424287:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444394368 00000100:00100000:2.0:1762166855.424293:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444394368 00010000:00010000:2.0:1762166855.424318:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d88d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911b8 expref: 25 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:3.0:1762166855.424326:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d808 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91179 expref: 25 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:1.0:1762166855.424326:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d85c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9119c expref: 25 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166855.424337:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444394752 00000100:00100000:2.0:1762166855.424345:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444394752 00010000:00010000:2.0:1762166855.424368:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d8a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911c6 expref: 26 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.424403:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444395136 00000100:00100000:2.0:1762166855.424404:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444395008 00000100:00100000:3.0:1762166855.424405:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444394624 00000100:00100000:2.0:1762166855.424418:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444395008 00000100:00100000:1.0:1762166855.424418:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444395136 00000100:00100000:3.0:1762166855.424420:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444394624 00010000:00010000:1.0:1762166855.424463:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244473000/0xf915a5bdf3c9d672 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910fb expref: 29 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:3.0:1762166855.424465:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d894 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911bf expref: 29 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:2.0:1762166855.424465:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d8b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911db expref: 29 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.424535:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 637 00000100:00100000:3.0:1762166855.424562:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 638 00000100:00100000:1.0:1762166855.424564:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765444394880:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166855.424579:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 639 00000100:00100000:3.0:1762166855.424585:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765444393984:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.424588:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166855.424599:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444394112:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166855.424602:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.424602:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d8b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911d4 expref: 29 pid: 7858 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166855.424617:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166855.424619:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d8a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 15 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911cd expref: 29 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:2.0:1762166855.424631:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee244472600/0xf915a5bdf3c9d7c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 16 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91164 expref: 29 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:1.0:1762166855.424638:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d8b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 17 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911d4 expref: 29 pid: 7858 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.424667:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d8a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 16 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911cd expref: 29 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:1.0:1762166855.424700:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee244472400/0xf915a5bdf3c9d8b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 15 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911d4 expref: 29 pid: 7858 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166855.424704:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee244472600/0xf915a5bdf3c9d7c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 16 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91164 expref: 29 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:3.0:1762166855.424732:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee244473800/0xf915a5bdf3c9d8a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911cd expref: 28 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:2.0:1762166855.424739:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee244472600/0xf915a5bdf3c9d7c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 15 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91164 expref: 28 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:1.0:1762166855.424739:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166855.424755:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.424757:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166855.424877:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2358:x1847765444394880:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 316us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166855.424880:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444393984:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 298us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.424891:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444394112:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 287us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.424894:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 640 00000100:00100000:1.0:1762166855.424910:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 637 00000100:00100000:0.0:1762166855.424917:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444394368:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166855.424929:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 639 00000100:00100000:3.0:1762166855.424939:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 638 00010000:00010000:0.0:1762166855.424953:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166855.424965:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 641 00010000:00010000:0.0:1762166855.424965:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d88d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911b8 expref: 23 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166855.424983:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444394496:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166855.424984:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d88d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911b8 expref: 23 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:3.0:1762166855.424989:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 642 00010000:00010000:2.0:1762166855.425003:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166855.425012:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d85c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9119c expref: 23 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:3.0:1762166855.425017:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444394240:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166855.425020:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee244472000/0xf915a5bdf3c9d88d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911b8 expref: 23 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.425022:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 643 00010000:00010000:3.0:1762166855.425043:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166855.425046:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444394752:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166855.425062:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d85c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9119c expref: 22 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:3.0:1762166855.425063:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d808 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91179 expref: 22 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:1.0:1762166855.425068:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.425087:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d8a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911c6 expref: 22 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:0.0:1762166855.425098:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.425111:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9d85c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9119c expref: 22 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:3.0:1762166855.425113:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d808 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91179 expref: 22 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:0.0:1762166855.425139:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765444394368:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 223us (1029us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166855.425149:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d8a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911c6 expref: 21 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:0.0:1762166855.425161:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 640 00010000:00010000:2.0:1762166855.425186:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166855.425187:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee244473600/0xf915a5bdf3c9d808 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91179 expref: 20 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:1.0:1762166855.425201:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9d8a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911c6 expref: 20 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:0.0:1762166855.425202:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 644 00010000:00010000:3.0:1762166855.425209:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166855.425226:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765444394496:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 240us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.425247:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765444395136:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166855.425251:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765444394240:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 241us (1176us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166855.425280:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166855.425285:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 641 00010000:00010000:1.0:1762166855.425297:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166855.425298:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 642 00010000:00010000:0.0:1762166855.425298:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee244473000/0xf915a5bdf3c9d672 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910fb expref: 18 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166855.425318:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 645 00010000:00010000:0.0:1762166855.425319:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee244473000/0xf915a5bdf3c9d672 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910fb expref: 17 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:3.0:1762166855.425331:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 646 00000100:00100000:2.0:1762166855.425338:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444394624:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166855.425341:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444394752:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 298us (1184us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166855.425349:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee244473000/0xf915a5bdf3c9d672 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910fb expref: 16 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:3.0:1762166855.425359:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444395008:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166855.425362:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166855.425378:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 643 00010000:00010000:2.0:1762166855.425379:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d894 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911bf expref: 16 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:3.0:1762166855.425380:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166855.425394:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d8b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911db expref: 16 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:2.0:1762166855.425410:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d894 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911bf expref: 15 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:3.0:1762166855.425441:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d8b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x84:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911db expref: 14 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:2.0:1762166855.425467:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9d894 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911bf expref: 14 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:0.0:1762166855.425467:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166855.425479:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee244472800/0xf915a5bdf3c9d8b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x84:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911db expref: 13 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:2.0:1762166855.425481:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.425486:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.425492:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dac4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.425502:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dac4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166855.425511:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444395136:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 277us (1338us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166855.425515:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166855.425524:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 644 00010000:00010000:2.0:1762166855.425539:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166855.425552:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444395008:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 202us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166855.425561:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 646 00000100:00100000:2.0:1762166855.425580:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444394624:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 247us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.425592:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 645 00010000:00010000:2.0:1762166855.425649:0:7858:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dac4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.425665:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dac4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.425675:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dac4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.425683:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dac4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.425720:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166855.425977:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166855.425984:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dac4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.425992:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166855.425997:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dac4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.426006:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dac4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.426018:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dac4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.426026:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dac4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.426047:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166855.426050:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166855.426058:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166855.426407:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765451958016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5353us (5472us total) trans 17179869440 rc 0/0 00000100:00100000:2.0:1762166855.426417:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1762166855.426523:0:3295:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869438 gen 2 00000004:00080000:0.0:1762166855.426531:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354fb80, transno 17179869433 00000004:00080000:0.0:1762166855.426553:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354c700, transno 17179869434 00000004:00080000:0.0:1762166855.426557:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f286300, transno 17179869435 00000004:00080000:0.0:1762166855.426560:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354ce00, transno 17179869436 00000004:00080000:0.0:1762166855.426565:0:3295:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869438 committed transno 17179869438 00000100:00100000:0.0:1762166855.426588:0:3295:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee36f400a80 x1847765451958016/t17179869440(17179869440) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166871 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1762166855.426598:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f400a80/2, rc 0, transno 17179869440 00000100:00100000:0.0:1762166855.426603:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451958016:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1762166855.426802:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 1 in progress, 0 in flight, 4 done 00000100:00100000:3.0:1762166855.431004:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.431106:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444395264 00000100:00100000:2.0:1762166855.431117:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444395264 00000100:00100000:2.0:1762166855.431175:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1050 00000100:00100000:2.0:1762166855.431187:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444395264:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166855.431236:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dacb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.431251:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.431254:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.431259:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dacb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.431273:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dacb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.431319:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dacb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.431328:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dacb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.431336:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dacb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.431342:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166855.431346:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dacb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.431355:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dacb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.431369:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dacb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.431376:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dacb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166855.431471:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444395264:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 287us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.431480:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1050 00000100:00100000:1.0:1762166855.433147:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.433221:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444395520 00000100:00100000:0.0:1762166855.433233:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444395520 00000100:00100000:0.0:1762166855.433293:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 140 00000100:00100000:0.0:1762166855.433303:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49141:x1847765444395520:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166855.433349:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166855.433372:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9da70 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91267 expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.433388:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x23:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166855.433398:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166855.433426:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dad2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.433463:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dad2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.433472:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dad2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:0.0:1762166855.433638:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005506fd61 reply state 00000000c9f1620c transno 8589934709 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dad2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166855.433646:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166855.433726:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49141:x1847765444395520:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 425us (593us total) trans 8589934709 rc 0/0 00000100:00100000:0.0:1762166855.433743:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 140 00000100:00100000:0.0:1762166855.435092:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166855.435110:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dad2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.435121:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dad2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.435128:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dad2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.435133:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166855.435138:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dad2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.435145:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dad2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.435158:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x23:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:3.0:1762166855.435161:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166855.435165:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dad2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.435174:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444395648 00000100:00100000:1.0:1762166855.435182:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444395648 00010000:00010000:3.0:1762166855.435216:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dad2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.435230:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 141 00000100:00100000:1.0:1762166855.435240:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49141:x1847765444395648:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.435257:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.435272:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dad9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f912a6 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.435311:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dad9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912a6 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.435322:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dad9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912a6 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.435336:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x23:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:1.0:1762166855.435339:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166855.435342:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c800, rc 0) 00000100:00100000:1.0:1762166855.435382:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49141:x1847765444395648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 144us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.435388:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 141 00000100:00100000:3.0:1762166855.436647:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.436714:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444395776 00000100:00100000:2.0:1762166855.436731:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444395776 00000100:00100000:2.0:1762166855.436798:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1051 00000100:00100000:2.0:1762166855.436808:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444395776:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166855.437020:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166855.437024:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x85:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:2.0:1762166855.437026:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x85:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:2.0:1762166855.437029:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x85:0x0] updating lvb ctime from disk: 0 -> 1762166855 00002000:00010000:2.0:1762166855.437031:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x85:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166855.437075:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444395776:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 269us (433us total) trans 17179869441 rc 0/0 00000100:00100000:2.0:1762166855.437082:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1051 00000100:00100000:0.0:1762166855.438334:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.438383:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444396032 00000100:00100000:2.0:1762166855.438390:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444396032 00000100:00100000:2.0:1762166855.438450:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 142 00000100:00100000:2.0:1762166855.438459:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49141:x1847765444396032:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762166855.438502:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166855.438526:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9da5b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91259 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.438542:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:2.0:1762166855.438547:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.438582:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dae0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.438594:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dae0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.438604:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dae0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:2.0:1762166855.438744:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bde510a3 reply state 00000000c36478bb transno 8589934710 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dae0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166855.438753:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166855.438857:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49141:x1847765444396032:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 399us (526us total) trans 8589934710 rc 0/0 00000100:00100000:2.0:1762166855.438867:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 142 00010000:00010000:2.0:1762166855.439951:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dae0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.439962:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dae0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.439968:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dae0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.439973:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.439978:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dae0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166855.439984:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166855.439990:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dae0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.440005:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:2.0:1762166855.440008:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166855.440012:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dae0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.440020:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dae0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166855.440075:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444396160 00000100:00100000:1.0:1762166855.440108:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444396160 00000100:00100000:1.0:1762166855.440184:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1052 00000100:00100000:1.0:1762166855.440196:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444396160:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762166855.440440:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166855.440445:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x85:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:1.0:1762166855.440448:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x85:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:1.0:1762166855.440451:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x85:0x0] updating lvb ctime from disk: 1762166855 -> 1762166855 00002000:00010000:1.0:1762166855.440453:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x85:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762166855.440531:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765444396160:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 337us (551us total) trans 21474836771 rc 0/0 00000100:00100000:1.0:1762166855.440540:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1052 00000100:00100000:3.0:1762166855.441643:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.441706:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444396416 00000100:00100000:2.0:1762166855.441732:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444396416 00000100:00100000:2.0:1762166855.441817:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 43 00000100:00100000:2.0:1762166855.441828:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342febc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49141:x1847765444396416:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166855.441901:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9da85 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91275 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.441935:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dae7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.441947:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9d9b3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91221 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.441954:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9da00 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91236 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.441962:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dae7 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.441994:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9da00 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91236 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.442007:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9da00 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91236 expref: 27 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.442020:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451959424:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.442106:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9d9b3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91221 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.442116:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9d9b3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91221 expref: 27 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.442133:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451959552:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.442159:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.443233:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451959424:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.443260:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451959552:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.443279:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dae7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166855.443429:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.443499:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.443500:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444396672 00000100:00100000:0.0:1762166855.443507:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444396672 00000100:00100000:0.0:1762166855.443551:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 44 00000100:00100000:0.0:1762166855.443561:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:37762:x1847765444396672:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1762166855.443598:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444396800 00000100:00100000:1.0:1762166855.443612:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444396800 00010000:00010000:1.0:1762166855.443663:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9d9b3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91221 expref: 29 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.443712:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 647 00000100:00100000:1.0:1762166855.443726:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765444396800:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.443746:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.443755:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9d9b3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91221 expref: 30 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166855.443806:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:37762:x1847765444396672:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 244us (376us total) trans 8589934711 rc 0/0 00000100:00100000:0.0:1762166855.443819:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 44 00010000:00010000:1.0:1762166855.443827:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9d9b3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91221 expref: 30 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.443858:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9d9b3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91221 expref: 29 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.443898:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:1.0:1762166855.443904:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dae7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.443915:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dae7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.443922:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166855.443974:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444396800:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 251us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.443985:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 647 00000100:00100000:0.0:1762166855.445145:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.445201:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444396928 00000100:00100000:1.0:1762166855.445209:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444396928 00010000:00010000:1.0:1762166855.445233:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9da00 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91236 expref: 28 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.445277:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 648 00000100:00100000:1.0:1762166855.445286:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444396928:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.445300:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.445306:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9da00 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91236 expref: 28 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.445319:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9da00 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91236 expref: 28 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.445338:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9da00 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91236 expref: 28 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.445369:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:1.0:1762166855.445374:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dae7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.445383:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dae7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.445390:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dae7 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.445418:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.445450:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dae7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.445459:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dae7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166855.445473:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444396928:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 186us (332us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166855.445481:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9daee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166855.445482:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 648 00010000:00010000:2.0:1762166855.445497:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dad9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912a6 expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.445506:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9daee lrc: 4/0,1 mode: --/EX res: [0x200000404:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.445532:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dad9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912a6 expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.445544:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dad9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912a6 expref: 26 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.445556:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451959680:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.445620:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.446982:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451959680:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166855.446991:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166855.447024:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9daee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166855.447063:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444397056 00000100:00100000:1.0:1762166855.447073:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444397056 00010000:00010000:1.0:1762166855.447108:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dad9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912a6 expref: 27 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.447151:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 649 00000100:00100000:1.0:1762166855.447163:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444397056:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.447180:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.447187:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dad9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912a6 expref: 27 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.447199:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dad9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912a6 expref: 27 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.447243:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dad9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912a6 expref: 27 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.447260:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x23:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:1.0:1762166855.447265:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9daee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.447275:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9daee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.447283:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9daee lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.447313:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166855.447367:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444397056:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 205us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.447377:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 649 00010000:00010000:2.0:1762166855.447388:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9daee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.447400:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9daee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166855.447862:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451959808:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166855.447915:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166855.447944:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.447966:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451959808 00000100:00100000:0.0:1762166855.447974:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451959808 00000100:00100000:0.0:1762166855.448023:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1762166855.448046:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:31351:x1847765451959808:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166855.448131:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:31351:x1847765451959808:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 88us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.448138:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1762166855.448176:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451959808:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166855.448220:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451959936:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166855.448242:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166855.448261:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.448283:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451959936 00000100:00100000:0.0:1762166855.448288:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451959936 00000100:00100000:0.0:1762166855.448315:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1762166855.448324:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:31351:x1847765451959936:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166855.448389:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:31351:x1847765451959936:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 66us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.448396:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1762166855.448403:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451959936:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166855.448560:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934712 00000100:00100000:2.0:1762166855.448602:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451960064:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166855.448624:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166855.448646:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.448671:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451960064 00000100:00100000:0.0:1762166855.448676:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451960064 00000100:00100000:0.0:1762166855.448697:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1762166855.448704:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:31351:x1847765451960064:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166855.448838:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:31351:x1847765451960064:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 135us (213us total) trans 17179869442 rc 0/0 00000100:00100000:0.0:1762166855.448844:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1762166855.448861:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451960064:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166855.448922:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934713 00010000:00010000:2.0:1762166855.448945:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9daee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.448959:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9daee lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.448967:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9daee lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.448974:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.448978:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9daee lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.448986:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9daee lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.449000:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x23:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:2.0:1762166855.449003:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166855.449007:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9daee lrc: 2/0,0 mode: --/EX res: [0x200000404:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.449013:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9daee lrc: 0/0,0 mode: --/EX res: [0x200000404:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.449032:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dae7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.449038:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dae7 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.449044:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dae7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.449049:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.449051:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dae7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.449069:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dae7 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.449077:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:2.0:1762166855.449080:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166855.449083:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dae7 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.449088:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dae7 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.449099:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:2.0:1762166855.449102:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166855.449109:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9da85 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91275 expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166855.449194:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342febc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49141:x1847765444396416:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 7368us (7558us total) trans 8589934714 rc 0/0 00000100:00100000:2.0:1762166855.449203:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 43 00000020:00080000:2.0:1762166855.449207:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166855.450374:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.450442:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444397184 00000100:00100000:1.0:1762166855.450449:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444397184 00000100:00100000:1.0:1762166855.450494:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 143 00000100:00100000:1.0:1762166855.450503:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49141:x1847765444397184:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.450521:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.450540:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9daf5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f912ad expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.450586:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9daf5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912ad expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.450597:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9daf5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912ad expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.450627:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3a00) 00010000:00010000:1.0:1762166855.450630:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166855.450633:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d200, rc 0) 00000100:00100000:1.0:1762166855.450676:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49141:x1847765444397184:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 174us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.450682:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 143 00000100:00100000:3.0:1762166855.452077:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.452345:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444397440 00000100:00100000:2.0:1762166855.452353:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444397440 00000100:00100000:2.0:1762166855.452398:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 45 00000100:00100000:2.0:1762166855.452407:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49141:x1847765444397440:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166855.452610:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49141:x1847765444397440:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 203us (550us total) trans 8589934715 rc 0/0 00000100:00100000:2.0:1762166855.452620:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 45 00000100:00100000:3.0:1762166855.453576:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.453617:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444397696 00000100:00100000:2.0:1762166855.453635:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444397696 00000100:00100000:2.0:1762166855.453674:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 46 00000100:00100000:2.0:1762166855.453683:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49141:x1847765444397696:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762166855.453939:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x23:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1762166855.454016:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dafc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.454027:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dafc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.454034:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dafc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.454039:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dafc lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.454044:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dafc lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.454047:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dafc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.454066:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166855.454101:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166855.454108:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dafc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.454114:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166855.454119:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dafc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.454127:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dafc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.454139:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x23:0x0].0x0 (ffff9ee360714500) 00010000:00010000:1.0:1762166855.454142:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:2.0:1762166855.454148:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49141:x1847765444397696:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 465us (573us total) trans 8589934716 rc 0/0 00010000:00010000:1.0:1762166855.454148:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dafc lrc: 1/0,0 mode: --/PW res: [0x200000404:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.454162:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dafc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166855.454167:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 46 00010000:00010000:1.0:1762166855.454190:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166855.454193:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166855.454195:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166855.462332:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.462400:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444397824 00000100:00100000:1.0:1762166855.462411:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444397824 00000100:00100000:1.0:1762166855.462497:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 144 00000100:00100000:1.0:1762166855.462513:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49143:x1847765444397824:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:1.0:1762166855.462537:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.462556:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9db03 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f912b4 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.462619:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db0a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.462635:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db0a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.462645:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db0a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.462658:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db11 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.462664:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db11 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.462670:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db11 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.462818:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9db18 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.462827:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9db18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.462835:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9db18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.462867:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166855.462877:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166855.462899:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9db18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.462911:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9db18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.462919:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db0a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.462925:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db0a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.462932:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db0a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.462938:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.462942:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db0a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.462949:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db0a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.462960:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166855.462963:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.462968:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db0a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.462974:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db0a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.462985:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db11 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.462991:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db11 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.463004:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db11 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.463009:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.463012:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db11 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.463018:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db11 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.463026:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3800) 00010000:00010000:1.0:1762166855.463029:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.463032:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db11 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.463038:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db11 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.463067:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9db03 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912b4 expref: 32 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.463080:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9db18 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912b4 expref: 31 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.463087:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3a00) 00010000:00010000:1.0:1762166855.463089:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166855.463092:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c000, rc 0) 00000100:00100000:1.0:1762166855.463155:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49143:x1847765444397824:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 648us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.463163:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 144 00000100:00100000:3.0:1762166855.476234:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.476329:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444397952 00000100:00100000:1.0:1762166855.476339:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444397952 00000100:00100000:1.0:1762166855.476396:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 145 00000100:00100000:1.0:1762166855.476407:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49147:x1847765444397952:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:1.0:1762166855.476503:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9db1f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476518:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9db1f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476529:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9db1f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476542:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db26 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476548:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db26 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476553:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db26 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476652:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db2d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476659:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476666:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.476693:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166855.476697:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166855.476708:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476727:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9db1f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476733:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9db1f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476739:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9db1f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476744:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7c800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.476748:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9db1f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476754:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9db1f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476806:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166855.476810:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.476815:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9db1f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476822:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9db1f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476836:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db26 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476841:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db26 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476846:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db26 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476851:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.476860:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db26 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476865:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db26 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476872:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3800) 00010000:00010000:1.0:1762166855.476874:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.476876:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db26 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476881:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db26 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476894:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476900:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db2d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476905:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db2d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476909:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.476911:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db2d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476916:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db2d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476921:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3a00) 00010000:00010000:1.0:1762166855.476923:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.476925:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db2d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.476939:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db2d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.477007:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49147:x1847765444397952:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 602us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.477015:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 145 00000100:00100000:3.0:1762166855.487453:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.487540:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444398208 00000100:00100000:1.0:1762166855.487558:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444398208 00000100:00100000:1.0:1762166855.487643:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 146 00000100:00100000:1.0:1762166855.487656:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49149:x1847765444398208:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.487686:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.487712:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db34 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f912bb expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.487867:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db3b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.487884:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db3b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.487897:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db3b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.487910:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166855.488071:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db34 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912bb expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.488092:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db3b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912bb expref: 33 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.488124:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3a00) 00010000:00010000:1.0:1762166855.488127:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166855.488131:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7da00, rc 0) 00000100:00100000:1.0:1762166855.488205:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49149:x1847765444398208:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 552us (900us total) trans 8589934717 rc 0/0 00000100:00100000:1.0:1762166855.488211:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 146 00000100:00100000:0.0:1762166855.490633:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.490694:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444398464 00000100:00100000:1.0:1762166855.490708:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444398464 00000100:00100000:1.0:1762166855.490801:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 147 00000100:00100000:1.0:1762166855.490815:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49149:x1847765444398464:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.490841:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.490861:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9db49 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f912c2 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.490963:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9db50 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.490979:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9db18 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912b4 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.490987:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9db50 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.491027:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9db18 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912b4 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.491043:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9db18 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912b4 expref: 34 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.491081:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451960192:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.491185:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3504606c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166855.492516:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451960192:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.492551:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9db50 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166855.492733:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.492815:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444398592 00000100:00100000:1.0:1762166855.492821:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444398592 00010000:00010000:1.0:1762166855.492849:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9db18 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912b4 expref: 35 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.492880:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 650 00000100:00100000:1.0:1762166855.492887:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444398592:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.492900:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.492907:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9db18 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912b4 expref: 35 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.492918:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9db18 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912b4 expref: 35 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.492938:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9db18 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912b4 expref: 35 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.492953:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3a00) 00010000:00010000:1.0:1762166855.492958:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9db50 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.492982:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9db50 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.492989:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9db50 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.493018:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166855.493070:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765444398592:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 183us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.493078:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 650 00010000:00010000:0.0:1762166855.493122:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9db50 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.493129:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9db50 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762166855.493154:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166855.493292:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9db49 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912c2 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.493306:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9db50 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912c2 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.493311:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3a00) 00010000:00010000:0.0:1762166855.493313:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166855.493315:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d800, rc 0) 00000100:00100000:0.0:1762166855.493343:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49149:x1847765444398464:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2533us (2720us total) trans 8589934718 rc 0/0 00000100:00100000:0.0:1762166855.493350:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 147 00000100:00100000:0.0:1762166855.494709:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.494796:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444398720 00000100:00100000:2.0:1762166855.494803:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444398720 00000100:00100000:2.0:1762166855.494851:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 47 00000100:00100000:2.0:1762166855.494861:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49149:x1847765444398720:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:2.0:1762166855.494969:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49149:x1847765444398720:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 109us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.494986:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 47 00000100:00100000:3.0:1762166855.496159:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.496204:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444398976 00000100:00100000:2.0:1762166855.496210:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444398976 00000100:00100000:2.0:1762166855.496246:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 48 00000100:00100000:2.0:1762166855.496255:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49149:x1847765444398976:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166855.496408:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49149:x1847765444398976:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 151us (249us total) trans 8589934719 rc 0/0 00000100:00100000:2.0:1762166855.496415:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 48 00000100:00100000:3.0:1762166855.497362:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.497397:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444399232 00000100:00100000:0.0:1762166855.497402:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444399232 00000100:00100000:0.0:1762166855.497441:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 148 00000100:00100000:0.0:1762166855.497450:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49149:x1847765444399232:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.497463:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.497466:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166855.497488:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9db50 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912c2 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.497508:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9db3b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912bb expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.497518:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3a00) 00010000:00010000:0.0:1762166855.497530:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166855.497540:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9db5e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f912c9 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.497595:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9db65 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.497603:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9db65 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.497609:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9db65 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762166855.497617:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166855.497694:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9db5e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912c9 expref: 36 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.497707:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9db65 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912c9 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.497713:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3a00) 00010000:00010000:0.0:1762166855.497716:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166855.497719:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198200, rc 0) 00000100:00100000:0.0:1762166855.497755:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49149:x1847765444399232:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 306us (395us total) trans 8589934720 rc 0/0 00000100:00100000:0.0:1762166855.497798:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 148 00000100:00100000:0.0:1762166855.498958:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.499022:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444399488 00000100:00100000:2.0:1762166855.499030:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444399488 00000100:00100000:2.0:1762166855.499074:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 49 00000100:00100000:2.0:1762166855.499083:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342feac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49149:x1847765444399488:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166855.499136:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9db65 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912c9 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.499165:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9db73 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.499177:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9daf5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912ad expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.499186:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9db73 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.499218:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9daf5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912ad expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.499230:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9daf5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912ad expref: 35 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.499253:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451960320:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.499336:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.500229:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451960320:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.500248:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9db73 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166855.500461:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.500515:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444399616 00000100:00100000:1.0:1762166855.500522:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444399616 00010000:00010000:1.0:1762166855.500547:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9daf5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912ad expref: 36 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.500580:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 651 00000100:00100000:1.0:1762166855.500589:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765444399616:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.500603:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.500609:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9daf5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912ad expref: 36 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.500620:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9daf5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912ad expref: 36 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.500636:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9daf5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912ad expref: 36 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.500652:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3a00) 00010000:00010000:1.0:1762166855.500665:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9db73 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.500673:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9db73 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.500679:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9db73 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.500704:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.500739:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9db73 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166855.500754:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444399616:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 163us (289us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166855.500755:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9db73 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166855.500792:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 651 00010000:00010000:2.0:1762166855.501033:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9db73 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.501041:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9db73 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.501048:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9db73 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.501054:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.501058:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9db73 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.501064:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9db73 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.501074:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3a00) 00010000:00010000:2.0:1762166855.501077:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166855.501087:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9db73 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.501093:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9db73 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.501104:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3a00) 00010000:00010000:2.0:1762166855.501107:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166855.501112:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9db65 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912c9 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166855.501232:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342feac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49149:x1847765444399488:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2150us (2277us total) trans 8589934721 rc -22/-22 00000100:00100000:2.0:1762166855.501240:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 49 00000100:00100000:0.0:1762166855.502098:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.502133:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444399744 00000100:00100000:1.0:1762166855.502138:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444399744 00000100:00100000:1.0:1762166855.502167:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 149 00000100:00100000:1.0:1762166855.502172:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49149:x1847765444399744:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.502187:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.502200:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db7a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f912d0 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.502231:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db7a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912d0 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.502242:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db7a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912d0 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.502259:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3800) 00010000:00010000:1.0:1762166855.502262:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166855.502265:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7de00, rc 0) 00000100:00100000:1.0:1762166855.502315:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49149:x1847765444399744:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 138us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.502322:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 149 00000100:00100000:0.0:1762166855.503972:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.504016:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444400000 00000100:00100000:1.0:1762166855.504025:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444400000 00000100:00100000:1.0:1762166855.504069:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 150 00000100:00100000:1.0:1762166855.504078:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49149:x1847765444400000:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.504092:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.504104:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9db81 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f912d7 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.504579:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9db88 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.504591:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9db88 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.504601:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9db88 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.504610:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x24:0x0]: returning size 0 00010000:00010000:1.0:1762166855.504652:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9db81 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912d7 expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.504670:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9db88 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912d7 expref: 37 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.504679:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x24:0x0].0x0 (ffff9ee34ada3400) 00010000:00010000:1.0:1762166855.504682:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166855.504685:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7ca00, rc 0) 00000100:00100000:1.0:1762166855.504753:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49149:x1847765444400000:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 675us (786us total) trans 8589934722 rc 0/0 00000100:00100000:1.0:1762166855.504789:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 150 00000100:00100000:3.0:1762166855.506178:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.506214:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444400256 00000100:00100000:1.0:1762166855.506220:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444400256 00000100:00100000:1.0:1762166855.506250:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 151 00000100:00100000:1.0:1762166855.506256:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49149:x1847765444400256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.506270:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.506279:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9db96 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f912de expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.506351:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9db9d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.506359:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9db9d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.506365:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9db9d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.506372:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166855.506446:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9db96 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912de expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.506462:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9db9d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912de expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.506469:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3800) 00010000:00010000:1.0:1762166855.506473:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166855.506475:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c400, rc 0) 00000100:00100000:1.0:1762166855.506516:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49149:x1847765444400256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 260us (343us total) trans 8589934723 rc 0/0 00000100:00100000:1.0:1762166855.506520:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 151 00000100:00100000:0.0:1762166855.507445:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.507504:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444400512 00000100:00100000:2.0:1762166855.507511:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444400512 00000100:00100000:2.0:1762166855.507550:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 50 00000100:00100000:2.0:1762166855.507559:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49149:x1847765444400512:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166855.507606:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9db9d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912de expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.507637:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dbab lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.507649:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db7a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912d0 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.507657:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dbab lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.507684:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db7a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912d0 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.507699:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db7a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912d0 expref: 39 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.507709:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451960448:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.507756:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9af00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.508944:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451960448:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.508965:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dbab lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166855.509314:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.509391:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444400640 00000100:00100000:1.0:1762166855.509401:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444400640 00010000:00010000:1.0:1762166855.509455:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db7a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912d0 expref: 40 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.509490:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 652 00000100:00100000:1.0:1762166855.509499:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2360:x1847765444400640:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.509515:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.509522:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db7a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912d0 expref: 40 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.509535:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db7a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912d0 expref: 40 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.509559:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9db7a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912d0 expref: 40 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.509579:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3800) 00010000:00010000:1.0:1762166855.509585:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dbab lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.509594:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dbab lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.509602:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dbab lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.509658:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.509701:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dbab lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.509713:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dbab lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166855.509727:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444400640:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 225us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.509741:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 652 00010000:00010000:2.0:1762166855.509742:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dbb2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.509795:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9db88 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912d7 expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.509804:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dbb2 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.509845:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9db88 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912d7 expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.509859:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9db88 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912d7 expref: 38 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.509894:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451960576:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.509968:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9af00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.511101:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451960576:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.511118:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dbb2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166855.511323:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.511373:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444400768 00000100:00100000:1.0:1762166855.511381:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444400768 00010000:00010000:1.0:1762166855.511414:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9db88 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912d7 expref: 39 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.511458:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 653 00000100:00100000:1.0:1762166855.511476:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444400768:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.511493:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.511498:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9db88 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912d7 expref: 39 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.511510:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9db88 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912d7 expref: 39 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.511528:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9db88 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912d7 expref: 39 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.511544:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x24:0x0].0x0 (ffff9ee34ada3400) 00010000:00010000:1.0:1762166855.511549:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dbb2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.511556:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dbb2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.511578:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dbb2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.511605:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.511646:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dbb2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x24:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166855.511653:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2361:x1847765444400768:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 185us (330us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166855.511659:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dbb2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x24:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166855.511666:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 653 00000100:00100000:2.0:1762166855.512214:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451960704:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166855.512270:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166855.512293:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.512327:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451960704 00000100:00100000:0.0:1762166855.512336:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451960704 00000100:00100000:0.0:1762166855.512391:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1762166855.512402:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:31351:x1847765451960704:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166855.512516:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:31351:x1847765451960704:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 116us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.512525:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1762166855.512564:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451960704:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166855.512616:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934724 00000001:00080000:2.0:1762166855.512682:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934725 00010000:00010000:2.0:1762166855.512707:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dbb2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x24:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.512717:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dbb2 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x24:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.512724:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dbb2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x24:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.512731:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.512747:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dbb2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x24:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.512755:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dbb2 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x24:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.512792:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x24:0x0].0x0 (ffff9ee34ada3400) 00010000:00010000:2.0:1762166855.512797:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166855.512801:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dbb2 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x24:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.512809:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dbb2 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x24:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.512830:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dbab lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.512837:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dbab lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.512843:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dbab lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.512849:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.512852:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dbab lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.512858:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dbab lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.512866:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3800) 00010000:00010000:2.0:1762166855.512868:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166855.512871:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dbab lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.512887:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dbab lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.512900:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3800) 00010000:00010000:2.0:1762166855.512903:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166855.512909:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9db9d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912de expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166855.513011:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49149:x1847765444400512:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 5449us (5577us total) trans 8589934726 rc 0/0 00000100:00100000:2.0:1762166855.513022:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 50 00000020:00080000:2.0:1762166855.513028:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166855.514063:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.514127:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444400896 00000100:00100000:1.0:1762166855.514134:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444400896 00000100:00100000:1.0:1762166855.514178:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 152 00000100:00100000:1.0:1762166855.514187:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49149:x1847765444400896:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.514205:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.514225:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dbb9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f912e5 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.514277:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dbb9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912e5 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.514291:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dbb9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912e5 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.514308:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166855.514312:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166855.514315:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d200, rc 0) 00000100:00100000:1.0:1762166855.514361:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49149:x1847765444400896:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 174us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.514368:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 152 00000100:00100000:0.0:1762166855.515738:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.515815:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444401152 00000100:00100000:2.0:1762166855.515822:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444401152 00000100:00100000:2.0:1762166855.515863:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 51 00000100:00100000:2.0:1762166855.515872:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49149:x1847765444401152:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762166855.516261:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x24:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166855.516358:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].12, 64 off9152 00000001:00080000:2.0:1762166855.516367:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934727 00010000:00010000:2.0:1762166855.516410:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dbc0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.516424:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dbc0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.516448:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dbc0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.516456:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dbc0 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.516472:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dbc0 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.516478:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dbc0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.516499:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166855.516534:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166855.516543:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dbc0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.516551:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166855.516554:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dbc0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.516560:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dbc0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.516570:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x24:0x0].0x0 (ffff9ee360714f00) 00010000:00010000:1.0:1762166855.516573:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166855.516575:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dbc0 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.516579:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dbc0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.516593:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166855.516594:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166855.516595:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166855.516604:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49149:x1847765444401152:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 732us (868us total) trans 8589934728 rc 0/0 00000100:00100000:2.0:1762166855.516614:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 51 00000020:00080000:2.0:1762166855.516619:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166855.517581:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.517620:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444401408 00000100:00100000:2.0:1762166855.517630:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444401408 00000100:00100000:2.0:1762166855.517670:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 52 00000100:00100000:2.0:1762166855.517679:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49149:x1847765444401408:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166855.517885:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49149:x1847765444401408:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 206us (305us total) trans 8589934729 rc 0/0 00000100:00100000:2.0:1762166855.517892:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 52 00000100:00100000:3.0:1762166855.525690:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.525809:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444401536 00000100:00100000:1.0:1762166855.525834:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444401536 00000100:00100000:1.0:1762166855.525922:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 153 00000100:00100000:1.0:1762166855.525937:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49151:x1847765444401536:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:1.0:1762166855.525970:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.526016:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dbc7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f912ec expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.526108:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbce lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526156:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbce lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526171:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbce lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526188:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbd5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526195:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526202:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526336:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dbdc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526345:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dbdc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526353:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dbdc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.526392:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166855.526398:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166855.526419:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dbdc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526443:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dbdc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526454:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbce lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526470:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbce lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526478:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526484:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.526489:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526498:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbce lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526514:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166855.526517:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.526523:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbce lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526530:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbce lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526557:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526563:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbd5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526573:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbd5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526578:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.526581:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbd5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526595:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbd5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526604:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3900) 00010000:00010000:1.0:1762166855.526607:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.526610:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbd5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526616:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbd5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.526651:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dbc7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912ec expref: 45 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.526664:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dbdc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912ec expref: 44 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.526672:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166855.526675:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166855.526677:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d600, rc 0) 00000100:00100000:1.0:1762166855.526825:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49151:x1847765444401536:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 891us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.526834:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 153 00000100:00100000:0.0:1762166855.528661:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.528712:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444401664 00000100:00100000:1.0:1762166855.528722:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444401664 00000100:00100000:1.0:1762166855.528814:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1053 00000100:00100000:1.0:1762166855.528827:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444401664:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:1.0:1762166855.528846:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.528882:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9dbe3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f912f3 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.528911:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.528913:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.528923:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9dbe3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912f3 expref: 12 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.528941:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9dbe3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912f3 expref: 12 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.528956:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c000, rc 0) 00000100:00100000:1.0:1762166855.529030:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444401664:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 206us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.529042:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1053 00000100:00100000:0.0:1762166855.542502:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.542646:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444401792 00000100:00100000:1.0:1762166855.542664:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444401792 00000100:00100000:1.0:1762166855.542752:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 154 00000100:00100000:1.0:1762166855.542820:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49155:x1847765444401792:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:1.0:1762166855.542927:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dbea lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.542950:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dbea lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.542965:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dbea lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.542982:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbf1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543009:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbf1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543016:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbf1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543168:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbf8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543177:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543184:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.543233:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166855.543251:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166855.543266:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543281:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dbea lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543288:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dbea lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543295:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dbea lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543302:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.543306:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dbea lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543314:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dbea lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543335:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166855.543339:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.543345:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dbea lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543353:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dbea lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543368:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbf1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543374:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbf1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543379:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbf1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543385:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.543388:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbf1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543394:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbf1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543401:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3900) 00010000:00010000:1.0:1762166855.543404:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.543407:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbf1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543412:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dbf1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543429:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543451:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbf8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543457:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543462:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166855.543465:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543472:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbf8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543480:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166855.543482:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166855.543486:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbf8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.543491:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbf8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.543600:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49155:x1847765444401792:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 835us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.543611:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 154 00000100:00100000:3.0:1762166855.553846:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.553967:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444402048 00000100:00100000:1.0:1762166855.553985:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444402048 00000100:00100000:1.0:1762166855.554082:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 155 00000100:00100000:1.0:1762166855.554095:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49157:x1847765444402048:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.554125:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.554153:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f912fa expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.554302:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dc06 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.554320:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dc06 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.554333:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dc06 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.554346:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166855.554533:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dbff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912fa expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.554555:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dc06 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912fa expref: 46 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.554564:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166855.554567:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166855.554571:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c600, rc 0) 00000100:00100000:1.0:1762166855.554658:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49157:x1847765444402048:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 565us (821us total) trans 8589934730 rc 0/0 00000100:00100000:1.0:1762166855.554666:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 155 00000100:00100000:0.0:1762166855.556678:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.556742:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444402176 00000100:00100000:1.0:1762166855.556753:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444402176 00000100:00100000:1.0:1762166855.556832:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1054 00000100:00100000:1.0:1762166855.556843:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444402176:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.556863:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.556881:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dc14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91301 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.556919:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.556921:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.556927:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dc14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91301 expref: 13 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.556941:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dc14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91301 expref: 13 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.556951:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7ca00, rc 0) 00000100:00100000:1.0:1762166855.557006:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765444402176:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 164us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.557013:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1054 00000100:00100000:0.0:1762166855.558491:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.558533:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444402432 00000100:00100000:1.0:1762166855.558541:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444402432 00000100:00100000:1.0:1762166855.558589:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 156 00000100:00100000:1.0:1762166855.558598:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49157:x1847765444402432:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.558615:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.558631:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dc1b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91308 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.558722:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dc22 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.558739:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dbdc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912ec expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.558747:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dc22 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.558813:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dbdc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912ec expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.558827:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dbdc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912ec expref: 47 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.558838:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451960832:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.558909:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350460180 going to sleep for 11 seconds 00000100:00100000:1.0:1762166855.559730:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451960832:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.559748:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dc22 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166855.560067:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.560123:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444402560 00000100:00100000:1.0:1762166855.560128:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444402560 00010000:00010000:1.0:1762166855.560151:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dbdc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912ec expref: 48 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.560177:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 654 00000100:00100000:1.0:1762166855.560186:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2361:x1847765444402560:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.560197:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.560204:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dbdc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912ec expref: 48 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.560214:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dbdc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912ec expref: 48 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.560233:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dbdc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912ec expref: 48 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.560264:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166855.560269:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dc22 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.560278:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dc22 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.560285:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dc22 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.560312:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166855.560344:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dc22 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.560351:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dc22 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.560360:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:2361:x1847765444402560:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 174us (292us total) trans 0 rc 0/0 00000004:00200000:0.0:1762166855.560363:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000100:00100000:1.0:1762166855.560372:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 654 00010000:00010000:0.0:1762166855.560490:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dc1b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91308 expref: 48 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.560500:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dc22 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91308 expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.560507:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:0.0:1762166855.560516:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166855.560519:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d000, rc 0) 00000100:00100000:0.0:1762166855.560553:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49157:x1847765444402432:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1956us (2066us total) trans 8589934731 rc 0/0 00000100:00100000:0.0:1762166855.560560:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 156 00000100:00100000:0.0:1762166855.561881:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.561920:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444402816 00000100:00100000:1.0:1762166855.561928:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444402816 00000100:00100000:1.0:1762166855.561964:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 157 00000100:00100000:1.0:1762166855.561974:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49157:x1847765444402816:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.561991:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.562003:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dc30 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9130f expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.562405:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc37 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.562416:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc37 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.562442:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc37 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166855.562461:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x25:0x0]: returning size 0 00010000:00010000:1.0:1762166855.562510:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dc30 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9130f expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.562525:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc37 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9130f expref: 49 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.562533:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x25:0x0].0x0 (ffff9ee34ada3900) 00010000:00010000:1.0:1762166855.562535:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166855.562538:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c200, rc 0) 00000100:00100000:1.0:1762166855.562592:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49157:x1847765444402816:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 620us (715us total) trans 8589934732 rc 0/0 00000100:00100000:1.0:1762166855.562599:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 157 00000100:00100000:3.0:1762166855.564124:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.564176:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444403072 00000100:00100000:1.0:1762166855.564184:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444403072 00000100:00100000:1.0:1762166855.564228:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 158 00000100:00100000:1.0:1762166855.564238:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49157:x1847765444403072:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.564256:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.564269:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9dc45 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91316 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.564331:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9dc4c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.564342:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc37 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9130f expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.564350:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9dc4c lrc: 4/0,1 mode: --/EX res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.564388:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc37 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9130f expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.564401:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc37 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9130f expref: 50 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.564414:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451960960:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.564503:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350460240 going to sleep for 11 seconds 00000100:00100000:1.0:1762166855.565482:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451960960:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.565518:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9dc4c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166855.565694:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.565754:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444403200 00000100:00100000:1.0:1762166855.565787:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444403200 00010000:00010000:1.0:1762166855.565831:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc37 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9130f expref: 51 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.565879:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 655 00000100:00100000:1.0:1762166855.565889:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2360:x1847765444403200:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.565906:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.565914:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc37 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9130f expref: 51 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.565927:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc37 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9130f expref: 51 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.565950:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc37 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9130f expref: 51 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.565984:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x25:0x0].0x0 (ffff9ee34ada3900) 00010000:00010000:1.0:1762166855.565989:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9dc4c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.565998:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9dc4c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.566006:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9dc4c lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.566039:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166855.566076:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9dc4c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.566086:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9dc4c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762166855.566107:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x25:0x0]: returning size 0 00000100:00100000:1.0:1762166855.566125:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2360:x1847765444403200:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 236us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.566134:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 655 00000004:00080000:0.0:1762166855.566533:0:30818:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x86:0x0], index 0: 0 00010000:00010000:0.0:1762166855.566704:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9dc4c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.566714:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9dc4c lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.566721:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9dc4c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.566729:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166855.566733:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9dc4c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.566743:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9dc4c lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.566755:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x25:0x0].0x0 (ffff9ee34ada3900) 00010000:00010000:0.0:1762166855.566758:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166855.566802:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9dc4c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.566810:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9dc4c lrc: 0/0,0 mode: --/EX res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.566873:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9dc45 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91316 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.566883:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166855.566886:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166855.566890:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9dc45 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91316 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.566900:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d400, rc 0) 00000100:00100000:0.0:1762166855.566949:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49157:x1847765444403072:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2713us (2831us total) trans 8589934733 rc 301/301 00000100:00100000:0.0:1762166855.566956:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 158 00000100:00100000:3.0:1762166855.568164:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.568231:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444403456 00000100:00100000:2.0:1762166855.568241:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444403456 00000100:00100000:2.0:1762166855.568288:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 53 00000100:00100000:2.0:1762166855.568298:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49157:x1847765444403456:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166855.568644:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49157:x1847765444403456:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 347us (485us total) trans 8589934734 rc 0/0 00000100:00100000:2.0:1762166855.568653:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 53 00000100:00100000:2.0:1762166855.569943:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.569998:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444403584 00000100:00100000:0.0:1762166855.570007:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444403584 00000100:00100000:0.0:1762166855.570070:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 159 00000100:00100000:0.0:1762166855.570080:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49157:x1847765444403584:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.570106:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.570125:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9dc5a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9131d expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.570213:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9dc61 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.570231:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dc22 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91308 expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.570266:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9dc61 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.570310:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dc22 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91308 expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.570324:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dc22 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91308 expref: 51 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166855.570340:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e07b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451961088:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166855.570424:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36cb75d80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166855.571504:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e07b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451961088:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.571535:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9dc61 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166855.571645:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.571697:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444403712 00000100:00100000:1.0:1762166855.571706:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444403712 00010000:00010000:1.0:1762166855.571740:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dc22 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91308 expref: 52 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.571818:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 656 00000100:00100000:1.0:1762166855.571830:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2361:x1847765444403712:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.571845:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.571852:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dc22 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91308 expref: 52 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.571882:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dc22 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91308 expref: 52 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.571904:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dc22 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91308 expref: 52 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.571919:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166855.571924:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9dc61 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.571931:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9dc61 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.571938:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9dc61 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166855.571965:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166855.571987:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9dc61 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.571997:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9dc61 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.572033:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444403712:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 205us (389us total) trans 0 rc 0/0 00000004:00200000:0.0:1762166855.572035:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166855.572041:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1762166855.572047:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 656 00000004:00010000:0.0:1762166855.572061:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9dc61 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.572094:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9dc5a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9131d expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.572111:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9dc61 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9131d expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.572130:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:0.0:1762166855.572140:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166855.572144:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199800, rc 0) 00000100:00100000:0.0:1762166855.572180:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49157:x1847765444403584:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2102us (2242us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.572187:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 159 00000100:00100000:2.0:1762166855.573538:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.573600:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444403840 00000100:00100000:1.0:1762166855.573611:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444403840 00000100:00100000:1.0:1762166855.573661:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1055 00000100:00100000:1.0:1762166855.573671:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2358:x1847765444403840:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.573687:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.573703:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dc68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91324 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.573725:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.573738:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.573746:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dc68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91324 expref: 14 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.573802:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dc68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91324 expref: 14 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.573815:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d600, rc 0) 00000100:00100000:1.0:1762166855.573870:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2358:x1847765444403840:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 201us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.573877:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1055 00000100:00100000:2.0:1762166855.575046:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.575091:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444403968 00000100:00100000:0.0:1762166855.575096:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444403968 00000100:00100000:0.0:1762166855.575124:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 160 00000100:00100000:0.0:1762166855.575130:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49157:x1847765444403968:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.575139:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.575153:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9dc6f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9132b expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.575220:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9dc76 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.575232:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9dc76 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.575241:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9dc76 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762166855.575270:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x25:0x0]: returning size 0 00000004:00200000:0.0:1762166855.575274:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166855.575287:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9dc76 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.575309:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9dc6f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9132b expref: 52 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.575319:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9dc76 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9132b expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.575330:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x25:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166855.575332:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762166855.575334:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198a00, rc 0) 00000100:00100000:0.0:1762166855.575367:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49157:x1847765444403968:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 238us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.575371:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 160 00000100:00100000:3.0:1762166855.576420:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.576485:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444404096 00000100:00100000:1.0:1762166855.576492:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444404096 00000100:00100000:1.0:1762166855.576536:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1056 00000100:00100000:1.0:1762166855.576553:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765444404096:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.576567:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.576585:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9dc7d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91332 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166855.576606:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166855.576620:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.576622:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.576629:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9dc7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91332 expref: 22 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.576642:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9dc7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91332 expref: 22 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.576666:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7da00, rc 0) 00000100:00100000:1.0:1762166855.576705:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765444404096:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 153us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.576711:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1056 00000100:00100000:2.0:1762166855.577820:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.577866:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444404352 00000100:00100000:0.0:1762166855.577872:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444404352 00000100:00100000:0.0:1762166855.577905:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 161 00000100:00100000:0.0:1762166855.577911:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49157:x1847765444404352:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.577922:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.577934:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9dc84 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91339 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.577997:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dc8b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.578008:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dc8b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.578023:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dc8b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762166855.578036:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166855.578151:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9dc84 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91339 expref: 54 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.578162:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dc8b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91339 expref: 53 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.578178:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:0.0:1762166855.578181:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166855.578183:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199c00, rc 0) 00000100:00100000:0.0:1762166855.578232:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49157:x1847765444404352:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 320us (417us total) trans 8589934735 rc 0/0 00000100:00100000:0.0:1762166855.578238:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 161 00000100:00100000:2.0:1762166855.579302:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.579342:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444404480 00000100:00100000:1.0:1762166855.579348:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444404480 00000100:00100000:1.0:1762166855.579387:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1057 00000100:00100000:1.0:1762166855.579395:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765444404480:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.579405:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.579417:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91340 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.579444:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.579447:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.579453:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91340 expref: 15 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.579466:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91340 expref: 15 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.579476:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c200, rc 0) 00000100:00100000:1.0:1762166855.579516:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444404480:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 121us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.579523:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1057 00000100:00100000:3.0:1762166855.580596:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.580633:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444404608 00000100:00100000:1.0:1762166855.580650:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444404608 00000100:00100000:1.0:1762166855.580683:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1058 00000100:00100000:1.0:1762166855.580692:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765444404608:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.580702:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.580711:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dca0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91347 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.580735:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.580737:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.580742:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dca0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91347 expref: 16 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.580754:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dca0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91347 expref: 16 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.580784:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7de00, rc 0) 00000100:00100000:1.0:1762166855.580811:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444404608:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 122us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.580816:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1058 00000100:00100000:2.0:1762166855.581654:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.581683:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444404736 00000100:00100000:1.0:1762166855.581687:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444404736 00000100:00100000:1.0:1762166855.581708:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1059 00000100:00100000:1.0:1762166855.581712:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444404736:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762166855.581731:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dca7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.581738:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.581739:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.581745:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dca7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.581753:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dca7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.581799:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dca7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.581805:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dca7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.581810:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dca7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.581814:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7d800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166855.581817:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dca7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.581823:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dca7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.581832:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dca7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.581837:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dca7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166855.581874:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444404736:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 161us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.581882:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1059 00000100:00100000:2.0:1762166855.582993:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.583026:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444404864 00000100:00100000:1.0:1762166855.583031:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444404864 00000100:00100000:1.0:1762166855.583067:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1060 00000100:00100000:1.0:1762166855.583076:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765444404864:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.583086:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.583097:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dcae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9134e expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.583112:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.583114:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.583119:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dcae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9134e expref: 17 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.583131:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dcae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9134e expref: 17 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.583146:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c800, rc 0) 00000100:00100000:1.0:1762166855.583184:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765444404864:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 109us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.583191:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1060 00000100:00100000:3.0:1762166855.608303:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.608398:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444404992 00000100:00100000:1.0:1762166855.608417:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444404992 00000100:00100000:1.0:1762166855.608520:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1061 00000100:00100000:1.0:1762166855.608532:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444404992:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.608559:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.608608:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dcb5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91355 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.608642:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.608645:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.608655:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dcb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91355 expref: 18 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.608677:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dcb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91355 expref: 18 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.608692:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d800, rc 0) 00000100:00100000:1.0:1762166855.608798:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765444404992:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 268us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.608806:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1061 00000100:00100000:2.0:1762166855.610491:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.610600:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444405120 00000100:00100000:1.0:1762166855.610611:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444405120 00000100:00100000:1.0:1762166855.610677:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1062 00000100:00100000:1.0:1762166855.610688:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:49157:x1847765444405120:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.610711:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.610730:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dcbc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9135c expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.610813:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.610816:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.610823:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dcbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9135c expref: 19 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.610840:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dcbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9135c expref: 19 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.610865:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d000, rc 0) 00000100:00100000:1.0:1762166855.610924:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:49157:x1847765444405120:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 237us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.610931:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1062 00000100:00100000:2.0:1762166855.613566:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.613629:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444405248 00000100:00100000:0.0:1762166855.613640:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444405248 00000100:00100000:0.0:1762166855.613695:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1063 00000100:00100000:0.0:1762166855.613705:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765444405248:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.613729:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.613753:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199400/0xf915a5bdf3c9dcc3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91363 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.613820:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166855.613822:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166855.613831:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199400/0xf915a5bdf3c9dcc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91363 expref: 20 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166855.613852:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199400/0xf915a5bdf3c9dcc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91363 expref: 20 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166855.613865:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199400, rc 0) 00000100:00100000:0.0:1762166855.613918:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444405248:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 214us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.613925:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1063 00000100:00100000:3.0:1762166855.615144:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.615234:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444405376 00000100:00100000:0.0:1762166855.615240:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444405376 00000100:00100000:0.0:1762166855.615275:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 162 00000100:00100000:0.0:1762166855.615283:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49157:x1847765444405376:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:2.0:1762166855.631543:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934735 is committed 00000020:00080000:2.0:1762166855.631592:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969113 batchid updated 00000020:00080000:1.0:1762166855.631642:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969113 00000020:00080000:2.0:1762166855.631651:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee350485c00 refcount 2 committed 0 result 0 batchid 4294969114 00000020:00080000:1.0:1762166855.631654:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969113 00000020:00080000:2.0:1762166855.631659:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee247a17400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee350485d80 00000020:00080000:2.0:1762166855.631664:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2478dc400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee2426ed400 00000020:00080000:1.0:1762166855.631690:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969114 committed batchid 4294969113 00000100:00100000:0.0:1762166855.631698:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49157:x1847765444405376:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 16409us (16550us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.631711:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 162 00000020:00080000:1.0:1762166855.631890:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969113 00000100:00100000:2.0:1762166855.633298:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.633374:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444405504 00000100:00100000:0.0:1762166855.633382:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444405504 00000100:00100000:0.0:1762166855.633441:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1064 00000100:00100000:0.0:1762166855.633450:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444405504:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:0.0:1762166855.633535:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444405504:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 85us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.633543:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1064 00000100:00100000:3.0:1762166855.641063:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.641172:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444405632 00000100:00100000:0.0:1762166855.641182:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444405632 00000100:00100000:0.0:1762166855.641241:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1065 00000100:00100000:0.0:1762166855.641251:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444405632:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762166855.641296:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198800/0xf915a5bdf3c9dcca lrc: 3/1,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.641310:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166855.641312:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166855.641317:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198800/0xf915a5bdf3c9dcca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.641330:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198800/0xf915a5bdf3c9dcca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.641374:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198800/0xf915a5bdf3c9dcca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.641382:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198800/0xf915a5bdf3c9dcca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.641390:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347198800/0xf915a5bdf3c9dcca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.641397:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166855.641401:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347198800/0xf915a5bdf3c9dcca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.641410:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347198800/0xf915a5bdf3c9dcca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.641425:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347198800/0xf915a5bdf3c9dcca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.641448:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198800/0xf915a5bdf3c9dcca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166855.641533:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444405632:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 283us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.641541:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1065 00000100:00100000:3.0:1762166855.642869:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.643096:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444405888 00000100:00100000:0.0:1762166855.643112:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444405888 00000100:00100000:0.0:1762166855.643163:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 163 00000100:00100000:0.0:1762166855.643173:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49157:x1847765444405888:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166855.643225:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166855.643248:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9dc76 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9132b expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.643269:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x25:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166855.643279:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166855.643308:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9dcd1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.643319:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9dcd1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166855.643327:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9dcd1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:0.0:1762166855.643497:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f7ba819c reply state 00000000549966d2 transno 8589934736 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9dcd1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166855.643506:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166855.643581:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49157:x1847765444405888:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 409us (716us total) trans 8589934736 rc 0/0 00000100:00100000:0.0:1762166855.643589:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 163 00010000:00010000:3.0:1762166855.644647:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9dcd1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.644661:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9dcd1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.644669:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9dcd1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.644675:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166855.644680:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9dcd1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.644688:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9dcd1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.644711:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x25:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:3.0:1762166855.644714:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166855.644719:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9dcd1 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166855.644724:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9dcd1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166855.644791:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.644830:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444406016 00000100:00100000:2.0:1762166855.644836:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444406016 00000100:00100000:2.0:1762166855.644878:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 164 00000100:00100000:2.0:1762166855.644888:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49157:x1847765444406016:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.644904:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.644918:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dcd8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9136a expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.644957:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dcd8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9136a expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.644969:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dcd8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9136a expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.644995:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x25:0x0].0x0 (ffff9ee360714f00) 00010000:00010000:2.0:1762166855.644998:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166855.645000:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2e00, rc 0) 00000100:00100000:2.0:1762166855.645037:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49157:x1847765444406016:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 151us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.645043:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 164 00000100:00100000:2.0:1762166855.646459:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.646519:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444406144 00000100:00100000:0.0:1762166855.646526:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444406144 00000100:00100000:0.0:1762166855.646571:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1066 00000100:00100000:0.0:1762166855.646580:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765444406144:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166855.646809:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x86:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166855.646824:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x86:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:0.0:1762166855.646827:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x86:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:0.0:1762166855.646829:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x86:0x0] updating lvb ctime from disk: 0 -> 1762166855 00002000:00010000:0.0:1762166855.646832:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x86:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166855.646889:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444406144:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 310us (434us total) trans 21474836772 rc 0/0 00000100:00100000:0.0:1762166855.646895:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1066 00000100:00100000:3.0:1762166855.648262:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.648322:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444406400 00000100:00100000:2.0:1762166855.648329:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444406400 00000100:00100000:2.0:1762166855.648374:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 165 00000100:00100000:2.0:1762166855.648383:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49157:x1847765444406400:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762166855.648428:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166855.648463:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9dc61 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9131d expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.648479:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:2.0:1762166855.648483:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.648517:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dcdf lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.648529:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dcdf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.648537:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dcdf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:2.0:1762166855.648812:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001c9ebf8c reply state 00000000f18bdaa2 transno 8589934737 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dcdf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166855.648834:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166855.648908:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49157:x1847765444406400:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 526us (651us total) trans 8589934737 rc 0/0 00000100:00100000:2.0:1762166855.648917:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 165 00010000:00010000:2.0:1762166855.650174:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dcdf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.650187:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dcdf lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.650194:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dcdf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.650201:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.650206:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dcdf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.650214:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dcdf lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.650229:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00000100:00100000:3.0:1762166855.650234:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166855.650243:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166855.650252:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dcdf lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.650259:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dcdf lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166855.650334:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444406528 00000100:00100000:0.0:1762166855.650340:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444406528 00000100:00100000:0.0:1762166855.650377:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1067 00000100:00100000:0.0:1762166855.650382:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444406528:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166855.650533:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166855.650537:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x85:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166855.650540:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x85:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166855.650542:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x85:0x0] updating lvb ctime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166855.650544:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x85:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166855.650593:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765444406528:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 209us (363us total) trans 17179869443 rc 0/0 00000100:00100000:0.0:1762166855.650602:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1067 00000100:00100000:1.0:1762166855.652275:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.652386:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444406784 00000100:00100000:2.0:1762166855.652392:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444406784 00000100:00100000:2.0:1762166855.652452:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 54 00000100:00100000:2.0:1762166855.652461:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342fe9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49157:x1847765444406784:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166855.652527:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dc8b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91339 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.652559:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dce6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.652571:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dbb9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912e5 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.652579:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dc06 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912fa expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.652587:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dce6 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.652619:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dc06 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912fa expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.652634:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dc06 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912fa expref: 27 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.652654:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f400700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451961216:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.652736:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dbb9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912e5 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.652745:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dbb9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912e5 expref: 27 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.652754:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f400380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451961344:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.652802:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166855.654289:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f400700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451961216:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.654395:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.654467:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444407040 00000100:00100000:0.0:1762166855.654475:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444407040 00000100:00100000:0.0:1762166855.654527:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 55 00000100:00100000:0.0:1762166855.654536:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:43348:x1847765444407040:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1762166855.654666:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f400380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451961344:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166855.654724:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dce6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166855.654743:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:43348:x1847765444407040:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 207us (355us total) trans 8589934738 rc 0/0 00000100:00100000:0.0:1762166855.654752:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 55 00000100:00100000:2.0:1762166855.654829:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.654877:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444407168 00000100:00100000:0.0:1762166855.654882:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444407168 00010000:00010000:0.0:1762166855.654904:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dbb9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912e5 expref: 29 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166855.654941:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 657 00000100:00100000:0.0:1762166855.654951:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765444407168:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166855.654961:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166855.654967:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dbb9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912e5 expref: 29 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.654978:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dbb9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912e5 expref: 29 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.654995:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dbb9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912e5 expref: 29 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.655010:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:0.0:1762166855.655015:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dce6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.655028:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dce6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.655034:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166855.655072:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444407168:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 123us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.655079:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 657 00000100:00100000:3.0:1762166855.655826:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.655860:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444407296 00000100:00100000:0.0:1762166855.655871:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444407296 00010000:00010000:0.0:1762166855.655889:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dc06 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912fa expref: 28 pid: 30818 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166855.655921:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 658 00000100:00100000:0.0:1762166855.655932:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444407296:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166855.655942:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166855.655947:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dc06 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912fa expref: 28 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.655958:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dc06 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912fa expref: 28 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.655972:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dc06 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912fa expref: 28 pid: 30818 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.655982:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:0.0:1762166855.655985:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dce6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.655991:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dce6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.655996:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dce6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.656016:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166855.656041:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444407296:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 109us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.656049:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 658 00010000:00010000:3.0:1762166855.656055:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dce6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.656065:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dce6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.656087:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9dced lrc: 3/0,1 mode: --/EX res: [0x200000404:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.656098:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dcd8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9136a expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.656105:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9dced lrc: 4/0,1 mode: --/EX res: [0x200000404:0x25:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.656141:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dcd8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9136a expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.656152:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dcd8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9136a expref: 26 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166855.656164:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451961472:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166855.656262:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.657235:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451961472:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.657267:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9dced lrc: 3/0,1 mode: --/EX res: [0x200000404:0x25:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166855.657462:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.657604:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444407424 00000100:00100000:0.0:1762166855.657611:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444407424 00010000:00010000:0.0:1762166855.657638:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dcd8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9136a expref: 27 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166855.657666:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 659 00000100:00100000:0.0:1762166855.657672:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444407424:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166855.657680:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166855.657683:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dcd8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9136a expref: 27 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.657691:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dcd8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9136a expref: 27 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.657707:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dcd8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9136a expref: 27 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.657721:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x25:0x0].0x0 (ffff9ee360714f00) 00010000:00010000:0.0:1762166855.657725:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9dced lrc: 3/0,1 mode: --/EX res: [0x200000404:0x25:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.657733:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9dced lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x25:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.657739:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9dced lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x25:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.657791:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9dced lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x25:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.657797:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166855.657800:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9dced lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166855.657831:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444407424:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 158us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.657852:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 659 00000100:00100000:3.0:1762166855.658224:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451961600:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166855.658265:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166855.658294:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3180 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.658311:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451961600 00000100:00100000:0.0:1762166855.658317:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451961600 00000100:00100000:0.0:1762166855.658355:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1762166855.658363:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:31351:x1847765451961600:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166855.658443:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:31351:x1847765451961600:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 69us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.658449:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1762166855.658475:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451961600:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166855.658514:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451961728:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166855.658537:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166855.658558:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3180 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.658566:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451961728 00000100:00100000:0.0:1762166855.658570:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451961728 00000100:00100000:0.0:1762166855.658598:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1762166855.658604:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:31351:x1847765451961728:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166855.658672:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:31351:x1847765451961728:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 68us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.658681:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1762166855.658692:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451961728:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166855.658850:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934739 00000100:00100000:3.0:1762166855.658892:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e2bc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451961856:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166855.658914:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166855.658937:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.658971:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451961856 00000100:00100000:0.0:1762166855.658976:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451961856 00000100:00100000:2.0:1762166855.659038:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1762166855.659047:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:31351:x1847765451961856:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166855.659171:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:31351:x1847765451961856:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 125us (255us total) trans 21474836773 rc 0/0 00000100:00100000:2.0:1762166855.659177:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1762166855.659248:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e2bc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451961856:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166855.659303:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934740 00010000:00010000:3.0:1762166855.659323:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9dced lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.659333:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9dced lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.659340:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9dced lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.659346:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166855.659350:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9dced lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.659357:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9dced lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.659368:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x25:0x0].0x0 (ffff9ee360714f00) 00010000:00010000:3.0:1762166855.659372:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166855.659375:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9dced lrc: 2/0,0 mode: --/EX res: [0x200000404:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.659382:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9dced lrc: 0/0,0 mode: --/EX res: [0x200000404:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.659401:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dce6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.659407:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dce6 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.659413:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dce6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.659427:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166855.659429:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dce6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.659446:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dce6 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.659452:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:3.0:1762166855.659454:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166855.659456:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dce6 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.659460:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dce6 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.659468:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:3.0:1762166855.659469:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166855.659473:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dc8b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91339 expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166855.659540:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342fe9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49157:x1847765444406784:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 7081us (7270us total) trans 8589934741 rc 0/0 00000100:00100000:3.0:1762166855.659548:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 54 00000020:00080000:3.0:1762166855.659552:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166855.660643:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.660744:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444407552 00000100:00100000:0.0:1762166855.660749:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444407552 00000100:00100000:0.0:1762166855.660824:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 166 00000100:00100000:0.0:1762166855.660832:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49157:x1847765444407552:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.660849:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.660865:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9dcf4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91371 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.660908:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9dcf4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91371 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.660934:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9dcf4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91371 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.660953:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166855.660956:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166855.660959:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198a00, rc 0) 00000100:00100000:0.0:1762166855.661000:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49157:x1847765444407552:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 169us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.661006:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 166 00000100:00100000:2.0:1762166855.662369:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.662409:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444407808 00000100:00100000:3.0:1762166855.662416:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444407808 00000100:00100000:3.0:1762166855.662479:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 56 00000100:00100000:3.0:1762166855.662489:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49157:x1847765444407808:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166855.662671:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49157:x1847765444407808:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 184us (305us total) trans 8589934742 rc 0/0 00000100:00100000:3.0:1762166855.662688:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 56 00000100:00100000:1.0:1762166855.663676:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.663723:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444408064 00000100:00100000:3.0:1762166855.663730:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444408064 00000100:00100000:3.0:1762166855.663799:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 57 00000100:00100000:3.0:1762166855.663810:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49157:x1847765444408064:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:3.0:1762166855.664028:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x25:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166855.664135:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9dcfb lrc: 3/0,1 mode: --/PW res: [0x200000404:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.664149:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9dcfb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.664158:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9dcfb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.664166:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9dcfb lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.664171:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9dcfb lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.664177:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9dcfb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.664199:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166855.664233:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166855.664240:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9dcfb lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.664248:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166855.664252:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9dcfb lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.664260:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9dcfb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.664273:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x25:0x0].0x0 (ffff9ee363960900) 00010000:00010000:2.0:1762166855.664276:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166855.664280:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9dcfb lrc: 1/0,0 mode: --/PW res: [0x200000404:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166855.664287:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49157:x1847765444408064:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 477us (612us total) trans 8589934743 rc 0/0 00000100:00100000:3.0:1762166855.664298:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 57 00010000:00010000:2.0:1762166855.664305:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9dcfb lrc: 0/0,0 mode: --/PW res: [0x200000404:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.664325:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166855.664327:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166855.664330:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166855.672526:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.672591:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444408192 00000100:00100000:0.0:1762166855.672602:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444408192 00000100:00100000:0.0:1762166855.672660:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 167 00000100:00100000:0.0:1762166855.672671:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49159:x1847765444408192:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166855.672696:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.672718:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9dd02 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91378 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.672832:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9dd09 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.672846:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9dd09 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.672857:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9dd09 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.672883:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9dd10 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.672907:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9dd10 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.672915:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9dd10 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673016:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dd17 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673025:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dd17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673032:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dd17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166855.673063:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166855.673067:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166855.673086:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dd17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673096:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dd17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673104:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9dd09 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673110:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9dd09 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673117:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9dd09 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673122:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166855.673125:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9dd09 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673140:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9dd09 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673152:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166855.673154:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166855.673159:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9dd09 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673164:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9dd09 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673175:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9dd10 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673181:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9dd10 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673186:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9dd10 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673191:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166855.673194:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9dd10 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673199:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9dd10 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673205:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166855.673207:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166855.673210:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9dd10 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673214:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9dd10 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.673253:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9dd02 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91378 expref: 32 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.673265:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dd17 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91378 expref: 31 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.673272:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166855.673274:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166855.673277:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199c00, rc 0) 00000100:00100000:0.0:1762166855.673329:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49159:x1847765444408192:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 660us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.673337:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 167 00000100:00100000:0.0:1762166855.687107:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.687249:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444408320 00000100:00100000:2.0:1762166855.687259:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444408320 00000100:00100000:2.0:1762166855.687340:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 168 00000100:00100000:2.0:1762166855.687351:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e07a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49163:x1847765444408320:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166855.687424:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dd1e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687466:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dd1e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687478:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dd1e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687493:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dd25 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687500:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dd25 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687507:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dd25 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687608:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dd2c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687632:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dd2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687639:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dd2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.687669:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166855.687673:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166855.687683:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dd2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687695:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dd1e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687701:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dd1e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687708:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dd1e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687713:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.687722:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dd1e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687729:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dd1e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687740:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166855.687743:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166855.687747:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dd1e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687752:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dd1e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687803:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dd25 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687810:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dd25 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687816:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dd25 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687821:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.687824:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dd25 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687831:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dd25 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687840:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee360714500) 00010000:00010000:2.0:1762166855.687843:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166855.687846:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dd25 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687850:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dd25 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687861:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dd2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687865:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dd2c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687870:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dd2c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687890:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.687893:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dd2c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687898:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dd2c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687906:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:2.0:1762166855.687908:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166855.687911:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dd2c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.687914:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dd2c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166855.687972:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e07a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49163:x1847765444408320:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 623us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.687977:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 168 00000100:00100000:1.0:1762166855.697605:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.697737:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444408576 00000100:00100000:2.0:1762166855.697749:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444408576 00000100:00100000:2.0:1762166855.697834:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 169 00000100:00100000:2.0:1762166855.697846:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49165:x1847765444408576:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.697867:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.697887:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dd33 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9137f expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.697990:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dd3a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.698007:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dd3a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.698030:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dd3a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.698042:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166855.698167:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9dd33 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9137f expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.698185:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dd3a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9137f expref: 33 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.698192:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:2.0:1762166855.698193:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166855.698196:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2400, rc 0) 00000100:00100000:2.0:1762166855.698257:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49165:x1847765444408576:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 410us (662us total) trans 8589934744 rc 0/0 00000100:00100000:2.0:1762166855.698264:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 169 00000100:00100000:3.0:1762166855.700466:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.700533:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444408832 00000100:00100000:2.0:1762166855.700540:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444408832 00000100:00100000:2.0:1762166855.700584:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 170 00000100:00100000:2.0:1762166855.700590:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49165:x1847765444408832:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.700606:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.700619:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dd48 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91386 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.700683:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dd4f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.700693:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dd17 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91378 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.700709:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dd4f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.700735:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dd17 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91378 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.700744:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dd17 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91378 expref: 34 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.700754:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f401880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451961984:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.700860:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.702594:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f401880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451961984:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.702620:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dd4f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166855.702751:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.702888:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444408960 00000100:00100000:0.0:1762166855.702896:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444408960 00010000:00010000:0.0:1762166855.702932:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dd17 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91378 expref: 35 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166855.702972:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 660 00000100:00100000:0.0:1762166855.702981:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444408960:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166855.702995:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166855.703001:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dd17 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91378 expref: 35 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.703019:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dd17 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91378 expref: 35 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.703051:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9dd17 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91378 expref: 35 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.703066:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166855.703071:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dd4f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.703079:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dd4f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.703086:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dd4f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.703110:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.703129:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dd4f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.703138:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dd4f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.703155:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000100:00100000:0.0:1762166855.703156:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765444408960:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 175us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.703167:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 660 00010000:00010000:2.0:1762166855.703294:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9dd48 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91386 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.703310:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dd4f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91386 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.703318:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:2.0:1762166855.703329:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166855.703332:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3400, rc 0) 00000100:00100000:2.0:1762166855.703373:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49165:x1847765444408832:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2782us (2913us total) trans 8589934745 rc 0/0 00000100:00100000:2.0:1762166855.703380:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 170 00000100:00100000:3.0:1762166855.704424:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.704479:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444409088 00000100:00100000:2.0:1762166855.704485:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444409088 00000100:00100000:2.0:1762166855.704524:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 58 00000100:00100000:2.0:1762166855.704534:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49165:x1847765444409088:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:2.0:1762166855.704656:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49165:x1847765444409088:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 123us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.704663:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 58 00000100:00100000:0.0:1762166855.705574:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.705613:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444409344 00000100:00100000:2.0:1762166855.705620:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444409344 00000100:00100000:2.0:1762166855.705652:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 59 00000100:00100000:2.0:1762166855.705661:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49165:x1847765444409344:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166855.705828:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49165:x1847765444409344:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 168us (255us total) trans 8589934746 rc 0/0 00000100:00100000:2.0:1762166855.705836:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 59 00000100:00100000:3.0:1762166855.706862:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.706904:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444409600 00000100:00100000:2.0:1762166855.706910:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444409600 00000100:00100000:2.0:1762166855.706946:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 171 00000100:00100000:2.0:1762166855.706955:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49165:x1847765444409600:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.706972:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.706975:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762166855.706998:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9dd4f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91386 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.707031:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9dd3a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9137f expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.707040:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:2.0:1762166855.707044:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.707055:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dd5d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9138d expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.707122:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9dd64 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.707135:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9dd64 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.707143:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9dd64 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.707155:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166855.707232:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9dd5d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9138d expref: 36 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.707246:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9dd64 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9138d expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.707253:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:2.0:1762166855.707256:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166855.707259:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472800, rc 0) 00000100:00100000:2.0:1762166855.707300:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49165:x1847765444409600:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 347us (442us total) trans 8589934747 rc 0/0 00000100:00100000:2.0:1762166855.707321:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 171 00000100:00100000:3.0:1762166855.708647:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.708692:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444409856 00000100:00100000:2.0:1762166855.708701:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444409856 00000100:00100000:2.0:1762166855.708743:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 60 00000100:00100000:2.0:1762166855.708751:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342fe9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49165:x1847765444409856:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166855.708828:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9dd64 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9138d expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.708857:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9dd72 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.708869:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9dcf4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91371 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.708877:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9dd72 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.708908:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9dcf4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91371 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.708921:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9dcf4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91371 expref: 35 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.708935:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f401880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451962112:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.709009:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.710023:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f401880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451962112:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.710044:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9dd72 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166855.710612:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.710654:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444409984 00000100:00100000:0.0:1762166855.710661:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444409984 00010000:00010000:0.0:1762166855.710688:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9dcf4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91371 expref: 36 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166855.710720:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 661 00000100:00100000:0.0:1762166855.710729:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765444409984:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166855.710743:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166855.710749:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9dcf4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91371 expref: 36 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.710794:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9dcf4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91371 expref: 36 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.710810:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9dcf4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91371 expref: 36 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.710826:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166855.710830:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9dd72 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.710838:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9dd72 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.710844:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9dd72 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.710867:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.710890:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9dd72 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.710900:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9dd72 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166855.710910:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444409984:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 181us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.710918:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 661 00010000:00010000:2.0:1762166855.711135:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9dd72 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.711141:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9dd72 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.711145:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9dd72 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.711148:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.711151:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9dd72 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.711155:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9dd72 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.711161:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:2.0:1762166855.711163:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166855.711165:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9dd72 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.711168:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9dd72 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.711176:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:2.0:1762166855.711177:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166855.711185:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9dd64 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9138d expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166855.711283:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342fe9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49165:x1847765444409856:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2532us (2637us total) trans 8589934748 rc -22/-22 00000100:00100000:2.0:1762166855.711291:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 60 00000100:00100000:3.0:1762166855.712232:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.712392:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444410112 00000100:00100000:2.0:1762166855.712399:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444410112 00000100:00100000:2.0:1762166855.712459:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 172 00000100:00100000:2.0:1762166855.712469:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49165:x1847765444410112:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.712488:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.712511:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9dd79 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91394 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.712555:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9dd79 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91394 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.712567:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9dd79 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91394 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.712583:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714500) 00010000:00010000:2.0:1762166855.712587:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166855.712589:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473000, rc 0) 00000100:00100000:2.0:1762166855.712637:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49165:x1847765444410112:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 170us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.712644:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 172 00000100:00100000:0.0:1762166855.715267:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.715349:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444410368 00000100:00100000:2.0:1762166855.715358:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444410368 00000100:00100000:2.0:1762166855.715423:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 173 00000100:00100000:2.0:1762166855.715445:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e07bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49165:x1847765444410368:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.715463:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.715481:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9dd80 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9139b expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.716050:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9dd87 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.716064:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9dd87 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.716074:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9dd87 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.716084:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x26:0x0]: returning size 0 00010000:00010000:2.0:1762166855.716125:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9dd80 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9139b expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.716141:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9dd87 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9139b expref: 37 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.716149:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x26:0x0].0x0 (ffff9ee360714600) 00010000:00010000:2.0:1762166855.716153:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166855.716156:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472000, rc 0) 00000100:00100000:2.0:1762166855.716211:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e07bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49165:x1847765444410368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 780us (952us total) trans 8589934749 rc 0/0 00000100:00100000:2.0:1762166855.716218:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 173 00000100:00100000:3.0:1762166855.717751:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.717817:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444410624 00000100:00100000:2.0:1762166855.717825:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444410624 00000100:00100000:2.0:1762166855.717885:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 174 00000100:00100000:2.0:1762166855.717895:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49165:x1847765444410624:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.717915:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.717930:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9dd95 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f913a2 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.718005:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9dd9c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.718018:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9dd9c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.718027:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9dd9c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.718038:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166855.718130:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9dd95 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913a2 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.718147:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9dd9c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913a2 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.718155:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714500) 00010000:00010000:2.0:1762166855.718159:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166855.718162:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473a00, rc 0) 00000100:00100000:2.0:1762166855.718214:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49165:x1847765444410624:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 321us (468us total) trans 8589934750 rc 0/0 00000100:00100000:2.0:1762166855.718222:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 174 00000100:00100000:3.0:1762166855.719304:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.719356:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444410880 00000100:00100000:2.0:1762166855.719363:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444410880 00000100:00100000:2.0:1762166855.719419:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 61 00000100:00100000:2.0:1762166855.719428:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49165:x1847765444410880:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166855.719492:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9dd9c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913a2 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.719520:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddaa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.719532:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9dd79 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91394 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.719539:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddaa lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.719575:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9dd79 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91394 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.719587:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9dd79 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91394 expref: 39 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.719601:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f402d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451962240:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.719668:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.720752:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f402d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451962240:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.720798:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddaa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166855.720970:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.721018:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444411008 00000100:00100000:0.0:1762166855.721025:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444411008 00010000:00010000:0.0:1762166855.721051:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9dd79 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91394 expref: 40 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166855.721082:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 662 00000100:00100000:0.0:1762166855.721090:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2360:x1847765444411008:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166855.721116:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166855.721122:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9dd79 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91394 expref: 40 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.721132:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9dd79 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91394 expref: 40 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.721149:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9dd79 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91394 expref: 40 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.721164:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714500) 00010000:00010000:0.0:1762166855.721168:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddaa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.721176:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddaa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.721183:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddaa lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.721208:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.721232:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddaa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.721241:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddaa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166855.721252:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444411008:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 162us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.721265:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 662 00010000:00010000:2.0:1762166855.721271:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddb1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.721283:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9dd87 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9139b expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.721291:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddb1 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.721314:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9dd87 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9139b expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.721327:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9dd87 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9139b expref: 38 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.721339:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f402d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451962368:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.721387:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166855.722655:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.722719:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444411136 00000100:00100000:0.0:1762166855.722726:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444411136 00000100:00100000:2.0:1762166855.722740:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f402d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451962368:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166855.722750:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9dd87 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9139b expref: 39 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166855.722758:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddb1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x26:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166855.722806:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 663 00000100:00100000:0.0:1762166855.722825:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444411136:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166855.722837:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166855.722843:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9dd87 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9139b expref: 39 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.722853:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9dd87 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9139b expref: 39 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.722868:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9dd87 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9139b expref: 39 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.722882:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x26:0x0].0x0 (ffff9ee360714600) 00010000:00010000:0.0:1762166855.722885:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddb1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.722892:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddb1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.722898:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddb1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166855.722919:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.722938:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddb1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x26:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.722946:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddb1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x26:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166855.722964:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2360:x1847765444411136:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 139us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.722972:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 663 00000100:00100000:2.0:1762166855.723317:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f402d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451962496:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166855.723359:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166855.723396:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166855.723459:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451962496 00000100:00100000:3.0:1762166855.723464:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451962496 00000100:00100000:3.0:1762166855.723496:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1762166855.723504:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:31351:x1847765451962496:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166855.723564:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:31351:x1847765451962496:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 58us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166855.723571:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1762166855.723592:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f402d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451962496:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166855.723628:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934751 00000001:00080000:2.0:1762166855.723668:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934752 00010000:00010000:2.0:1762166855.723681:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddb1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x26:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.723686:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddb1 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x26:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.723690:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddb1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x26:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.723694:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244472600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.723696:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddb1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x26:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.723701:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddb1 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x26:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.723708:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x26:0x0].0x0 (ffff9ee360714600) 00010000:00010000:2.0:1762166855.723710:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166855.723712:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddb1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x26:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.723716:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddb1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x26:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.723727:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddaa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.723731:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddaa lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.723741:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddaa lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.723744:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.723746:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddaa lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.723749:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddaa lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.723753:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714500) 00010000:00010000:2.0:1762166855.723754:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166855.723755:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddaa lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.723758:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddaa lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.723791:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714500) 00010000:00010000:2.0:1762166855.723793:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166855.723797:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9dd9c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913a2 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166855.723854:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49165:x1847765444410880:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 4429us (4556us total) trans 8589934753 rc 0/0 00000100:00100000:2.0:1762166855.723860:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 61 00000020:00080000:2.0:1762166855.723863:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166855.724742:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.724824:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444411264 00000100:00100000:2.0:1762166855.724829:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444411264 00000100:00100000:2.0:1762166855.724866:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 175 00000100:00100000:2.0:1762166855.724877:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49165:x1847765444411264:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.724902:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.724919:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9ddb8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f913a9 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.724960:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9ddb8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913a9 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.724973:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9ddb8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913a9 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.724989:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:2.0:1762166855.724991:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166855.724993:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472800, rc 0) 00000100:00100000:2.0:1762166855.725034:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49165:x1847765444411264:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 158us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.725041:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 175 00000100:00100000:0.0:1762166855.726390:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.726444:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444411520 00000100:00100000:2.0:1762166855.726450:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444411520 00000100:00100000:2.0:1762166855.726478:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 62 00000100:00100000:2.0:1762166855.726487:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49165:x1847765444411520:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762166855.726843:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x26:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166855.726919:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].11, 64 off9088 00000001:00080000:2.0:1762166855.726928:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934754 00010000:00010000:2.0:1762166855.726969:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9ddbf lrc: 3/0,1 mode: --/PW res: [0x200000404:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.726982:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9ddbf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.727006:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9ddbf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.727015:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9ddbf lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.727021:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9ddbf lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.727027:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9ddbf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.727047:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166855.727084:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166855.727097:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9ddbf lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.727106:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166855.727110:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9ddbf lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.727117:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9ddbf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.727144:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x26:0x0].0x0 (ffff9ee360714f00) 00000100:00100000:2.0:1762166855.727152:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49165:x1847765444411520:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 662us (762us total) trans 8589934755 rc 0/0 00010000:00010000:1.0:1762166855.727153:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:2.0:1762166855.727166:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 62 00010000:00010000:1.0:1762166855.727166:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9ddbf lrc: 1/0,0 mode: --/PW res: [0x200000404:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00000020:00080000:2.0:1762166855.727173:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762166855.727192:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9ddbf lrc: 0/0,0 mode: --/PW res: [0x200000404:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.727224:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166855.727226:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166855.727228:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166855.728058:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.728122:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444411776 00000100:00100000:2.0:1762166855.728128:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444411776 00000100:00100000:2.0:1762166855.728161:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 63 00000100:00100000:2.0:1762166855.728170:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49165:x1847765444411776:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166855.728354:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49165:x1847765444411776:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 184us (298us total) trans 8589934756 rc 0/0 00000100:00100000:2.0:1762166855.728362:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 63 00000100:00100000:3.0:1762166855.737307:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.737386:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444411904 00000100:00100000:2.0:1762166855.737397:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444411904 00000100:00100000:2.0:1762166855.737475:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 176 00000100:00100000:2.0:1762166855.737490:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49167:x1847765444411904:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166855.737532:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.737553:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9ddc6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f913b0 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.737614:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddcd lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737627:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddcd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737648:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddcd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737664:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddd4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737671:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddd4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737677:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddd4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737844:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9dddb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737853:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9dddb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737859:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9dddb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.737888:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166855.737892:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166855.737913:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9dddb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737931:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9dddb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737940:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddcd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737947:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddcd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737953:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddcd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737957:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.737960:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddcd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737965:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddcd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737973:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166855.737975:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166855.737978:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddcd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737982:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddcd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737991:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddd4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737994:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddd4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.737998:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddd4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.738008:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244472600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.738011:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddd4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.738017:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddd4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.738024:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee360714500) 00010000:00010000:2.0:1762166855.738026:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166855.738029:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddd4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.738034:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddd4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.738064:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9ddc6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913b0 expref: 45 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.738078:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9dddb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913b0 expref: 44 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.738085:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:2.0:1762166855.738087:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166855.738089:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472a00, rc 0) 00000100:00100000:2.0:1762166855.738141:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49167:x1847765444411904:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 657us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.738146:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 176 00000100:00100000:0.0:1762166855.739697:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.739804:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444412032 00000100:00100000:2.0:1762166855.739811:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444412032 00000100:00100000:2.0:1762166855.739865:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1068 00000100:00100000:2.0:1762166855.739874:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444412032:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166855.739888:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.739902:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9dde2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f913b7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.739923:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.739925:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.739933:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9dde2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913b7 expref: 24 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.739947:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9dde2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913b7 expref: 24 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.739958:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472e00, rc 0) 00000100:00100000:2.0:1762166855.740008:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765444412032:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 131us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.740015:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1068 00000100:00100000:3.0:1762166855.753495:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.753555:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444412160 00000100:00100000:2.0:1762166855.753567:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444412160 00000100:00100000:2.0:1762166855.753629:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 177 00000100:00100000:2.0:1762166855.753639:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49171:x1847765444412160:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166855.753710:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9dde9 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.753726:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9dde9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.753738:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9dde9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.753827:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddf0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.753835:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddf0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.753843:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddf0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.753965:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddf7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.753974:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddf7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.753980:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddf7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.754008:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166855.754012:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166855.754023:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddf7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754034:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9dde9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754040:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9dde9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754046:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9dde9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754052:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.754056:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9dde9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754068:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9dde9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754079:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166855.754082:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166855.754085:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9dde9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754089:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9dde9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754099:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddf0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754102:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddf0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754106:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddf0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754108:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244472600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.754110:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddf0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754113:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddf0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754119:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee360714500) 00010000:00010000:2.0:1762166855.754121:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166855.754124:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddf0 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754128:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9ddf0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754146:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddf7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754152:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddf7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754156:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddf7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754161:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244473800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.754164:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddf7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754169:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddf7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754175:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:2.0:1762166855.754177:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166855.754179:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddf7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.754184:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddf7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166855.754251:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49171:x1847765444412160:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 613us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.754259:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 177 00000100:00100000:3.0:1762166855.764371:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.764460:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444412416 00000100:00100000:2.0:1762166855.764472:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444412416 00000100:00100000:2.0:1762166855.764533:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 178 00000100:00100000:2.0:1762166855.764544:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49173:x1847765444412416:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.764580:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.764599:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddfe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f913be expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.764692:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9de05 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.764706:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9de05 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.764717:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9de05 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.764728:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166855.764872:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9ddfe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913be expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.764890:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9de05 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913be expref: 46 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.764899:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:2.0:1762166855.764902:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166855.764906:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472600, rc 0) 00000100:00100000:2.0:1762166855.764971:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49173:x1847765444412416:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 429us (610us total) trans 8589934757 rc 0/0 00000100:00100000:2.0:1762166855.764978:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 178 00000100:00100000:0.0:1762166855.767113:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.767159:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444412544 00000100:00100000:2.0:1762166855.767167:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444412544 00000100:00100000:2.0:1762166855.767226:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1069 00000100:00100000:2.0:1762166855.767235:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e07ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765444412544:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.767264:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.767279:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9de13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f913c5 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.767301:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.767303:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.767320:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9de13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913c5 expref: 25 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.767339:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9de13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913c5 expref: 25 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.767352:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473a00, rc 0) 00000100:00100000:2.0:1762166855.767409:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e07ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444412544:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 175us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.767417:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1069 00000100:00100000:3.0:1762166855.769476:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.769653:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444412800 00000100:00100000:2.0:1762166855.769662:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444412800 00000100:00100000:2.0:1762166855.769719:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 179 00000100:00100000:2.0:1762166855.769729:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49173:x1847765444412800:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.769748:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.769796:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9de1a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f913cc expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.769914:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9de21 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.769929:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9dddb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913b0 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.769942:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9de21 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.769971:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9dddb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913b0 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.769984:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9dddb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913b0 expref: 47 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.769997:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f402d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451962624:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.770069:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34aab0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.771308:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f402d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451962624:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.771352:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9de21 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166855.771588:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.771701:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444412928 00000100:00100000:0.0:1762166855.771711:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444412928 00010000:00010000:0.0:1762166855.771755:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9dddb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913b0 expref: 48 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166855.771816:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 664 00000100:00100000:0.0:1762166855.771829:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2360:x1847765444412928:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166855.771844:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166855.771851:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9dddb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913b0 expref: 48 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.771865:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9dddb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913b0 expref: 48 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.771885:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9dddb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913b0 expref: 48 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.771901:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:0.0:1762166855.771905:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9de21 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.771914:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9de21 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.771920:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9de21 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.771952:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166855.772006:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:2360:x1847765444412928:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 181us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.772013:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 664 00010000:00010000:2.0:1762166855.772084:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9de21 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.772099:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9de21 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.772135:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166855.772328:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9de1a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913cc expref: 48 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.772349:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9de21 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913cc expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.772358:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:2.0:1762166855.772371:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166855.772375:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473c00, rc 0) 00000100:00100000:2.0:1762166855.772454:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49173:x1847765444412800:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2726us (2985us total) trans 8589934758 rc 0/0 00000100:00100000:2.0:1762166855.772462:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 179 00000100:00100000:3.0:1762166855.774093:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.774205:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444413184 00000100:00100000:2.0:1762166855.774213:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444413184 00000100:00100000:2.0:1762166855.774270:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 180 00000100:00100000:2.0:1762166855.774282:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49173:x1847765444413184:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.774306:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.774325:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9de2f lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f913d3 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.774872:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9de36 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.774885:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9de36 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.774895:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9de36 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.774905:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x27:0x0]: returning size 0 00010000:00010000:2.0:1762166855.774947:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473800/0xf915a5bdf3c9de2f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913d3 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.774964:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9de36 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913d3 expref: 49 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.774973:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x27:0x0].0x0 (ffff9ee360714500) 00010000:00010000:2.0:1762166855.774988:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166855.774992:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473200, rc 0) 00000100:00100000:2.0:1762166855.775045:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49173:x1847765444413184:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 766us (961us total) trans 8589934759 rc 0/0 00000100:00100000:2.0:1762166855.775053:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 180 00000100:00100000:3.0:1762166855.776901:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.776956:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444413440 00000100:00100000:2.0:1762166855.776965:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444413440 00000100:00100000:2.0:1762166855.777021:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 181 00000100:00100000:2.0:1762166855.777030:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49173:x1847765444413440:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.777048:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.777064:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472200/0xf915a5bdf3c9de44 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f913da expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.777143:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9de4b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.777159:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9de36 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913d3 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.777168:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9de4b lrc: 4/0,1 mode: --/EX res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.777204:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9de36 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913d3 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.777217:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9de36 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913d3 expref: 50 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.777231:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f402d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451962752:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.777324:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34aab0480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.778545:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f402d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451962752:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.778580:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9de4b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166855.778740:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.778844:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444413568 00000100:00100000:0.0:1762166855.778871:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444413568 00010000:00010000:0.0:1762166855.778914:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9de36 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913d3 expref: 51 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166855.778953:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 665 00000100:00100000:0.0:1762166855.778964:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2360:x1847765444413568:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166855.778981:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166855.778988:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9de36 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913d3 expref: 51 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.779006:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9de36 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913d3 expref: 51 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.779032:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473200/0xf915a5bdf3c9de36 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913d3 expref: 51 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.779052:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x27:0x0].0x0 (ffff9ee360714500) 00010000:00010000:0.0:1762166855.779057:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9de4b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.779067:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9de4b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.779075:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9de4b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.779111:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166855.779166:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2360:x1847765444413568:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 201us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.779176:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 665 00010000:00010000:2.0:1762166855.779311:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9de4b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.779319:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9de4b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.779338:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x27:0x0]: returning size 0 00000004:00080000:2.0:1762166855.779731:0:30817:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x86:0x0], index 1: 0 00010000:00010000:2.0:1762166855.779937:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9de4b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.779946:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9de4b lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.779953:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9de4b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.779960:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee244472000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.779964:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9de4b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.779971:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9de4b lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.779984:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x27:0x0].0x0 (ffff9ee360714500) 00010000:00010000:2.0:1762166855.779987:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166855.779991:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9de4b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.780004:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472000/0xf915a5bdf3c9de4b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.780065:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472200/0xf915a5bdf3c9de44 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913da expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.780075:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166855.780077:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166855.780081:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472200/0xf915a5bdf3c9de44 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913da expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.780089:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244472200, rc 0) 00000100:00100000:2.0:1762166855.780134:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49173:x1847765444413440:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3105us (3240us total) trans 8589934760 rc 301/301 00000100:00100000:2.0:1762166855.780142:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 181 00000100:00100000:3.0:1762166855.781858:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.781902:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444413824 00000100:00100000:2.0:1762166855.781911:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444413824 00000100:00100000:2.0:1762166855.781968:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 64 00000100:00100000:2.0:1762166855.781977:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49173:x1847765444413824:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166855.782304:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49173:x1847765444413824:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 328us (462us total) trans 8589934761 rc 0/0 00000100:00100000:2.0:1762166855.782312:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 64 00000100:00100000:1.0:1762166855.783452:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.783514:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444413952 00000100:00100000:2.0:1762166855.783520:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444413952 00000100:00100000:2.0:1762166855.783559:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 182 00000100:00100000:2.0:1762166855.783569:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49173:x1847765444413952:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.783598:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.783615:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9de59 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f913e1 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.783675:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9de60 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.783688:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9de21 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913cc expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.783696:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9de60 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.783726:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9de21 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913cc expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.783741:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9de21 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913cc expref: 51 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.783754:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f402d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451962880:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.783847:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34aab0480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.784783:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f402d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451962880:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.784800:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9de60 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166855.785103:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.785173:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444414080 00000100:00100000:0.0:1762166855.785179:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444414080 00010000:00010000:0.0:1762166855.785205:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9de21 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913cc expref: 52 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166855.785231:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 666 00000100:00100000:0.0:1762166855.785238:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2361:x1847765444414080:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166855.785247:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166855.785251:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9de21 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913cc expref: 52 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.785260:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9de21 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913cc expref: 52 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.785274:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473c00/0xf915a5bdf3c9de21 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913cc expref: 52 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.785287:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:0.0:1762166855.785290:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9de60 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.785296:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9de60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.785301:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9de60 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.785324:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166855.785365:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444414080:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 126us (261us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166855.785366:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9de60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.785377:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9de60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166855.785391:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 666 00000004:00200000:2.0:1762166855.785456:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166855.785462:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166855.785479:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9de60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.785508:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472400/0xf915a5bdf3c9de59 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913e1 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.785521:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9de60 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913e1 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.785528:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:2.0:1762166855.785530:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166855.785532:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473000, rc 0) 00000100:00100000:2.0:1762166855.785564:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49173:x1847765444413952:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1997us (2116us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.785571:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 182 00000100:00100000:1.0:1762166855.787021:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.787118:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444414208 00000100:00100000:2.0:1762166855.787129:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444414208 00000100:00100000:2.0:1762166855.787196:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1070 00000100:00100000:2.0:1762166855.787207:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444414208:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.787228:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.787249:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9de67 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f913e8 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.787275:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.787277:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166855.787287:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9de67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913e8 expref: 26 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.787320:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9de67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913e8 expref: 26 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166855.787335:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee244473600, rc 0) 00000100:00100000:2.0:1762166855.787406:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444414208:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 200us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.787414:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1070 00000100:00100000:3.0:1762166855.788850:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.788968:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444414336 00000100:00100000:2.0:1762166855.788977:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444414336 00000100:00100000:2.0:1762166855.789039:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 183 00000100:00100000:2.0:1762166855.789050:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49173:x1847765444414336:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.789073:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.789098:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9de6e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f913ef expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.789166:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9de75 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.789180:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9de75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x27:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.789190:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9de75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x27:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.789220:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x27:0x0]: returning size 0 00000004:00200000:2.0:1762166855.789225:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166855.789239:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9de75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x27:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.789273:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472a00/0xf915a5bdf3c9de6e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913ef expref: 52 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.789291:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9de75 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x27:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913ef expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.789299:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x27:0x0].0x0 (ffff9ee360714600) 00010000:00010000:2.0:1762166855.789302:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166855.789305:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2200, rc 0) 00000100:00100000:2.0:1762166855.789363:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49173:x1847765444414336:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 315us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.789371:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 183 00000100:00100000:3.0:1762166855.790748:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.790851:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444414464 00000100:00100000:1.0:1762166855.790866:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444414464 00000100:00100000:1.0:1762166855.790936:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1071 00000100:00100000:1.0:1762166855.790949:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765444414464:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.790969:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.790995:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9de7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f913f6 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166855.791025:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166855.791047:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.791049:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.791058:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9de7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913f6 expref: 22 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.791075:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9de7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913f6 expref: 22 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.791090:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7cc00, rc 0) 00000100:00100000:1.0:1762166855.791161:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444414464:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 216us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.791184:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1071 00000100:00100000:1.0:1762166855.792361:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.792408:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444414720 00000100:00100000:2.0:1762166855.792419:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444414720 00000100:00100000:2.0:1762166855.792474:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 184 00000100:00100000:2.0:1762166855.792485:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49173:x1847765444414720:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.792503:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.792522:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9de83 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f913fd expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.792606:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9de8a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.792620:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9de8a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.792628:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9de8a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.792652:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166855.792821:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9de83 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913fd expref: 54 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.792843:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9de8a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913fd expref: 53 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.792852:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:2.0:1762166855.792867:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166855.792871:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3400, rc 0) 00000100:00100000:2.0:1762166855.792943:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49173:x1847765444414720:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 456us (594us total) trans 8589934762 rc 0/0 00000100:00100000:2.0:1762166855.792951:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 184 00000100:00100000:3.0:1762166855.794417:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.794491:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444414848 00000100:00100000:1.0:1762166855.794498:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444414848 00000100:00100000:1.0:1762166855.794542:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1072 00000100:00100000:1.0:1762166855.794552:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444414848:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.794565:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.794578:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9de98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91404 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.794598:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.794600:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.794607:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9de98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91404 expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.794623:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9de98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91404 expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.794634:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d400, rc 0) 00000100:00100000:1.0:1762166855.794684:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444414848:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 134us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.794691:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1072 00000100:00100000:3.0:1762166855.796013:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.796146:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444414976 00000100:00100000:1.0:1762166855.796161:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444414976 00000100:00100000:1.0:1762166855.796229:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1073 00000100:00100000:1.0:1762166855.796239:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444414976:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.796289:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.796311:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9de9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9140b expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.796339:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.796341:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.796350:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9de9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9140b expref: 28 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.796369:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9de9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9140b expref: 28 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.796384:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c400, rc 0) 00000100:00100000:1.0:1762166855.796469:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444414976:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 231us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.796477:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1073 00000100:00100000:0.0:1762166855.797856:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.797921:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444415104 00000100:00100000:1.0:1762166855.797931:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444415104 00000100:00100000:1.0:1762166855.797983:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1074 00000100:00100000:1.0:1762166855.797993:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444415104:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762166855.798042:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dea6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.798056:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.798058:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.798062:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dea6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.798094:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dea6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.798132:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dea6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.798140:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dea6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.798148:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dea6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.798155:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7dc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166855.798160:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dea6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.798169:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dea6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.798185:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dea6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.798193:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dea6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166855.798274:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444415104:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 282us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.798293:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1074 00000100:00100000:3.0:1762166855.799653:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.799739:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444415232 00000100:00100000:1.0:1762166855.799749:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444415232 00000100:00100000:1.0:1762166855.799820:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1075 00000100:00100000:1.0:1762166855.799828:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444415232:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.799843:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.799856:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dead lrc: 2/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91412 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.799874:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.799876:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.799889:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dead lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91412 expref: 29 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.799909:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dead lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91412 expref: 29 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.799922:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d200, rc 0) 00000100:00100000:1.0:1762166855.799980:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765444415232:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 153us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.799985:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1075 00000100:00100000:3.0:1762166855.825026:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.825143:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444415360 00000100:00100000:1.0:1762166855.825162:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444415360 00000100:00100000:1.0:1762166855.825253:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1076 00000100:00100000:1.0:1762166855.825266:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765444415360:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.825291:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.825334:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9deb4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91419 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.825365:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.825368:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.825378:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9deb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91419 expref: 30 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.825401:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9deb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91419 expref: 30 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.825418:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7dc00, rc 0) 00000100:00100000:1.0:1762166855.825518:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765444415360:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 254us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.825527:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1076 00000100:00100000:0.0:1762166855.827018:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.827092:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444415488 00000100:00100000:1.0:1762166855.827108:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444415488 00000100:00100000:1.0:1762166855.827166:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1077 00000100:00100000:1.0:1762166855.827177:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49173:x1847765444415488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.827196:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.827216:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9debb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91420 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.827242:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.827245:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.827252:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9debb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91420 expref: 31 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.827267:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9debb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91420 expref: 31 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.827292:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c600, rc 0) 00000100:00100000:1.0:1762166855.827349:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49173:x1847765444415488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 175us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.827357:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1077 00000100:00100000:3.0:1762166855.828732:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.828804:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444415616 00000100:00100000:1.0:1762166855.828810:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444415616 00000100:00100000:1.0:1762166855.828841:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1078 00000100:00100000:1.0:1762166855.828846:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765444415616:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.828855:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.828866:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dec2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91427 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.828879:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.828881:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.828885:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dec2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91427 expref: 32 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.828895:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dec2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91427 expref: 32 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.828902:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7ce00, rc 0) 00000100:00100000:1.0:1762166855.828932:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765444415616:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 86us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.828936:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1078 00000100:00100000:3.0:1762166855.829880:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.829938:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444415744 00000100:00100000:2.0:1762166855.829944:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444415744 00000100:00100000:2.0:1762166855.829990:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 185 00000100:00100000:2.0:1762166855.829999:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49173:x1847765444415744:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:2.0:1762166855.840224:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934738 is committed 00000020:00080000:2.0:1762166855.840244:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969114 batchid updated 00000001:00080000:2.0:1762166855.840268:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934762 is committed 00000020:00080000:2.0:1762166855.840323:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee3457d3180 refcount 2 committed 0 result 0 batchid 4294969115 00000020:00080000:2.0:1762166855.840328:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435c0c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3457d39c0 00000020:00080000:2.0:1762166855.840332:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435c0a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee24baac800 00000100:00100000:0.0:1762166855.840339:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49173:x1847765444415744:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 10334us (10454us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.840352:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 185 00000020:00080000:1.0:1762166855.840360:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969115 committed batchid 4294969114 00000020:00080000:1.0:1762166855.840540:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969114 00000100:00100000:0.0:1762166855.841534:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.841585:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444415872 00000100:00100000:1.0:1762166855.841591:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444415872 00000100:00100000:1.0:1762166855.841627:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1079 00000100:00100000:1.0:1762166855.841633:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444415872:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:1.0:1762166855.841717:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444415872:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 82us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.841724:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1079 00000100:00100000:3.0:1762166855.847897:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.847956:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444416000 00000100:00100000:1.0:1762166855.847968:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444416000 00000100:00100000:1.0:1762166855.848025:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1080 00000100:00100000:1.0:1762166855.848033:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765444416000:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762166855.848074:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9dec9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.848089:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.848091:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.848097:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9dec9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.848112:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9dec9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.848139:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9dec9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.848147:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9dec9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.848166:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9dec9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.848170:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166855.848173:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9dec9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.848178:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9dec9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.848188:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9dec9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.848193:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9dec9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166855.848260:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765444416000:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 227us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.848268:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1080 00000100:00100000:3.0:1762166855.849259:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.849314:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444416256 00000100:00100000:0.0:1762166855.849321:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444416256 00000100:00100000:0.0:1762166855.849364:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 186 00000100:00100000:0.0:1762166855.849372:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49173:x1847765444416256:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166855.849414:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166855.849444:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9de75 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x27:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913ef expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.849460:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x27:0x0].0x0 (ffff9ee360714600) 00010000:00010000:0.0:1762166855.849468:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166855.849491:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9ded0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.849499:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9ded0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.849504:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9ded0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762166855.849652:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000e75274f reply state 00000000f830b5bc transno 8589934763 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9ded0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166855.849673:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166855.849739:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49173:x1847765444416256:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 367us (481us total) trans 8589934763 rc 0/0 00000100:00100000:0.0:1762166855.849746:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 186 00010000:00010000:3.0:1762166855.850610:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9ded0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166855.850622:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9ded0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166855.850629:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9ded0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166855.850635:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166855.850639:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9ded0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166855.850647:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9ded0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166855.850659:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x27:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:3.0:1762166855.850662:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166855.850665:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9ded0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166855.850671:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9ded0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166855.850850:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.850884:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444416384 00000100:00100000:0.0:1762166855.850890:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444416384 00000100:00100000:0.0:1762166855.850926:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 187 00000100:00100000:0.0:1762166855.850937:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49173:x1847765444416384:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.850953:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.850967:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ded7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9142e expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.851004:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ded7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9142e expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.851015:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ded7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9142e expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.851029:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x27:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166855.851032:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166855.851035:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198c00, rc 0) 00000100:00100000:0.0:1762166855.851076:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49173:x1847765444416384:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 142us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.851084:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 187 00000100:00100000:0.0:1762166855.852094:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.852152:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444416512 00000100:00100000:1.0:1762166855.852167:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444416512 00000100:00100000:1.0:1762166855.852241:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1081 00000100:00100000:1.0:1762166855.852254:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:49173:x1847765444416512:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.852273:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.852293:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9dede lrc: 2/0,0 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91435 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.852340:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9de7c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913f6 expref: 23 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.852348:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.852350:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.852354:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9dede lrc: 4/0,0 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91435 expref: 23 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.852409:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9de7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913f6 expref: 23 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.852425:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9de7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913f6 expref: 23 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.852452:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451963008:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.852547:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee351428300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166855.853544:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451963008:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.853583:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9dede lrc: 3/0,0 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91435 expref: 23 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.853599:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158200, rc 0) 00000100:00100000:1.0:1762166855.853643:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:49173:x1847765444416512:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1391us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.853651:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1081 00000100:00100000:0.0:1762166855.853805:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.853849:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444416640 00000100:00100000:1.0:1762166855.853864:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444416640 00010000:00010000:1.0:1762166855.853892:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9de7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913f6 expref: 23 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.853937:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 667 00000100:00100000:1.0:1762166855.853949:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e07b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444416640:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.853962:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.853987:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9de7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913f6 expref: 23 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:1.0:1762166855.854001:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9de7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913f6 expref: 23 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:1.0:1762166855.854023:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9de7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913f6 expref: 23 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:1.0:1762166855.854036:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.854038:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.854043:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9dede lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91435 expref: 22 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.854053:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9dede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91435 expref: 22 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.854081:0:5741:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9dede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91435 expref: 22 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166855.854106:0:5741:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5741:1847765451963136:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762166855.854159:0:5741:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee351428300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166855.854968:0:5741:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5741:1847765451963136:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762166855.854979:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166855.855009:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e07b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444416640:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1063us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.855019:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 667 00000100:00100000:3.0:1762166855.855124:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.855167:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444416768 00000100:00100000:1.0:1762166855.855174:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444416768 00000100:00100000:1.0:1762166855.855214:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1082 00000100:00100000:1.0:1762166855.855223:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765444416768:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762166855.855505:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x86:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166855.855510:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x86:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:1.0:1762166855.855512:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x86:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:1.0:1762166855.855515:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x86:0x0] updating lvb ctime from disk: 0 -> 1762166856 00002000:00010000:1.0:1762166855.855517:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x86:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762166855.855558:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444416768:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 335us (437us total) trans 17179869444 rc 0/0 00000100:00100000:1.0:1762166855.855566:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1082 00000100:00100000:3.0:1762166855.856489:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.856537:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444417024 00000100:00100000:0.0:1762166855.856555:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444417024 00000100:00100000:0.0:1762166855.856602:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 188 00000100:00100000:0.0:1762166855.856613:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49173:x1847765444417024:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166855.856663:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166855.856690:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473000/0xf915a5bdf3c9de60 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913e1 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.856709:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:0.0:1762166855.856715:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166855.856755:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9dee5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.856792:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9dee5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.856803:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9dee5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762166855.856929:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007b56afde reply state 000000001c56b386 transno 8589934764 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9dee5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166855.856945:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166855.857026:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49173:x1847765444417024:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 415us (540us total) trans 8589934764 rc 0/0 00000100:00100000:0.0:1762166855.857033:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 188 00010000:00010000:2.0:1762166855.857732:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9dee5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.857756:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9dee5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.857794:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9dee5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.857802:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.857807:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9dee5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.857816:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9dee5 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.857828:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:2.0:1762166855.857832:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166855.857836:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9dee5 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.857842:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9dee5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166855.857941:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.858021:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444417152 00000100:00100000:1.0:1762166855.858031:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444417152 00000100:00100000:1.0:1762166855.858080:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1083 00000100:00100000:1.0:1762166855.858095:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:49173:x1847765444417152:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166855.858111:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166855.858140:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9deec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9143c expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.858168:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9dc7d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91332 expref: 33 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.858177:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dec2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91427 expref: 33 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.858185:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9debb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91420 expref: 33 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.858192:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9deb4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91419 expref: 33 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.858199:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dead lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91412 expref: 33 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.858206:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9de9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9140b expref: 33 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.858213:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9de98 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91404 expref: 33 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.858220:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9de67 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913e8 expref: 33 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.858237:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9de13 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913c5 expref: 33 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.858250:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9dde2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913b7 expref: 33 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.858257:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.858259:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.858263:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9deec lrc: 13/0,0 mode: --/PW res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9143c expref: 33 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.858295:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9dde2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913b7 expref: 33 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.858306:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9dde2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913b7 expref: 33 pid: 6532 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.858320:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451963264:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.858393:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9de13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913c5 expref: 33 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.858402:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9de13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913c5 expref: 33 pid: 6532 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.858411:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451963392:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.858460:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9de67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913e8 expref: 33 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.858469:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9de67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913e8 expref: 33 pid: 6532 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.858478:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451963520:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.858501:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9de98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91404 expref: 33 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.858514:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9de98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91404 expref: 33 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.858523:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451963648:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.858560:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9de9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9140b expref: 33 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.858569:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9de9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9140b expref: 33 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.858578:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451963776:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.858614:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dead lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91412 expref: 33 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.858623:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dead lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91412 expref: 33 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.858639:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345731180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451963904:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.858671:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9deb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91419 expref: 33 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.858681:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9deb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91419 expref: 33 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.858689:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451964032:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.858724:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9debb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91420 expref: 33 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.858734:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9debb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91420 expref: 33 pid: 7858 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.858747:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345731f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451964160:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.858832:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dec2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91427 expref: 33 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.858846:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dec2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91427 expref: 33 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.858856:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345733800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451964288:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.858887:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9dc7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91332 expref: 33 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.858906:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9dc7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91332 expref: 33 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.858918:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451964416:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.858955:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee351428300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166855.860028:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451963264:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.860330:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451963392:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.860347:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451963520:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.860364:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451963648:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.860374:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451963776:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.860384:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345731180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451963904:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.860397:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451964032:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.860406:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345731f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451964160:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.860413:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345733800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451964288:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166855.860675:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451964416:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166855.860740:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9deec lrc: 3/0,0 mode: --/PW res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9143c expref: 33 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166855.860753:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166855.860758:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159a00, rc 0) 00000100:00100000:0.0:1762166855.860842:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444417408 00000100:00100000:0.0:1762166855.860855:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444417408 00000100:00100000:1.0:1762166855.860884:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49173:x1847765444417152:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2790us (2945us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166855.860895:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9de9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9140b expref: 34 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.860903:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1083 00000100:00100000:3.0:1762166855.860921:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.860950:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444417664 00000100:00100000:0.0:1762166855.860962:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444417664 00010000:00010000:0.0:1762166855.860986:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9de67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913e8 expref: 34 pid: 6532 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.860998:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 668 00000100:00100000:3.0:1762166855.861013:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 669 00000100:00100000:1.0:1762166855.861017:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765444417408:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166855.861029:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166855.861042:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166855.861045:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444418432 00000100:00100000:0.0:1762166855.861051:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444418432 00010000:00010000:1.0:1762166855.861076:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9de9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9140b expref: 35 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:0.0:1762166855.861081:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9dc7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91332 expref: 35 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166855.861083:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.861098:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444417664:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166855.861119:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444417920 00010000:00010000:3.0:1762166855.861127:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166855.861131:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444417920 00010000:00010000:1.0:1762166855.861137:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9de9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9140b expref: 35 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:0.0:1762166855.861144:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 670 00000100:00100000:0.0:1762166855.861160:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2359:x1847765444418432:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166855.861165:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dead lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91412 expref: 36 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:0.0:1762166855.861170:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166855.861173:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9de67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 15 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913e8 expref: 36 pid: 6532 timeout: 576 lvb_type: 1 00010000:00010000:1.0:1762166855.861193:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9de9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 17 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9140b expref: 36 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:0.0:1762166855.861193:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9dc7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 17 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91332 expref: 36 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166855.861214:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 671 00010000:00010000:3.0:1762166855.861234:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9de67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 17 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913e8 expref: 36 pid: 6532 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166855.861242:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765444417920:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166855.861275:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9dc7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91332 expref: 35 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:2.0:1762166855.861286:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.861286:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166855.861302:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9dc7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91332 expref: 35 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:3.0:1762166855.861311:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee244473600/0xf915a5bdf3c9de67 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 15 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913e8 expref: 35 pid: 6532 timeout: 576 lvb_type: 1 00010000:00010000:2.0:1762166855.861322:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dead lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91412 expref: 34 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.861323:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765444417408:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 305us (640us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166855.861323:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166855.861345:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166855.861352:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 668 00010000:00010000:2.0:1762166855.861361:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dead lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91412 expref: 33 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:0.0:1762166855.861374:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2359:x1847765444418432:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 214us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.861382:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 670 00010000:00010000:2.0:1762166855.861389:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dead lrc: 0/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91412 expref: 32 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:3.0:1762166855.861391:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765444417664:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 316us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166855.861425:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 669 00010000:00010000:2.0:1762166855.861442:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166855.861475:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444417920:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 242us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.861485:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 671 00000100:00100000:3.0:1762166855.861558:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.861605:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444418304 00000100:00100000:1.0:1762166855.861610:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444418304 00010000:00010000:1.0:1762166855.861625:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dec2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91427 expref: 29 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.861664:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 672 00000100:00100000:1.0:1762166855.861673:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444418304:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.861691:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.861703:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dec2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91427 expref: 29 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:3.0:1762166855.861717:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166855.861731:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dec2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91427 expref: 29 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:1.0:1762166855.861750:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dec2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91427 expref: 29 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:0.0:1762166855.861755:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444417280 00010000:00010000:1.0:1762166855.861789:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166855.861795:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.861806:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444417280 00000100:00100000:1.0:1762166855.861834:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444418304:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 159us (278us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166855.861838:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9dde2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913b7 expref: 29 pid: 6532 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.861847:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 672 00000100:00100000:0.0:1762166855.861907:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444417536 00000100:00100000:0.0:1762166855.861912:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444417536 00000100:00100000:2.0:1762166855.861922:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 673 00000100:00100000:2.0:1762166855.861934:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444417280:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166855.861941:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9de13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913c5 expref: 29 pid: 6532 timeout: 576 lvb_type: 1 00010000:00010000:2.0:1762166855.861948:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166855.861957:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166855.861968:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9dde2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913b7 expref: 29 pid: 6532 timeout: 576 lvb_type: 1 00010000:00010000:2.0:1762166855.861982:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9dde2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913b7 expref: 29 pid: 6532 timeout: 576 lvb_type: 1 00010000:00010000:2.0:1762166855.862000:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee244472e00/0xf915a5bdf3c9dde2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913b7 expref: 29 pid: 6532 timeout: 576 lvb_type: 1 00000100:00100000:0.0:1762166855.862007:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444417792 00000100:00100000:0.0:1762166855.862016:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444417792 00000100:00100000:1.0:1762166855.862017:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 674 00010000:00010000:2.0:1762166855.862029:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166855.862038:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444417536:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166855.862049:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9de98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91404 expref: 29 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:1.0:1762166855.862050:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166855.862066:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166855.862069:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9de13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913c5 expref: 29 pid: 6532 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166855.862076:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444417280:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 143us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.862084:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444418048 00000100:00100000:0.0:1762166855.862091:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444418048 00010000:00010000:1.0:1762166855.862095:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9de13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913c5 expref: 29 pid: 6532 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166855.862096:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 673 00010000:00010000:0.0:1762166855.862119:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9deb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91419 expref: 29 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:1.0:1762166855.862121:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee244473a00/0xf915a5bdf3c9de13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913c5 expref: 29 pid: 6532 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166855.862138:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 675 00000100:00100000:2.0:1762166855.862159:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444417792:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166855.862172:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166855.862182:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 676 00000100:00100000:3.0:1762166855.862183:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166855.862191:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9de98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91404 expref: 28 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:1.0:1762166855.862191:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166855.862202:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444418048:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166855.862218:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9de98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91404 expref: 28 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:0.0:1762166855.862220:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166855.862232:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444417536:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 195us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.862242:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 674 00010000:00010000:0.0:1762166855.862249:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9deb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91419 expref: 28 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:2.0:1762166855.862253:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9de98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91404 expref: 28 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:1.0:1762166855.862262:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444418176 00000100:00100000:1.0:1762166855.862269:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444418176 00010000:00010000:1.0:1762166855.862285:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9debb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91420 expref: 28 pid: 7858 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.862293:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9deb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91419 expref: 27 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:2.0:1762166855.862309:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166855.862311:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 677 00000100:00100000:1.0:1762166855.862324:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444418176:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166855.862325:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9deb4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91419 expref: 27 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:1.0:1762166855.862331:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.862348:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9debb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91420 expref: 27 pid: 7858 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.862356:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444417792:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 198us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.862386:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 675 00010000:00010000:1.0:1762166855.862404:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9debb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91420 expref: 26 pid: 7858 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1762166855.862417:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166855.862428:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9debb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91420 expref: 25 pid: 7858 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.862455:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.862460:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166855.862471:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9deec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9143c expref: 24 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166855.862474:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765444418048:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 273us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.862500:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 676 00010000:00010000:1.0:1762166855.862523:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9deec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9143c expref: 23 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166855.862567:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9deec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9143c expref: 23 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166855.862584:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765451964544:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762166855.862650:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee351428480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166855.863699:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765451964544:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762166855.863718:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166855.863756:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.863789:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444418176:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1445us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.863799:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 677 00000100:00100000:0.0:1762166855.863870:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444418560 00000100:00100000:0.0:1762166855.863880:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444418560 00000100:00100000:0.0:1762166855.863928:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1084 00000100:00100000:0.0:1762166855.863936:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444418560:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166855.864100:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x86:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166855.864103:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x86:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166855.864104:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x86:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166855.864106:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x86:0x0] updating lvb ctime from disk: 1762166855 -> 1762166856 00002000:00010000:0.0:1762166855.864107:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x86:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166855.864147:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444418560:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 213us (392us total) trans 21474836774 rc 0/0 00000100:00100000:0.0:1762166855.864151:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1084 00000100:00100000:2.0:1762166855.865257:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.865304:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444418816 00000100:00100000:3.0:1762166855.865310:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444418816 00000100:00100000:3.0:1762166855.865341:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 65 00000100:00100000:3.0:1762166855.865347:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342fea850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49173:x1847765444418816:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:3.0:1762166855.865401:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9de8a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913fd expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.865426:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9def3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.865448:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9ddb8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913a9 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.865456:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9de05 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913be expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.865464:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9def3 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.865496:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9de05 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913be expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.865510:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9de05 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913be expref: 27 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166855.865523:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451964672:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166855.865603:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9ddb8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913a9 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166855.865611:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9ddb8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913a9 expref: 27 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166855.865626:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451964800:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166855.865649:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166855.866826:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451964672:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166855.866888:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451964800:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166855.866911:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9def3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166855.867817:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.867867:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444419200 00000100:00100000:0.0:1762166855.867879:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444419200 00000100:00100000:2.0:1762166855.867916:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.867928:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 66 00000100:00100000:0.0:1762166855.867941:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:37762:x1847765444419200:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1762166855.868055:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444419072 00000100:00100000:3.0:1762166855.868061:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444419072 00010000:00010000:3.0:1762166855.868084:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9ddb8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913a9 expref: 30 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166855.868129:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 678 00000100:00100000:3.0:1762166855.868139:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765444419072:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166855.868146:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:37762:x1847765444419200:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 208us (332us total) trans 8589934765 rc 0/0 00010000:00010000:3.0:1762166855.868149:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166855.868159:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 66 00010000:00010000:3.0:1762166855.868163:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9ddb8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913a9 expref: 30 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.868177:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9ddb8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913a9 expref: 29 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.868213:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472800/0xf915a5bdf3c9ddb8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913a9 expref: 29 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.868228:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:3.0:1762166855.868233:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9def3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.868242:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9def3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.868249:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166855.868273:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444419072:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 136us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166855.868281:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 678 00000100:00100000:2.0:1762166855.869123:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.869156:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444419328 00000100:00100000:3.0:1762166855.869162:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444419328 00010000:00010000:3.0:1762166855.869181:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9de05 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913be expref: 28 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166855.869212:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 679 00000100:00100000:3.0:1762166855.869219:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444419328:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166855.869228:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166855.869234:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9de05 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913be expref: 28 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.869258:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9de05 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913be expref: 28 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.869284:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244472600/0xf915a5bdf3c9de05 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913be expref: 28 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.869295:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:3.0:1762166855.869299:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9def3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.869307:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9def3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.869314:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9def3 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.869340:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166855.869368:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444419328:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 149us (248us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166855.869371:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9def3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166855.869378:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 679 00010000:00010000:2.0:1762166855.869385:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9def3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.869404:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9defa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.869415:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ded7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9142e expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.869423:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9defa lrc: 4/0,1 mode: --/EX res: [0x200000404:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.869460:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ded7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9142e expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.869473:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ded7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9142e expref: 26 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.869485:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f400380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451964928:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.869529:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36cb75d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166855.870247:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f400380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451964928:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166855.870265:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9defa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166855.870515:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.870541:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444419456 00000100:00100000:3.0:1762166855.870547:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444419456 00010000:00010000:3.0:1762166855.870567:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ded7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9142e expref: 27 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166855.870636:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 680 00000100:00100000:3.0:1762166855.870645:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444419456:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166855.870664:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166855.870669:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ded7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9142e expref: 27 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.870679:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ded7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9142e expref: 27 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.870692:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ded7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x27:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9142e expref: 27 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.870703:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x27:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:3.0:1762166855.870707:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9defa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.870714:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9defa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.870724:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9defa lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.870744:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.870794:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9defa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166855.870806:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444419456:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 162us (290us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166855.870810:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9defa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166855.870819:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 680 00000100:00100000:2.0:1762166855.871132:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f400380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451965056:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166855.871163:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166855.871190:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34aab0480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166855.871208:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451965056 00000100:00100000:3.0:1762166855.871214:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451965056 00000100:00100000:3.0:1762166855.871251:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1762166855.871259:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:31351:x1847765451965056:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166855.871346:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:31351:x1847765451965056:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 86us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166855.871360:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1762166855.871370:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f400380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451965056:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166855.871403:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f400380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451965184:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166855.871439:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166855.871460:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36cb75d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166855.871473:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451965184 00000100:00100000:3.0:1762166855.871477:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451965184 00000100:00100000:3.0:1762166855.871499:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1762166855.871504:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:31351:x1847765451965184:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166855.871549:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:31351:x1847765451965184:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 45us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166855.871553:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1762166855.871579:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f400380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451965184:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166855.871704:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934766 00000100:00100000:2.0:1762166855.871792:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451965312:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166855.871811:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166855.871829:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34aab0900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166855.871840:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451965312 00000100:00100000:3.0:1762166855.871846:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451965312 00000100:00100000:3.0:1762166855.871876:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1762166855.871883:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:31351:x1847765451965312:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166855.871996:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:31351:x1847765451965312:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 114us (183us total) trans 17179869445 rc 0/0 00000100:00100000:3.0:1762166855.872001:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1762166855.872039:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451965312:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166855.872113:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934767 00010000:00010000:2.0:1762166855.872134:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9defa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.872142:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9defa lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.872148:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9defa lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.872154:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.872157:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9defa lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.872164:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9defa lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.872174:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x27:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:2.0:1762166855.872183:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166855.872188:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9defa lrc: 2/0,0 mode: --/EX res: [0x200000404:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.872194:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9defa lrc: 0/0,0 mode: --/EX res: [0x200000404:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.872210:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9def3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.872215:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9def3 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.872220:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9def3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.872224:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382044600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.872227:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9def3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.872231:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9def3 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.872238:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:2.0:1762166855.872240:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166855.872242:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9def3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.872247:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9def3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.872257:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:2.0:1762166855.872259:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166855.872263:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9de8a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f913fd expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166855.872336:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342fea850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49173:x1847765444418816:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 6988us (7082us total) trans 8589934768 rc 0/0 00000100:00100000:2.0:1762166855.872345:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 65 00000020:00080000:2.0:1762166855.872348:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166855.873290:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.873344:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444419584 00000100:00100000:0.0:1762166855.873358:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444419584 00000100:00100000:0.0:1762166855.873390:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 189 00000100:00100000:0.0:1762166855.873396:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49173:x1847765444419584:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.873410:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.873424:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9df01 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91443 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.873469:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9df01 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91443 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.873477:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9df01 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91443 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.873487:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:0.0:1762166855.873490:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166855.873492:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199a00, rc 0) 00000100:00100000:0.0:1762166855.873522:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49173:x1847765444419584:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 127us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.873527:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 189 00000100:00100000:0.0:1762166855.874544:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.874665:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444419840 00000100:00100000:2.0:1762166855.874672:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444419840 00000100:00100000:2.0:1762166855.874708:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 67 00000100:00100000:2.0:1762166855.874716:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e07aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49173:x1847765444419840:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166855.874910:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e07aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49173:x1847765444419840:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 193us (367us total) trans 8589934769 rc 0/0 00000100:00100000:2.0:1762166855.874918:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 67 00000100:00100000:3.0:1762166855.876037:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.876074:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444420096 00000100:00100000:2.0:1762166855.876080:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444420096 00000100:00100000:2.0:1762166855.876113:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 68 00000100:00100000:2.0:1762166855.876120:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49173:x1847765444420096:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762166855.876304:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x27:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1762166855.876398:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9df08 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.876412:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9df08 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.876422:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9df08 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.876438:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9df08 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.876455:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9df08 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.876459:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9df08 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.876474:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166855.876526:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166855.876540:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9df08 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.876552:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166855.876557:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9df08 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166855.876559:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49173:x1847765444420096:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 436us (521us total) trans 8589934770 rc 0/0 00000100:00100000:2.0:1762166855.876587:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 68 00010000:00010000:1.0:1762166855.876588:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9df08 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.876612:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x27:0x0].0x0 (ffff9ee343a13200) 00010000:00010000:1.0:1762166855.876629:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166855.876634:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9df08 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.876640:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9df08 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166855.876670:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166855.876673:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166855.876675:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166855.885255:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.885337:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444420224 00000100:00100000:0.0:1762166855.885349:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444420224 00000100:00100000:0.0:1762166855.885427:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 190 00000100:00100000:0.0:1762166855.885447:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49175:x1847765444420224:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166855.885474:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.885496:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9df0f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9144a expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.885585:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9df16 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.885599:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9df16 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.885613:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9df16 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.885628:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9df1d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.885635:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9df1d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.885642:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9df1d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.885816:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9df24 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.885825:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9df24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.885833:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9df24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166855.885870:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166855.885875:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166855.885896:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9df24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.885909:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9df24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.885925:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9df16 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.885931:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9df16 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.885938:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9df16 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.885944:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166855.885948:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9df16 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.885957:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9df16 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.885971:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166855.885974:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166855.885980:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9df16 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.885986:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9df16 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.886016:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9df1d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.886023:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9df1d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.886029:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9df1d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.886034:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166855.886043:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9df1d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.886049:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9df1d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.886057:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4c00) 00010000:00010000:0.0:1762166855.886060:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166855.886063:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9df1d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.886069:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9df1d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.886102:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9df0f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9144a expref: 32 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.886115:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9df24 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9144a expref: 31 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.886123:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:0.0:1762166855.886126:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166855.886128:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198000, rc 0) 00000100:00100000:0.0:1762166855.886199:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49175:x1847765444420224:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 754us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.886207:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 190 00000100:00100000:0.0:1762166855.899459:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.899581:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444420352 00000100:00100000:2.0:1762166855.899596:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444420352 00000100:00100000:2.0:1762166855.899672:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 191 00000100:00100000:2.0:1762166855.899686:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49179:x1847765444420352:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166855.899822:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9df2b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.899845:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9df2b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.899861:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9df2b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.899887:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9df32 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.899899:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9df32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.899906:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9df32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900066:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9df39 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900076:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9df39 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900084:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9df39 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.900125:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166855.900130:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166855.900143:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9df39 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900158:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9df2b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900164:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9df2b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900171:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9df2b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900178:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.900183:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9df2b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900190:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9df2b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900204:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166855.900208:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166855.900213:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9df2b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900226:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9df2b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900243:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9df32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900248:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9df32 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900254:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9df32 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900260:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.900263:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9df32 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900269:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9df32 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900278:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee343a13800) 00010000:00010000:2.0:1762166855.900281:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166855.900284:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9df32 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900289:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9df32 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900321:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9df39 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900327:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9df39 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900344:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9df39 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900349:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.900352:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9df39 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900358:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9df39 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900367:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:2.0:1762166855.900369:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166855.900372:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9df39 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.900378:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9df39 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166855.900488:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49179:x1847765444420352:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 804us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.900498:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 191 00000100:00100000:3.0:1762166855.910250:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.910359:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444420608 00000100:00100000:2.0:1762166855.910376:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444420608 00000100:00100000:2.0:1762166855.910486:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 192 00000100:00100000:2.0:1762166855.910500:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49181:x1847765444420608:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.910532:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.910568:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9df40 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91451 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.910696:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9df47 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.910728:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9df47 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.910740:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9df47 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.910753:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166855.910947:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9df40 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91451 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.910969:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9df47 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91451 expref: 33 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.910979:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:2.0:1762166855.910982:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166855.910986:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2200, rc 0) 00000100:00100000:2.0:1762166855.911079:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49181:x1847765444420608:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 582us (838us total) trans 8589934771 rc 0/0 00000100:00100000:2.0:1762166855.911087:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 192 00000100:00100000:1.0:1762166855.913540:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.913600:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444420864 00000100:00100000:2.0:1762166855.913615:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444420864 00000100:00100000:2.0:1762166855.913685:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 193 00000100:00100000:2.0:1762166855.913697:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49181:x1847765444420864:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.913727:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.913748:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9df55 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91458 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.913911:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9df5c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.913934:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9df24 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9144a expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.913944:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9df5c lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.913983:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9df24 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9144a expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.913998:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9df24 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9144a expref: 34 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.914015:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451965440:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.914117:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34aab0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.916449:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.916463:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451965440:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.916501:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9df5c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166855.916557:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444420992 00000100:00100000:3.0:1762166855.916567:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444420992 00010000:00010000:3.0:1762166855.916605:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9df24 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9144a expref: 35 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166855.916649:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 681 00000100:00100000:3.0:1762166855.916659:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e078a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444420992:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166855.916673:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166855.916681:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9df24 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9144a expref: 35 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.916706:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9df24 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9144a expref: 35 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.916726:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9df24 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9144a expref: 35 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.916741:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:3.0:1762166855.916747:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9df5c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166855.916755:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9df5c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166855.916832:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9df5c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166855.916859:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166855.916915:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e078a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765444420992:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 256us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166855.916929:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 681 00010000:00010000:2.0:1762166855.916935:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9df5c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.916946:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9df5c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.916970:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166855.917158:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9df55 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91458 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.917179:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9df5c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91458 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.917200:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:2.0:1762166855.917203:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166855.917207:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2e00, rc 0) 00000100:00100000:2.0:1762166855.917274:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49181:x1847765444420864:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3579us (3742us total) trans 8589934772 rc 0/0 00000100:00100000:2.0:1762166855.917283:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 193 00000100:00100000:0.0:1762166855.918669:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.918723:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444421120 00000100:00100000:2.0:1762166855.918738:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444421120 00000100:00100000:2.0:1762166855.918818:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 69 00000100:00100000:2.0:1762166855.918826:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e07a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49181:x1847765444421120:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:2.0:1762166855.918975:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e07a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49181:x1847765444421120:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 149us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.918983:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 69 00000100:00100000:3.0:1762166855.920225:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.920288:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444421376 00000100:00100000:2.0:1762166855.920298:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444421376 00000100:00100000:2.0:1762166855.920352:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 70 00000100:00100000:2.0:1762166855.920362:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49181:x1847765444421376:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166855.920602:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49181:x1847765444421376:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 241us (385us total) trans 8589934773 rc 0/0 00000100:00100000:2.0:1762166855.920610:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 70 00000100:00100000:0.0:1762166855.921935:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.921980:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444421632 00000100:00100000:2.0:1762166855.921988:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444421632 00000100:00100000:2.0:1762166855.922037:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 194 00000100:00100000:2.0:1762166855.922045:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49181:x1847765444421632:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.922078:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.922082:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762166855.922108:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9df5c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91458 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.922127:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9df47 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91451 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.922134:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:2.0:1762166855.922137:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.922147:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9df6a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9145f expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.922216:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9df71 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.922226:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9df71 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.922231:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9df71 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.922239:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166855.922315:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9df6a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9145f expref: 36 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.922324:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9df71 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9145f expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.922329:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:2.0:1762166855.922335:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166855.922337:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2400, rc 0) 00000100:00100000:2.0:1762166855.922374:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49181:x1847765444421632:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 331us (446us total) trans 8589934774 rc 0/0 00000100:00100000:2.0:1762166855.922379:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 194 00000100:00100000:0.0:1762166855.923558:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.923614:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444421888 00000100:00100000:2.0:1762166855.923621:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444421888 00000100:00100000:2.0:1762166855.923668:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 71 00000100:00100000:2.0:1762166855.923677:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342fe9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49181:x1847765444421888:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166855.923736:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9df71 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9145f expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.923794:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9df7f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.923806:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9df01 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91443 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.923815:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9df7f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.923850:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9df01 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91443 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.923862:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9df01 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91443 expref: 35 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.923876:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451965568:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.923948:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34aab0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.925011:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451965568:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.925032:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9df7f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166855.925356:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.925519:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444422016 00000100:00100000:3.0:1762166855.925526:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444422016 00010000:00010000:3.0:1762166855.925553:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9df01 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91443 expref: 36 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166855.925589:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 682 00000100:00100000:3.0:1762166855.925598:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e078000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765444422016:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166855.925624:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166855.925631:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9df01 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91443 expref: 36 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.925643:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9df01 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91443 expref: 36 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.925673:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9df01 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91443 expref: 36 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.925688:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:3.0:1762166855.925692:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9df7f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.925700:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9df7f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.925706:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9df7f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.925732:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.925782:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9df7f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.925792:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9df7f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166855.925826:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e078000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444422016:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 227us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166855.925836:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 682 00010000:00010000:2.0:1762166855.926037:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9df7f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.926042:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9df7f lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.926046:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9df7f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.926050:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.926053:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9df7f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.926057:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9df7f lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.926064:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:2.0:1762166855.926065:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166855.926068:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9df7f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.926071:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9df7f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.926088:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:2.0:1762166855.926090:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166855.926094:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9df71 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9145f expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166855.926215:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342fe9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49181:x1847765444421888:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2539us (2662us total) trans 8589934775 rc -22/-22 00000100:00100000:2.0:1762166855.926224:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 71 00000100:00100000:0.0:1762166855.927167:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.927244:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444422144 00000100:00100000:2.0:1762166855.927251:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444422144 00000100:00100000:2.0:1762166855.927294:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 195 00000100:00100000:2.0:1762166855.927303:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e07aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49181:x1847765444422144:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.927324:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.927344:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9df86 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91466 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.927396:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9df86 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91466 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.927408:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9df86 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91466 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.927427:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee343a13800) 00010000:00010000:2.0:1762166855.927444:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166855.927447:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d400, rc 0) 00000100:00100000:2.0:1762166855.927491:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e07aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49181:x1847765444422144:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 189us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.927507:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 195 00000100:00100000:3.0:1762166855.929271:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.929319:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444422400 00000100:00100000:2.0:1762166855.929328:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444422400 00000100:00100000:2.0:1762166855.929381:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 196 00000100:00100000:2.0:1762166855.929390:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49181:x1847765444422400:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.929406:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.929422:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9df8d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9146d expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.929958:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9df94 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.929971:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9df94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.929981:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9df94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.929991:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x28:0x0]: returning size 0 00010000:00010000:2.0:1762166855.930039:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9df8d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9146d expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.930057:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9df94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9146d expref: 37 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.930065:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x28:0x0].0x0 (ffff9ee343a13200) 00010000:00010000:2.0:1762166855.930068:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166855.930071:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c400, rc 0) 00000100:00100000:2.0:1762166855.930126:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49181:x1847765444422400:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 736us (859us total) trans 8589934776 rc 0/0 00000100:00100000:2.0:1762166855.930147:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 196 00000100:00100000:0.0:1762166855.931844:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.931957:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444422656 00000100:00100000:2.0:1762166855.931966:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444422656 00000100:00100000:2.0:1762166855.932029:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 197 00000100:00100000:2.0:1762166855.932037:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e07a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49181:x1847765444422656:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.932056:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.932072:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dfa2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91474 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.932151:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9dfa9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.932163:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9dfa9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.932172:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9dfa9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.932184:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166855.932273:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dfa2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91474 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.932289:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9dfa9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91474 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.932297:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee343a13800) 00010000:00010000:2.0:1762166855.932301:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166855.932303:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7da00, rc 0) 00000100:00100000:2.0:1762166855.932355:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e07a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49181:x1847765444422656:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 319us (518us total) trans 8589934777 rc 0/0 00000100:00100000:2.0:1762166855.932368:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 197 00000100:00100000:0.0:1762166855.933936:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.933984:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444422912 00000100:00100000:2.0:1762166855.933992:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444422912 00000100:00100000:2.0:1762166855.934039:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 72 00000100:00100000:2.0:1762166855.934048:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49181:x1847765444422912:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166855.934107:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9dfa9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91474 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.934135:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfb7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.934147:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9df86 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91466 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.934155:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfb7 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.934185:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9df86 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91466 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.934198:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9df86 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91466 expref: 39 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.934211:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451965696:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.934278:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.935458:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451965696:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.935478:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfb7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166855.936166:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.936294:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444423040 00000100:00100000:3.0:1762166855.936302:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444423040 00010000:00010000:3.0:1762166855.936333:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9df86 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91466 expref: 40 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166855.936388:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 683 00000100:00100000:3.0:1762166855.936399:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e07b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2361:x1847765444423040:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166855.936413:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166855.936419:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9df86 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91466 expref: 40 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.936441:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9df86 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91466 expref: 40 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.936470:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9df86 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91466 expref: 40 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.936486:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee343a13800) 00010000:00010000:3.0:1762166855.936489:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfb7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.936498:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfb7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.936505:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfb7 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.936534:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166855.936582:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e07b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444423040:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 185us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166855.936590:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 683 00010000:00010000:2.0:1762166855.936611:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfb7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.936621:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfb7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.936640:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfbe lrc: 3/0,1 mode: --/EX res: [0x200000404:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.936653:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9df94 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9146d expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.936661:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfbe lrc: 4/0,1 mode: --/EX res: [0x200000404:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.936688:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9df94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9146d expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.936701:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9df94 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9146d expref: 38 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.936714:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451965824:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.936795:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.938728:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.938801:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444423168 00000100:00100000:3.0:1762166855.938809:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444423168 00000100:00100000:2.0:1762166855.938850:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451965824:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.938884:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfbe lrc: 3/0,1 mode: --/EX res: [0x200000404:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.938909:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9df94 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9146d expref: 39 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166855.938955:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 684 00000100:00100000:3.0:1762166855.938965:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e079f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444423168:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166855.938980:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166855.938986:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9df94 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9146d expref: 39 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.938997:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9df94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9146d expref: 39 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.939024:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9df94 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9146d expref: 39 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.939041:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x28:0x0].0x0 (ffff9ee343a13200) 00010000:00010000:3.0:1762166855.939046:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfbe lrc: 3/0,1 mode: --/EX res: [0x200000404:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.939056:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfbe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.939063:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfbe lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.939089:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166855.939109:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfbe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x28:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.939125:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfbe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x28:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166855.939143:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e079f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2361:x1847765444423168:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 178us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166855.939152:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 684 00000100:00100000:2.0:1762166855.939507:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451965952:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166855.939544:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166855.939568:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eef480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166855.939582:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451965952 00000100:00100000:3.0:1762166855.939596:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451965952 00000100:00100000:3.0:1762166855.939634:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1762166855.939642:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:31351:x1847765451965952:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166855.939714:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:31351:x1847765451965952:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 72us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166855.939721:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1762166855.939815:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451965952:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166855.939854:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934778 00000001:00080000:2.0:1762166855.939914:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934779 00010000:00010000:2.0:1762166855.939936:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfbe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x28:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.939944:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfbe lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x28:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.939950:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfbe lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x28:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.939956:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.939960:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfbe lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x28:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.939966:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfbe lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x28:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.939977:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x28:0x0].0x0 (ffff9ee343a13200) 00010000:00010000:2.0:1762166855.939979:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166855.939983:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfbe lrc: 2/0,0 mode: --/EX res: [0x200000404:0x28:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.939988:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfbe lrc: 0/0,0 mode: --/EX res: [0x200000404:0x28:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.940011:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfb7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.940017:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfb7 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.940022:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfb7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.940025:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.940028:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfb7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.940034:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfb7 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.940041:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee343a13800) 00010000:00010000:2.0:1762166855.940043:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166855.940046:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfb7 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.940051:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfb7 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.940061:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee343a13800) 00010000:00010000:2.0:1762166855.940063:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166855.940068:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9dfa9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91474 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166855.940137:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49181:x1847765444422912:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 6089us (6205us total) trans 8589934780 rc 0/0 00000100:00100000:2.0:1762166855.940145:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 72 00000020:00080000:2.0:1762166855.940155:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166855.941155:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.941220:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444423296 00000100:00100000:2.0:1762166855.941226:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444423296 00000100:00100000:2.0:1762166855.941264:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 198 00000100:00100000:2.0:1762166855.941271:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e07b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49181:x1847765444423296:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.941285:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.941300:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dfc5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9147b expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.941338:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dfc5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9147b expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.941351:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dfc5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9147b expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.941368:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:2.0:1762166855.941372:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166855.941375:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7ce00, rc 0) 00000100:00100000:2.0:1762166855.941418:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e07b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49181:x1847765444423296:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 147us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.941423:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 198 00000100:00100000:3.0:1762166855.943746:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.943837:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444423552 00000100:00100000:2.0:1762166855.943846:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444423552 00000100:00100000:2.0:1762166855.943891:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 73 00000100:00100000:2.0:1762166855.943902:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49181:x1847765444423552:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762166855.944319:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x28:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166855.944390:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].13, 64 off9216 00000001:00080000:2.0:1762166855.944397:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934781 00010000:00010000:2.0:1762166855.944455:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dfcc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.944469:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dfcc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.944480:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dfcc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.944488:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dfcc lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.944494:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dfcc lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.944499:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dfcc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166855.944523:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166855.944548:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166855.944556:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dfcc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.944565:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7dc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166855.944569:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dfcc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.944577:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dfcc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.944589:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x28:0x0].0x0 (ffff9ee360714600) 00010000:00010000:3.0:1762166855.944593:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166855.944598:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dfcc lrc: 1/0,0 mode: --/PW res: [0x200000404:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.944604:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9dfcc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166855.944621:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166855.944623:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166855.944625:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166855.944637:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49181:x1847765444423552:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 737us (899us total) trans 8589934782 rc 0/0 00000100:00100000:2.0:1762166855.944646:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 73 00000020:00080000:2.0:1762166855.944651:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166855.946019:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.946138:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444423808 00000100:00100000:2.0:1762166855.946145:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444423808 00000100:00100000:2.0:1762166855.946189:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 74 00000100:00100000:2.0:1762166855.946199:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49181:x1847765444423808:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166855.946521:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49181:x1847765444423808:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 322us (506us total) trans 8589934783 rc 0/0 00000100:00100000:2.0:1762166855.946529:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 74 00000100:00100000:0.0:1762166855.955024:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.955118:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444423936 00000100:00100000:2.0:1762166855.955128:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444423936 00000100:00100000:2.0:1762166855.955208:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 199 00000100:00100000:2.0:1762166855.955219:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49183:x1847765444423936:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166855.955256:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.955278:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9dfd3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91482 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.955336:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfda lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955350:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfda lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955361:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfda lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955375:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfe1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955382:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfe1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955389:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfe1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955500:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dfe8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955508:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dfe8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955515:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dfe8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166855.955547:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166855.955558:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166855.955578:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dfe8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955590:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dfe8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955598:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfda lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955604:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfda lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955610:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfda lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955615:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.955619:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfda lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955627:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfda lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955637:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166855.955640:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166855.955645:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfda lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955650:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9dfda lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955664:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfe1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955670:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfe1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955683:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfe1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955688:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166855.955691:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfe1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955696:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfe1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955704:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee360714f00) 00010000:00010000:2.0:1762166855.955707:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166855.955710:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfe1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955715:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9dfe1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.955745:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9dfd3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91482 expref: 45 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.955757:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dfe8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91482 expref: 44 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.955821:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:2.0:1762166855.955823:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166855.955826:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d200, rc 0) 00000100:00100000:2.0:1762166855.955903:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49183:x1847765444423936:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 685us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.955912:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 199 00000100:00100000:3.0:1762166855.957895:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.957973:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444424064 00000100:00100000:0.0:1762166855.957982:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444424064 00000100:00100000:0.0:1762166855.958044:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1085 00000100:00100000:0.0:1762166855.958059:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444424064:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166855.958077:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.958093:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9dfef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91489 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166855.958148:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451966080:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166855.958232:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166855.959208:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451966080:192.168.203.35@tcp:106: 00010000:00010000:1.0:1762166855.959241:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9dfef lrc: 1/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91489 expref: 24 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.959259:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9dfef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91489 expref: 24 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166855.959270:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199e00, rc 0) 00000100:00100000:1.0:1762166855.959327:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444424064:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 1274us (1439us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166855.959335:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1085 00000100:00100000:2.0:1762166855.971506:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.971599:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444424192 00000100:00100000:0.0:1762166855.971608:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444424192 00000100:00100000:0.0:1762166855.971652:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 200 00000100:00100000:0.0:1762166855.971660:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49187:x1847765444424192:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166855.971731:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9dff6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.971747:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9dff6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.971794:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9dff6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.971807:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9dffd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.971814:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9dffd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.971820:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9dffd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.971915:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e004 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.971923:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e004 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.971935:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e004 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166855.971966:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166855.971970:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166855.971980:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e004 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.971991:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9dff6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.971997:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9dff6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972004:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9dff6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972021:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166855.972025:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9dff6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972032:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9dff6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972043:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166855.972046:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166855.972051:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9dff6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972056:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9dff6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972068:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9dffd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972074:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9dffd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972078:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9dffd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972083:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166855.972085:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9dffd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972091:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9dffd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972098:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4c00) 00010000:00010000:0.0:1762166855.972105:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166855.972109:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9dffd lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972114:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9dffd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972128:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e004 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972131:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e004 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972135:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e004 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972137:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166855.972139:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e004 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972142:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e004 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972146:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:0.0:1762166855.972147:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166855.972149:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e004 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.972152:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e004 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166855.972220:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49187:x1847765444424192:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 560us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166855.972227:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 200 00000100:00100000:3.0:1762166855.981578:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.981646:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444424448 00000100:00100000:0.0:1762166855.981654:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444424448 00000100:00100000:0.0:1762166855.981699:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 201 00000100:00100000:0.0:1762166855.981718:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49189:x1847765444424448:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.981738:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.981797:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e00b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91490 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.981882:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e012 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.981895:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e012 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.981906:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e012 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166855.981916:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166855.982026:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e00b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91490 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.982043:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e012 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91490 expref: 46 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.982051:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:0.0:1762166855.982054:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166855.982057:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199e00, rc 0) 00000100:00100000:0.0:1762166855.982117:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49189:x1847765444424448:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 410us (549us total) trans 8589934784 rc 0/0 00000100:00100000:0.0:1762166855.982123:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 201 00000100:00100000:1.0:1762166855.983616:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.983671:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444424576 00000100:00100000:0.0:1762166855.983677:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444424576 00000100:00100000:0.0:1762166855.983714:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1086 00000100:00100000:0.0:1762166855.983720:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444424576:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.983729:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.983743:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e020 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91497 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166855.983818:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451966208:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166855.983890:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.984936:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451966208:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166855.984967:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e020 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91497 expref: 24 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166855.984985:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e020 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91497 expref: 24 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166855.984997:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198400, rc 0) 00000100:00100000:0.0:1762166855.985040:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444424576:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1318us (1425us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166855.985047:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1086 00000100:00100000:3.0:1762166855.986411:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.986474:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444424832 00000100:00100000:0.0:1762166855.986481:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444424832 00000100:00100000:0.0:1762166855.986535:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 202 00000100:00100000:0.0:1762166855.986550:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49189:x1847765444424832:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.986573:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.986597:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9e027 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9149e expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.986682:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e02e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.986696:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dfe8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91482 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.986704:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e02e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.986731:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dfe8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91482 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.986744:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dfe8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91482 expref: 47 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166855.986756:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451966336:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166855.986879:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.988230:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451966336:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166855.988273:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e02e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166855.988386:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166855.988454:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444424960 00000100:00100000:1.0:1762166855.988464:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444424960 00010000:00010000:1.0:1762166855.988510:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dfe8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91482 expref: 48 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166855.988585:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 685 00000100:00100000:1.0:1762166855.988596:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2361:x1847765444424960:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166855.988613:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166855.988621:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dfe8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91482 expref: 48 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.988670:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dfe8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91482 expref: 48 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.988695:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9dfe8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91482 expref: 48 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166855.988714:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:1.0:1762166855.988720:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e02e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166855.988729:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e02e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166855.988737:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e02e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166855.988803:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166855.988861:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:2361:x1847765444424960:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 266us (476us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166855.988865:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e02e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166855.988877:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 685 00010000:00010000:0.0:1762166855.988887:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e02e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166855.988906:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166855.989053:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9e027 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9149e expref: 48 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.989071:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e02e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9149e expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.989080:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:0.0:1762166855.989083:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166855.989086:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198200, rc 0) 00000100:00100000:0.0:1762166855.989139:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49189:x1847765444424832:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2595us (2729us total) trans 8589934785 rc 0/0 00000100:00100000:0.0:1762166855.989147:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 202 00000100:00100000:3.0:1762166855.990591:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.990629:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444425216 00000100:00100000:0.0:1762166855.990637:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444425216 00000100:00100000:0.0:1762166855.990699:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 203 00000100:00100000:0.0:1762166855.990708:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49189:x1847765444425216:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.990733:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.990750:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e03c lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f914a5 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.991359:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e043 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.991379:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e043 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.991389:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e043 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166855.991399:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x29:0x0]: returning size 0 00010000:00010000:0.0:1762166855.991467:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e03c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914a5 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.991480:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e043 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914a5 expref: 49 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.991495:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x29:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:0.0:1762166855.991498:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166855.991501:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199600, rc 0) 00000100:00100000:0.0:1762166855.991560:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49189:x1847765444425216:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 853us (972us total) trans 8589934786 rc 0/0 00000100:00100000:0.0:1762166855.991568:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 203 00000100:00100000:1.0:1762166855.992937:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166855.992970:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444425472 00000100:00100000:0.0:1762166855.992977:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444425472 00000100:00100000:0.0:1762166855.993012:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 204 00000100:00100000:0.0:1762166855.993021:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49189:x1847765444425472:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166855.993036:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166855.993046:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e051 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f914ac expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.993100:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e058 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.993111:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e043 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914a5 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.993127:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e058 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.993157:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e043 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914a5 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.993179:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e043 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914a5 expref: 50 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166855.993191:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451966464:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166855.993249:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166855.994064:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451966464:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166855.994088:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e058 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166855.994274:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166855.994422:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444425600 00000100:00100000:3.0:1762166855.994441:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444425600 00010000:00010000:3.0:1762166855.994485:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e043 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914a5 expref: 51 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166855.994514:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 686 00000100:00100000:3.0:1762166855.994521:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2360:x1847765444425600:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166855.994534:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166855.994539:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e043 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914a5 expref: 51 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.994551:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e043 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914a5 expref: 51 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.994573:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e043 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914a5 expref: 51 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166855.994591:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x29:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:3.0:1762166855.994596:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e058 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166855.994605:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e058 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166855.994613:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e058 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166855.994640:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166855.994661:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e058 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.994671:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e058 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166855.994691:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x29:0x0]: returning size 0 00000100:00100000:3.0:1762166855.994696:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2360:x1847765444425600:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 175us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166855.994703:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 686 00000004:00080000:0.0:1762166855.995093:0:30817:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x87:0x0], index 0: 0 00010000:00010000:0.0:1762166855.995268:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e058 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.995277:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e058 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.995284:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e058 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.995290:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166855.995294:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e058 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.995313:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e058 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.995323:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x29:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:0.0:1762166855.995325:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166855.995329:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e058 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.995335:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e058 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166855.995391:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e051 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914ac expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.995401:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166855.995403:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166855.995407:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e051 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914ac expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166855.995416:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198a00, rc 0) 00000100:00100000:0.0:1762166855.995468:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49189:x1847765444425472:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2448us (2534us total) trans 8589934787 rc 301/301 00000100:00100000:0.0:1762166855.995476:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 204 00000100:00100000:1.0:1762166855.996447:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.996512:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444425856 00000100:00100000:2.0:1762166855.996522:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444425856 00000100:00100000:2.0:1762166855.996571:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 75 00000100:00100000:2.0:1762166855.996583:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49189:x1847765444425856:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166855.996903:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49189:x1847765444425856:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 322us (457us total) trans 8589934788 rc 0/0 00000100:00100000:2.0:1762166855.996912:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 75 00000100:00100000:0.0:1762166855.997979:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166855.998033:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444425984 00000100:00100000:2.0:1762166855.998043:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444425984 00000100:00100000:2.0:1762166855.998102:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 205 00000100:00100000:2.0:1762166855.998117:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49189:x1847765444425984:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166855.998152:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166855.998169:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e066 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f914b3 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.998253:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e06d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.998268:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e02e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9149e expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.998277:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e06d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166855.998308:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e02e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9149e expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166855.998321:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e02e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9149e expref: 51 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166855.998357:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451966592:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166855.998538:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eef480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166855.999666:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451966592:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166855.999684:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e06d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166856.000046:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.000097:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444426112 00000100:00100000:3.0:1762166856.000110:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444426112 00010000:00010000:3.0:1762166856.000153:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e02e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9149e expref: 52 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166856.000201:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 687 00000100:00100000:3.0:1762166856.000213:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2360:x1847765444426112:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.000230:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.000237:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e02e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9149e expref: 52 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.000253:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e02e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9149e expref: 52 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.000278:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e02e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9149e expref: 52 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.000298:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:3.0:1762166856.000303:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e06d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.000313:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e06d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.000322:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e06d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.000372:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166856.000441:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2360:x1847765444426112:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 217us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.000452:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 687 00010000:00010000:2.0:1762166856.000461:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e06d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.000485:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e06d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.000545:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166856.000550:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166856.000593:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e06d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.000643:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e066 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914b3 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.000672:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e06d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914b3 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.000696:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:2.0:1762166856.000700:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166856.000703:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d400, rc 0) 00000100:00100000:2.0:1762166856.000887:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49189:x1847765444425984:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2774us (2914us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.000921:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 205 00000100:00100000:0.0:1762166856.002224:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.002324:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444426240 00000100:00100000:1.0:1762166856.002337:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444426240 00000100:00080000:3.0:1762166856.002406:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166856.002440:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1087 00000100:00100000:1.0:1762166856.002454:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444426240:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166856.002475:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166856.002497:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e074 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f914ba expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166856.002565:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451966720:192.168.203.35@tcp:106: 00000100:00100000:1.0:1762166856.002668:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee351428480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166856.003736:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451966720:192.168.203.35@tcp:106: 00010000:00010000:1.0:1762166856.003824:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e074 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914ba expref: 24 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.003851:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e074 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914ba expref: 24 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.003867:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159600, rc 0) 00000100:00100000:1.0:1762166856.003928:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444426240:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1477us (1707us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166856.003938:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1087 00000100:00100000:0.0:1762166856.005371:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.005448:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444426368 00000100:00100000:2.0:1762166856.005457:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444426368 00000100:00080000:3.0:1762166856.005502:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166856.005528:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 206 00000100:00100000:2.0:1762166856.005539:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49189:x1847765444426368:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.005558:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.005586:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e07b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f914c1 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.005653:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e082 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.005666:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e082 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.005677:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e082 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.005708:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x29:0x0]: returning size 0 00000004:00200000:2.0:1762166856.005713:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166856.005728:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e082 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.005751:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e07b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914c1 expref: 52 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.005795:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e082 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914c1 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.005805:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x29:0x0].0x0 (ffff9ee360714f00) 00010000:00010000:2.0:1762166856.005821:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166856.005825:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c400, rc 0) 00000100:00100000:2.0:1762166856.005883:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49189:x1847765444426368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 345us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.005890:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 206 00000100:00100000:0.0:1762166856.007110:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.007172:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444426496 00000100:00100000:1.0:1762166856.007179:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444426496 00000100:00080000:3.0:1762166856.007231:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166856.007234:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1088 00000100:00100000:1.0:1762166856.007246:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765444426496:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166856.007269:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166856.007284:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e089 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f914c8 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166856.007308:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762166856.007322:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166856.007325:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166856.007332:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e089 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914c8 expref: 25 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.007345:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e089 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914c8 expref: 25 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.007356:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159800, rc 0) 00000100:00100000:1.0:1762166856.007400:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444426496:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 156us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.007406:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1088 00000100:00100000:3.0:1762166856.008903:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.008941:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444426752 00000100:00100000:2.0:1762166856.008948:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444426752 00000100:00100000:2.0:1762166856.008987:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 207 00000100:00100000:2.0:1762166856.008996:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49189:x1847765444426752:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.009011:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.009026:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e090 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f914cf expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.009108:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e097 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.009120:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e097 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.009130:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e097 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.009142:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166856.009255:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e090 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914cf expref: 54 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.009271:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e097 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914cf expref: 53 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.009279:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:2.0:1762166856.009292:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166856.009295:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7cc00, rc 0) 00000100:00100000:2.0:1762166856.009349:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49189:x1847765444426752:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 353us (450us total) trans 8589934789 rc 0/0 00000100:00100000:2.0:1762166856.009356:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 207 00000100:00100000:0.0:1762166856.011102:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.011187:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444426880 00000100:00100000:1.0:1762166856.011203:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444426880 00000100:00100000:1.0:1762166856.011282:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1089 00000100:00100000:1.0:1762166856.011299:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444426880:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166856.011321:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166856.011345:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9e0a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f914d6 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166856.011416:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451966848:192.168.203.35@tcp:106: 00000100:00100000:1.0:1762166856.011539:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee351428480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166856.013164:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451966848:192.168.203.35@tcp:106: 00010000:00010000:1.0:1762166856.013199:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9e0a5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914d6 expref: 24 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.013231:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9e0a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914d6 expref: 24 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.013244:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159200, rc 0) 00000100:00100000:1.0:1762166856.013298:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444426880:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2006us (2201us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166856.013308:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1089 00000100:00100000:3.0:1762166856.014665:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.014714:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444427008 00000100:00100000:1.0:1762166856.014721:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444427008 00000100:00100000:1.0:1762166856.014790:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1090 00000100:00100000:1.0:1762166856.014801:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444427008:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166856.014814:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166856.014828:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e0ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f914dd expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166856.014873:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451966976:192.168.203.35@tcp:106: 00000100:00100000:1.0:1762166856.014933:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee351428480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166856.015960:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451966976:192.168.203.35@tcp:106: 00010000:00010000:1.0:1762166856.015990:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e0ac lrc: 1/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914dd expref: 24 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.016008:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e0ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914dd expref: 24 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.016031:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159600, rc 0) 00000100:00100000:1.0:1762166856.016079:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444427008:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1280us (1418us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166856.016086:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1090 00000100:00100000:0.0:1762166856.017324:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.017370:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444427136 00000100:00100000:1.0:1762166856.017377:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444427136 00000100:00100000:1.0:1762166856.017416:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1091 00000100:00100000:1.0:1762166856.017425:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444427136:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762166856.017470:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e0b3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.017487:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9dede lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91435 expref: 23 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.017496:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166856.017498:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166856.017501:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e0b3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.017530:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9dede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91435 expref: 23 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.017543:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9dede lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91435 expref: 23 pid: 7858 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166856.017557:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451967104:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166856.017626:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee351428480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166856.018495:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765451967104:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.018513:0:7858:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e0b3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.018794:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.018878:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444427264 00000100:00100000:3.0:1762166856.018885:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444427264 00010000:00010000:3.0:1762166856.018910:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9dede lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91435 expref: 24 pid: 7858 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166856.018946:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 688 00000100:00100000:3.0:1762166856.018955:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765444427264:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.018967:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.018987:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9dede lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91435 expref: 24 pid: 7858 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.019000:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9dede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91435 expref: 24 pid: 7858 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.019031:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9dede lrc: 0/0,0 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91435 expref: 24 pid: 7858 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.019045:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166856.019060:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166856.019065:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e0b3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.019073:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e0b3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.019104:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166856.019149:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444427264:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 194us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.019171:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 688 00010000:00010000:1.0:1762166856.019186:0:7858:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e0b3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.019205:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e0b3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.019247:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e0b3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.019257:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e0b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.019266:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e0b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.019273:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166856.019278:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e0b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.019287:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e0b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.019325:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e0b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.019332:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e0b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166856.019422:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765444427136:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 1996us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.019443:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1091 00000100:00100000:0.0:1762166856.020813:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.020862:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444427392 00000100:00100000:1.0:1762166856.020874:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444427392 00000100:00100000:1.0:1762166856.020932:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1092 00000100:00100000:1.0:1762166856.020945:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765444427392:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166856.020965:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166856.020986:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e0ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f914e4 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166856.021008:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x86:0x0] initial LVB size: 0, mtime: 0x69088847, atime: 0x69088847, ctime: 0x69088848, blocks: 0x1 00010000:00010000:1.0:1762166856.021028:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166856.021031:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166856.021040:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e0ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914e4 expref: 23 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.021056:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e0ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914e4 expref: 23 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.021087:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159e00, rc 0) 00000100:00100000:1.0:1762166856.021142:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2358:x1847765444427392:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 201us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.021149:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1092 00000100:00100000:3.0:1762166856.045250:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.045346:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444427520 00000100:00100000:2.0:1762166856.045356:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444427520 00000100:00100000:2.0:1762166856.045412:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 208 00000100:00100000:2.0:1762166856.045422:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49189:x1847765444427520:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:2.0:1762166856.061149:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934787 is committed 00000020:00080000:2.0:1762166856.061183:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969115 batchid updated 00000001:00080000:2.0:1762166856.061200:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934789 is committed 00000020:00080000:1.0:1762166856.061223:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969115 00000020:00080000:1.0:1762166856.061238:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969115 00000100:00100000:0.0:1762166856.061239:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:49189:x1847765444427520:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 15812us (15993us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.061252:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 208 00000020:00080000:2.0:1762166856.061263:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee36cb75d80 refcount 2 committed 0 result 0 batchid 4294969116 00000020:00080000:2.0:1762166856.061269:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee343eae000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee36cb75c00 00000020:00080000:2.0:1762166856.061273:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee34ad8a600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee36e365800 00000020:00080000:1.0:1762166856.061311:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969116 committed batchid 4294969115 00000020:00080000:1.0:1762166856.061501:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969115 00000100:00100000:0.0:1762166856.062956:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.063079:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444427648 00000100:00100000:1.0:1762166856.063088:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444427648 00000100:00100000:1.0:1762166856.063143:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1093 00000100:00100000:1.0:1762166856.063152:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444427648:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:1.0:1762166856.063246:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444427648:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 95us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.063253:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1093 00000100:00100000:3.0:1762166856.070304:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.070377:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444427776 00000100:00100000:2.0:1762166856.070386:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444427776 00000100:00100000:2.0:1762166856.070447:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1094 00000100:00100000:2.0:1762166856.070458:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2359:x1847765444427776:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166856.070500:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e0c1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.070513:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.070515:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.070520:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e0c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.070551:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e0c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.070573:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e0c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.070578:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e0c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.070584:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e0c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.070588:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7c600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166856.070590:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e0c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.070595:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e0c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.070608:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e0c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.070614:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e0c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.070680:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2359:x1847765444427776:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 225us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.070693:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1094 00000100:00100000:3.0:1762166856.071985:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.072049:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444428032 00000100:00100000:0.0:1762166856.072056:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444428032 00000100:00100000:0.0:1762166856.072113:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 209 00000100:00100000:0.0:1762166856.072123:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49189:x1847765444428032:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166856.072171:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.072193:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e082 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914c1 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.072205:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x29:0x0].0x0 (ffff9ee360714f00) 00010000:00010000:0.0:1762166856.072212:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.072250:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e0c8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.072261:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e0c8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.072269:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e0c8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762166856.072440:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004b6a0eae reply state 0000000085ae13cf transno 8589934790 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e0c8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166856.072449:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166856.072540:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49189:x1847765444428032:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 418us (559us total) trans 8589934790 rc 0/0 00000100:00100000:0.0:1762166856.072547:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 209 00010000:00010000:3.0:1762166856.074025:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e0c8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.074039:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e0c8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.074046:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e0c8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.074053:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166856.074057:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e0c8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.074064:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e0c8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.074077:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x29:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:3.0:1762166856.074080:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166856.074096:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e0c8 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.074103:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e0c8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166856.074260:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.074374:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444428160 00000100:00100000:0.0:1762166856.074382:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444428160 00000100:00100000:0.0:1762166856.074445:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 210 00000100:00100000:0.0:1762166856.074455:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49189:x1847765444428160:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.074474:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.074489:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e0cf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f914eb expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.074536:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e0cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914eb expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.074545:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e0cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914eb expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.074556:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x29:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:0.0:1762166856.074558:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166856.074560:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199000, rc 0) 00000100:00100000:0.0:1762166856.074611:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49189:x1847765444428160:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 157us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.074617:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 210 00000100:00100000:0.0:1762166856.076090:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.076139:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444428288 00000100:00100000:2.0:1762166856.076147:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444428288 00000100:00100000:2.0:1762166856.076195:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1095 00000100:00100000:2.0:1762166856.076205:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:49189:x1847765444428288:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.076232:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.076247:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e0d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f914f2 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.076283:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e089 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914c8 expref: 26 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.076292:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.076295:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.076299:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e0d6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f2 expref: 26 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.076332:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e089 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914c8 expref: 26 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.076347:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e089 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914c8 expref: 26 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166856.076361:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451967232:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.076443:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eefd80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.077683:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451967232:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.077718:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e0d6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f2 expref: 26 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.077735:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d200, rc 0) 00000100:00100000:2.0:1762166856.077796:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49189:x1847765444428288:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1592us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.077805:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1095 00000100:00100000:0.0:1762166856.078611:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.078658:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444428416 00000100:00100000:3.0:1762166856.078666:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444428416 00010000:00010000:3.0:1762166856.078697:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e089 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914c8 expref: 26 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:3.0:1762166856.078732:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 689 00000100:00100000:3.0:1762166856.078741:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444428416:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.078754:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.078807:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e089 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914c8 expref: 26 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:3.0:1762166856.078821:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e089 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914c8 expref: 26 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:3.0:1762166856.078843:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e089 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914c8 expref: 26 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:3.0:1762166856.078856:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166856.078858:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166856.078869:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e0d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f2 expref: 25 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.078883:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e0d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f2 expref: 25 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.078925:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e0d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f2 expref: 25 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166856.078939:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e07b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765451967360:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762166856.079003:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350460240 going to sleep for 11 seconds 00000100:00100000:1.0:1762166856.080950:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.080999:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e07b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765451967360:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762166856.081032:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166856.081083:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444428544 00000100:00100000:2.0:1762166856.081092:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444428544 00000100:00100000:3.0:1762166856.081093:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444428416:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 2350us (2482us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.081105:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 689 00000100:00100000:2.0:1762166856.081152:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1096 00000100:00100000:2.0:1762166856.081162:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444428544:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166856.081418:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166856.081422:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x87:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:2.0:1762166856.081425:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x87:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:2.0:1762166856.081437:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x87:0x0] updating lvb ctime from disk: 0 -> 1762166856 00002000:00010000:2.0:1762166856.081440:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x87:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166856.081532:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444428544:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 370us (597us total) trans 21474836775 rc 0/0 00000100:00100000:2.0:1762166856.081540:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1096 00000100:00100000:1.0:1762166856.083099:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.083198:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444428800 00000100:00100000:0.0:1762166856.083208:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444428800 00000100:00100000:0.0:1762166856.083297:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 211 00000100:00100000:0.0:1762166856.083307:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49189:x1847765444428800:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166856.083385:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.083420:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e06d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914b3 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.083454:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:0.0:1762166856.083460:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.083511:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e0dd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.083527:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e0dd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.083538:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e0dd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762166856.083709:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003c92abe6 reply state 000000007f6a09f3 transno 8589934791 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e0dd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166856.083719:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166856.083888:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49189:x1847765444428800:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 580us (798us total) trans 8589934791 rc 0/0 00000100:00100000:0.0:1762166856.083896:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 211 00010000:00010000:2.0:1762166856.085259:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e0dd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.085272:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e0dd lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.085280:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e0dd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.085302:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.085306:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e0dd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.085313:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e0dd lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.085326:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:2.0:1762166856.085328:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166856.085332:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e0dd lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.085336:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e0dd lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166856.085689:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.085992:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444428928 00000100:00100000:2.0:1762166856.086003:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444428928 00000100:00100000:2.0:1762166856.086069:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1097 00000100:00100000:2.0:1762166856.086083:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:49189:x1847765444428928:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.086101:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.086120:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9e0e4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f914f9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.086149:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e0ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914e4 expref: 24 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.086158:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.086160:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.086164:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9e0e4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f9 expref: 24 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.086216:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e0ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914e4 expref: 24 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.086230:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e0ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914e4 expref: 24 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:2.0:1762166856.086245:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451967488:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.086327:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eefd80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.087997:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451967488:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.088026:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9e0e4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f9 expref: 24 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.088045:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7da00, rc 0) 00000100:00100000:2.0:1762166856.088111:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:49189:x1847765444428928:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2032us (2439us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.088123:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1097 00000100:00100000:0.0:1762166856.089723:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.089912:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444429056 00000100:00100000:3.0:1762166856.089919:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444429056 00010000:00010000:3.0:1762166856.089953:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e0ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914e4 expref: 24 pid: 7858 timeout: 576 lvb_type: 1 00000100:00100000:3.0:1762166856.089996:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 690 00000100:00100000:3.0:1762166856.090005:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444429056:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.090020:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.090040:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e0ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914e4 expref: 24 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:3.0:1762166856.090050:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e0ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914e4 expref: 24 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:3.0:1762166856.090084:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e0ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914e4 expref: 24 pid: 7858 timeout: 576 lvb_type: 1 00010000:00010000:3.0:1762166856.090099:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166856.090101:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166856.090105:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9e0e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f9 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.090115:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9e0e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f9 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.090147:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9e0e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f9 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166856.090158:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e07b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765451967616:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762166856.090220:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350460240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166856.092020:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e07b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765451967616:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762166856.092031:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166856.092086:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166856.092120:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444429184 00000100:00100000:2.0:1762166856.092127:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444429184 00000100:00100000:3.0:1762166856.092142:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444429056:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 2136us (2422us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.092153:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 690 00000100:00100000:2.0:1762166856.092186:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1098 00000100:00100000:2.0:1762166856.092197:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444429184:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166856.092372:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x86:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166856.092375:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x86:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:2.0:1762166856.092378:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x86:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:2.0:1762166856.092380:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x86:0x0] updating lvb ctime from disk: 1762166856 -> 1762166856 00002000:00010000:2.0:1762166856.092394:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x86:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166856.092446:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444429184:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 252us (417us total) trans 17179869446 rc 0/0 00000100:00100000:2.0:1762166856.092454:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1098 00000100:00100000:0.0:1762166856.093647:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.093714:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444429440 00000100:00100000:2.0:1762166856.093721:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444429440 00000100:00100000:2.0:1762166856.093787:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 76 00000100:00100000:2.0:1762166856.093796:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342feb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49189:x1847765444429440:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166856.093866:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e097 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914cf expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.093902:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e0eb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.093915:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dfc5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9147b expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.093923:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e012 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91490 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.093931:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e0eb lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.093965:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e012 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91490 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.093979:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e012 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91490 expref: 27 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166856.093992:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451967744:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.094078:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dfc5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9147b expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.094087:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dfc5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9147b expref: 27 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166856.094097:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451967872:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.094121:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eefd80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.095732:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451967872:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166856.095737:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.095755:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451967744:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166856.095827:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166856.095829:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e0eb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166856.095880:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444429568 00000100:00100000:3.0:1762166856.095958:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444429568 00010000:00010000:3.0:1762166856.095996:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dfc5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9147b expref: 28 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166856.096065:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 691 00000100:00100000:3.0:1762166856.096075:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444429568:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.096088:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166856.096092:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444429824 00010000:00010000:3.0:1762166856.096097:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dfc5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9147b expref: 28 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166856.096099:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444429824 00010000:00010000:3.0:1762166856.096113:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dfc5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9147b expref: 29 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.096137:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9dfc5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9147b expref: 29 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166856.096147:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 77 00010000:00010000:3.0:1762166856.096156:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00000100:00100000:0.0:1762166856.096160:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:37762:x1847765444429824:12345-192.168.203.35@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1762166856.096163:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e0eb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166856.096176:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e0eb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166856.096184:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166856.096252:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444429568:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 168us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.096261:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 691 00000100:00100000:0.0:1762166856.096370:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:37762:x1847765444429824:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 213us (637us total) trans 8589934792 rc 0/0 00000100:00100000:0.0:1762166856.096385:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 77 00000100:00100000:1.0:1762166856.098112:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.098167:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444429952 00000100:00100000:3.0:1762166856.098177:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444429952 00010000:00010000:3.0:1762166856.098226:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e012 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91490 expref: 28 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166856.098285:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 692 00000100:00100000:3.0:1762166856.098297:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444429952:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.098318:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.098326:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e012 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91490 expref: 28 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.098339:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e012 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91490 expref: 28 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.098364:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e012 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91490 expref: 28 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.098381:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:3.0:1762166856.098387:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e0eb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166856.098397:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e0eb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166856.098405:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e0eb lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166856.098445:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166856.098522:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444429952:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 227us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.098530:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 692 00010000:00010000:2.0:1762166856.098647:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e0eb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.098664:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e0eb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.098697:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e0f2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.098713:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e0cf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914eb expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.098721:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e0f2 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x29:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.098787:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e0cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914eb expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.098819:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e0cf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914eb expref: 26 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166856.098835:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451968000:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.098930:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eefd80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166856.100292:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.100300:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451968000:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.100332:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e0f2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x29:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166856.100360:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444430080 00000100:00100000:3.0:1762166856.100368:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444430080 00010000:00010000:3.0:1762166856.100476:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e0cf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914eb expref: 27 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166856.100516:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 693 00000100:00100000:3.0:1762166856.100526:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444430080:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.100540:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.100547:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e0cf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914eb expref: 27 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.100559:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e0cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914eb expref: 27 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.100578:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e0cf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914eb expref: 27 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.100596:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x29:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:3.0:1762166856.100601:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e0f2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x29:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166856.100610:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e0f2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x29:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166856.100618:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e0f2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x29:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166856.100647:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166856.100701:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444430080:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 176us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.100709:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 693 00010000:00010000:2.0:1762166856.100856:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e0f2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.100865:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e0f2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166856.101263:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451968128:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166856.101317:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166856.101358:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eefd80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.101440:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451968128 00000100:00100000:0.0:1762166856.101445:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451968128 00000100:00100000:0.0:1762166856.101492:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1762166856.101500:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:31351:x1847765451968128:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166856.101576:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:31351:x1847765451968128:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 77us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.101584:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1762166856.101722:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451968128:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166856.101759:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451968256:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166856.101807:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166856.101831:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eefd80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.101878:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451968256 00000100:00100000:0.0:1762166856.101883:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451968256 00000100:00100000:0.0:1762166856.101908:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1762166856.101914:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:31351:x1847765451968256:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166856.102124:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:31351:x1847765451968256:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 208us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.102131:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1762166856.102178:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451968256:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166856.102342:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934793 00000100:00100000:2.0:1762166856.102390:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451968384:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166856.102425:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166856.102460:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eef480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.102551:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451968384 00000100:00100000:0.0:1762166856.102555:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451968384 00000100:00100000:0.0:1762166856.102613:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1762166856.102621:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:31351:x1847765451968384:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166856.102759:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:31351:x1847765451968384:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 138us (332us total) trans 21474836776 rc 0/0 00000100:00100000:0.0:1762166856.102809:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1762166856.102819:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451968384:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166856.102885:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934794 00010000:00010000:2.0:1762166856.102914:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e0f2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.102924:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e0f2 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.102932:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e0f2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.102938:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.102942:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e0f2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.102950:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e0f2 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.102964:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x29:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:2.0:1762166856.102967:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166856.102972:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e0f2 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.102977:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e0f2 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.102997:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e0eb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.103003:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e0eb lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.103019:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e0eb lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.103024:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7dc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.103026:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e0eb lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.103032:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e0eb lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.103040:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:2.0:1762166856.103043:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166856.103046:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e0eb lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.103051:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e0eb lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166856.103062:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee360714200) 00010000:00010000:2.0:1762166856.103064:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166856.103068:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e097 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914cf expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.103134:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342feb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49189:x1847765444429440:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 9341us (9492us total) trans 8589934795 rc 0/0 00000100:00100000:2.0:1762166856.103141:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 76 00000020:00080000:2.0:1762166856.103143:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1762166856.103936:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166856.104294:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.104355:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444430208 00000100:00100000:0.0:1762166856.104362:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444430208 00000100:00100000:0.0:1762166856.104401:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 212 00000100:00100000:0.0:1762166856.104410:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49189:x1847765444430208:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.104452:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.104470:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e0f9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91500 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.104520:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e0f9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91500 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.104533:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e0f9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91500 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.104550:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.104553:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166856.104556:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198a00, rc 0) 00000100:00100000:0.0:1762166856.104597:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49189:x1847765444430208:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 189us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.104601:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 212 00000100:00100000:3.0:1762166856.106038:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.106441:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444430464 00000100:00100000:2.0:1762166856.106450:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444430464 00000100:00100000:2.0:1762166856.106511:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 78 00000100:00100000:2.0:1762166856.106527:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e07b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49189:x1847765444430464:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166856.106851:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e07b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49189:x1847765444430464:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 325us (818us total) trans 8589934796 rc 0/0 00000100:00100000:2.0:1762166856.106860:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 78 00000100:00100000:2.0:1762166856.108145:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.108184:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444430720 00000100:00100000:3.0:1762166856.108192:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444430720 00000100:00100000:3.0:1762166856.108236:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 79 00000100:00100000:3.0:1762166856.108245:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49189:x1847765444430720:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:3.0:1762166856.108489:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x29:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166856.108602:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9e100 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166856.108617:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9e100 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166856.108627:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9e100 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166856.108635:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9e100 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166856.108642:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9e100 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166856.108647:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9e100 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166856.108663:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166856.108695:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166856.108718:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9e100 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166856.108726:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166856.108740:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9e100 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166856.108751:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9e100 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166856.108756:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49189:x1847765444430720:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 510us (613us total) trans 8589934797 rc 0/0 00000100:00100000:3.0:1762166856.108790:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 79 00010000:00010000:1.0:1762166856.108803:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x29:0x0].0x0 (ffff9ee363960400) 00010000:00010000:1.0:1762166856.108808:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166856.108814:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9e100 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166856.108820:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9e100 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166856.108840:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166856.108842:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166856.108844:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166856.117816:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.117857:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444430848 00000100:00100000:0.0:1762166856.117868:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444430848 00000100:00100000:0.0:1762166856.117918:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 213 00000100:00100000:0.0:1762166856.117926:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49191:x1847765444430848:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166856.117945:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.117961:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e107 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91507 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.118007:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e10e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118018:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e10e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118038:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e10e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118046:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e115 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118050:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e115 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118054:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e115 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118143:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e11c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118150:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e11c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118158:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e11c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.118188:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166856.118192:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166856.118208:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e11c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118218:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e11c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118225:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e10e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118230:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e10e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118246:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e10e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118252:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.118255:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e10e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118261:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e10e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118272:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166856.118274:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.118278:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e10e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118282:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e10e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118292:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e115 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118297:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e115 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118301:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e115 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118305:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.118308:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e115 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118312:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e115 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118324:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4200) 00010000:00010000:0.0:1762166856.118326:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.118329:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e115 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118334:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e115 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.118362:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e107 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91507 expref: 32 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.118375:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e11c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91507 expref: 31 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.118381:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.118383:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166856.118386:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198200, rc 0) 00000100:00100000:0.0:1762166856.118451:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49191:x1847765444430848:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 525us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.118459:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 213 00000100:00100000:0.0:1762166856.133927:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.134000:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444430976 00000100:00100000:2.0:1762166856.134017:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444430976 00000100:00100000:2.0:1762166856.134106:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 214 00000100:00100000:2.0:1762166856.134120:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49195:x1847765444430976:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166856.134227:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e123 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134247:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e123 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134266:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e123 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134284:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e12a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134291:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e12a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134297:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e12a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134420:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e131 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134438:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e131 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134467:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e131 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.134509:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166856.134514:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166856.134527:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e131 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134541:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e123 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134548:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e123 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134555:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e123 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134561:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7dc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.134566:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e123 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134578:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e123 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134591:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166856.134594:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166856.134608:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e123 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134614:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e123 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134632:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e12a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134644:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e12a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134650:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e12a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134655:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.134658:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e12a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134664:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e12a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134672:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee343a13800) 00010000:00010000:2.0:1762166856.134675:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166856.134677:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e12a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134683:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e12a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134701:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e131 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134712:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e131 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134718:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e131 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134723:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.134725:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e131 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134737:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e131 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134745:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166856.134747:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166856.134751:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e131 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.134756:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e131 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166856.134883:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49195:x1847765444430976:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 765us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.134892:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 214 00000100:00100000:2.0:1762166856.144595:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.144693:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444431232 00000100:00100000:0.0:1762166856.144703:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444431232 00000100:00100000:0.0:1762166856.144790:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 215 00000100:00100000:0.0:1762166856.144803:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49197:x1847765444431232:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.144823:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.144839:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e138 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9150e expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.144926:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e13f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.144936:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e13f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.144944:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e13f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.144951:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166856.145048:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e138 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9150e expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.145064:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e13f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9150e expref: 33 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.145072:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.145075:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166856.145078:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199e00, rc 0) 00000100:00100000:0.0:1762166856.145131:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49197:x1847765444431232:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 329us (544us total) trans 8589934798 rc 0/0 00000100:00100000:0.0:1762166856.145138:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 215 00000100:00100000:1.0:1762166856.147179:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.147224:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444431488 00000100:00100000:0.0:1762166856.147231:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444431488 00000100:00100000:0.0:1762166856.147286:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 216 00000100:00100000:0.0:1762166856.147296:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49197:x1847765444431488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.147314:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.147329:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e14d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91515 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.147420:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e154 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.147447:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e11c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91507 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.147456:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e154 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.147489:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e11c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91507 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.147502:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e11c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91507 expref: 34 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166856.147514:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451968512:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.147586:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.148573:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451968512:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.148597:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e154 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166856.148706:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.148837:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444431616 00000100:00100000:3.0:1762166856.148844:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444431616 00010000:00010000:3.0:1762166856.148869:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e11c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91507 expref: 35 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166856.148918:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 694 00000100:00100000:3.0:1762166856.148932:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444431616:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.148944:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.148950:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e11c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91507 expref: 35 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.148961:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e11c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91507 expref: 35 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.148979:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e11c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91507 expref: 35 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.148992:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:3.0:1762166856.148997:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e154 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.149005:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e154 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.149011:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e154 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.149036:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.149057:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e154 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.149078:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e154 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166856.149082:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765444431616:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 150us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.149093:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 694 00000004:00200000:0.0:1762166856.149093:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166856.149227:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e14d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91515 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.149249:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e154 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91515 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.149257:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.149260:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166856.149262:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198800, rc 0) 00000100:00100000:0.0:1762166856.149299:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49197:x1847765444431488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2005us (2126us total) trans 8589934799 rc 0/0 00000100:00100000:0.0:1762166856.149306:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 216 00000100:00100000:1.0:1762166856.150526:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.150564:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444431744 00000100:00100000:3.0:1762166856.150570:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444431744 00000100:00100000:3.0:1762166856.150617:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 80 00000100:00100000:3.0:1762166856.150624:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49197:x1847765444431744:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:3.0:1762166856.150718:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49197:x1847765444431744:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 94us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.150725:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 80 00000100:00100000:3.0:1762166856.151645:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.151701:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444432000 00000100:00100000:0.0:1762166856.151708:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444432000 00000100:00100000:0.0:1762166856.151754:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 81 00000100:00100000:0.0:1762166856.151788:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49197:x1847765444432000:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166856.151971:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49197:x1847765444432000:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 208us (327us total) trans 8589934800 rc 0/0 00000100:00100000:0.0:1762166856.151978:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 81 00000100:00100000:2.0:1762166856.153040:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.153095:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444432256 00000100:00100000:0.0:1762166856.153102:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444432256 00000100:00100000:0.0:1762166856.153151:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 217 00000100:00100000:0.0:1762166856.153159:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49197:x1847765444432256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.153175:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.153179:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166856.153203:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e154 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91515 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.153242:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e13f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9150e expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.153251:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.153256:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.153266:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e162 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9151c expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.153348:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e169 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.153360:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e169 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.153373:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e169 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.153384:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166856.153490:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e162 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9151c expref: 36 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.153503:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e169 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9151c expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.153511:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.153514:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166856.153516:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198e00, rc 0) 00000100:00100000:0.0:1762166856.153570:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49197:x1847765444432256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 410us (534us total) trans 8589934801 rc 0/0 00000100:00100000:0.0:1762166856.153589:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 217 00000100:00100000:1.0:1762166856.155014:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.155074:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444432512 00000100:00100000:0.0:1762166856.155085:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444432512 00000100:00100000:0.0:1762166856.155131:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 82 00000100:00100000:0.0:1762166856.155137:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342feb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49197:x1847765444432512:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166856.155179:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e169 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9151c expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.155200:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e177 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.155208:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e0f9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91500 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.155214:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e177 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.155241:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e0f9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91500 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.155249:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e0f9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91500 expref: 35 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166856.155258:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451968640:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.155336:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.156383:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451968640:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.156404:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e177 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166856.156733:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.156816:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444432640 00000100:00100000:3.0:1762166856.156823:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444432640 00010000:00010000:3.0:1762166856.156849:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e0f9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91500 expref: 36 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166856.156882:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 695 00000100:00100000:3.0:1762166856.156891:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765444432640:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.156903:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.156909:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e0f9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91500 expref: 36 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.156919:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e0f9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91500 expref: 36 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.156932:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e0f9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91500 expref: 36 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.156942:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:3.0:1762166856.156945:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e177 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.156950:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e177 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.156960:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e177 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.156978:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.156998:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e177 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.157005:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e177 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166856.157011:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444432640:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 122us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.157017:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 695 00010000:00010000:0.0:1762166856.157205:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e177 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.157214:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e177 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.157221:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e177 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.157225:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.157228:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e177 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.157233:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e177 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.157242:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.157244:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166856.157248:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e177 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.157253:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e177 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.157264:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.157266:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166856.157277:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e169 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9151c expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.157392:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342feb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49197:x1847765444432512:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2254us (2386us total) trans 8589934802 rc -22/-22 00000100:00100000:0.0:1762166856.157399:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 82 00000100:00100000:1.0:1762166856.158247:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.158294:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444432768 00000100:00100000:0.0:1762166856.158300:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444432768 00000100:00100000:0.0:1762166856.158341:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 218 00000100:00100000:0.0:1762166856.158350:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49197:x1847765444432768:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.158367:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.158384:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9e17e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91523 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.158425:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9e17e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91523 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.158454:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9e17e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91523 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.158472:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4200) 00010000:00010000:0.0:1762166856.158474:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166856.158476:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199200, rc 0) 00000100:00100000:0.0:1762166856.158512:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49197:x1847765444432768:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 165us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.158517:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 218 00000100:00100000:3.0:1762166856.159924:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.159990:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444433024 00000100:00100000:0.0:1762166856.159998:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444433024 00000100:00100000:0.0:1762166856.160067:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 219 00000100:00100000:0.0:1762166856.160077:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e07b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49197:x1847765444433024:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.160094:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.160109:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e185 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9152a expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.160605:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e18c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.160615:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e18c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.160621:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e18c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.160628:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2a:0x0]: returning size 0 00010000:00010000:0.0:1762166856.160658:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e185 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9152a expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.160671:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e18c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9152a expref: 37 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.160677:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2a:0x0].0x0 (ffff9ee34bdb4700) 00010000:00010000:0.0:1762166856.160679:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166856.160681:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198c00, rc 0) 00000100:00100000:0.0:1762166856.160724:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e07b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49197:x1847765444433024:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 649us (806us total) trans 8589934803 rc 0/0 00000100:00100000:0.0:1762166856.160728:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 219 00000100:00100000:2.0:1762166856.162382:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.162436:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444433280 00000100:00100000:0.0:1762166856.162444:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444433280 00000100:00100000:0.0:1762166856.162509:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 220 00000100:00100000:0.0:1762166856.162518:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49197:x1847765444433280:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.162541:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.162554:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e19a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91531 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.162616:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e1a1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.162625:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e1a1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.162634:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e1a1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.162646:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166856.162740:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e19a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91531 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.162753:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e1a1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91531 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.162759:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4200) 00010000:00010000:0.0:1762166856.162785:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166856.162789:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199c00, rc 0) 00000100:00100000:0.0:1762166856.162834:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49197:x1847765444433280:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 317us (457us total) trans 8589934804 rc 0/0 00000100:00100000:0.0:1762166856.162841:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 220 00000100:00100000:1.0:1762166856.164157:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.164272:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444433536 00000100:00100000:0.0:1762166856.164282:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444433536 00000100:00100000:0.0:1762166856.164335:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 83 00000100:00100000:0.0:1762166856.164344:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49197:x1847765444433536:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166856.164403:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e1a1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91531 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.164443:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1af lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.164455:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9e17e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91523 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.164462:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1af lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.164491:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9e17e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91523 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.164503:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9e17e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91523 expref: 39 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166856.164517:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451968768:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.164588:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.165622:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451968768:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.165643:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1af lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166856.165925:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.166005:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444433664 00000100:00100000:3.0:1762166856.166017:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444433664 00010000:00010000:3.0:1762166856.166060:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9e17e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91523 expref: 40 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166856.166100:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 696 00000100:00100000:3.0:1762166856.166112:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2361:x1847765444433664:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.166142:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.166150:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9e17e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91523 expref: 40 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.166164:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9e17e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91523 expref: 40 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.166249:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9e17e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91523 expref: 40 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.166267:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4200) 00010000:00010000:3.0:1762166856.166273:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1af lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.166300:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1af lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.166307:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1af lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.166340:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.166376:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1af lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.166386:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1af lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166856.166408:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444433664:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 297us (486us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166856.166416:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1b6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166856.166418:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 696 00010000:00010000:0.0:1762166856.166471:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e18c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9152a expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.166484:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1b6 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.166521:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e18c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9152a expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.166535:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e18c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9152a expref: 39 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1762166856.166551:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451968896:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.166636:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.167858:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451968896:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.167884:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1b6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166856.168075:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.168169:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444433792 00000100:00100000:3.0:1762166856.168177:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444433792 00010000:00010000:3.0:1762166856.168248:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e18c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9152a expref: 39 pid: 30817 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166856.168290:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 697 00000100:00100000:3.0:1762166856.168300:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444433792:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.168313:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.168319:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e18c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9152a expref: 39 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.168331:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e18c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9152a expref: 39 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.168352:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e18c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9152a expref: 39 pid: 30817 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166856.168366:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2a:0x0].0x0 (ffff9ee34bdb4700) 00010000:00010000:3.0:1762166856.168383:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1b6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.168393:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1b6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.168401:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1b6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.168439:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.168453:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1b6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.168463:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1b6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166856.168510:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2361:x1847765444433792:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 210us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.168518:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 697 00000100:00100000:0.0:1762166856.168900:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451969024:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166856.168959:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166856.169003:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166856.169053:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451969024 00000100:00100000:3.0:1762166856.169058:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451969024 00000100:00100000:3.0:1762166856.169097:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1762166856.169105:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:30821:x1847765451969024:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166856.169176:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:30821:x1847765451969024:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 72us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.169181:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1762166856.169208:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451969024:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1762166856.169248:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934805 00000001:00080000:0.0:1762166856.169314:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934806 00010000:00010000:0.0:1762166856.169334:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1b6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.169343:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1b6 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.169349:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1b6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.169354:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.169358:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1b6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.169365:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1b6 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.169376:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2a:0x0].0x0 (ffff9ee34bdb4700) 00010000:00010000:0.0:1762166856.169379:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166856.169382:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1b6 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.169388:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1b6 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.169404:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1af lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.169410:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1af lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.169425:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1af lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.169444:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.169447:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1af lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.169453:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1af lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.169461:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4200) 00010000:00010000:0.0:1762166856.169463:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166856.169465:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1af lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.169470:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1af lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.169481:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4200) 00010000:00010000:0.0:1762166856.169484:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166856.169488:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e1a1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91531 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.169557:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49197:x1847765444433536:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 5214us (5409us total) trans 8589934807 rc 0/0 00000100:00100000:0.0:1762166856.169565:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 83 00000020:00080000:0.0:1762166856.169570:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166856.170546:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.170602:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444433920 00000100:00100000:0.0:1762166856.170608:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444433920 00000100:00100000:0.0:1762166856.170647:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 221 00000100:00100000:0.0:1762166856.170656:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49197:x1847765444433920:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.170680:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.170693:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e1bd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91538 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.170730:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e1bd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91538 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.170738:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e1bd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91538 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.170748:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.170750:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166856.170752:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198400, rc 0) 00000100:00100000:0.0:1762166856.170809:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49197:x1847765444433920:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 154us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.170816:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 221 00000100:00100000:1.0:1762166856.172645:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.172697:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444434176 00000100:00100000:0.0:1762166856.172705:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444434176 00000100:00100000:0.0:1762166856.172755:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 84 00000100:00100000:0.0:1762166856.172814:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49197:x1847765444434176:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:0.0:1762166856.173211:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x2a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1762166856.173303:0:30821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].12, 64 off9152 00000001:00080000:0.0:1762166856.173314:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934808 00010000:00010000:0.0:1762166856.173359:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e1c4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.173373:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.173397:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.173406:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e1c4 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.173413:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e1c4 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.173419:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e1c4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.173450:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166856.173481:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166856.173489:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e1c4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.173496:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166856.173500:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e1c4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.173508:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e1c4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.173520:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2a:0x0].0x0 (ffff9ee34bdb4400) 00010000:00010000:3.0:1762166856.173530:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166856.173535:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e1c4 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.173541:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e1c4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.173559:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166856.173561:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49197:x1847765444434176:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 796us (921us total) trans 8589934809 rc 0/0 00010000:00010000:3.0:1762166856.173562:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166856.173566:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166856.173574:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 84 00000020:00080000:0.0:1762166856.173580:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166856.174934:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.175016:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444434432 00000100:00100000:0.0:1762166856.175025:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444434432 00000100:00100000:0.0:1762166856.175074:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 85 00000100:00100000:0.0:1762166856.175084:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49197:x1847765444434432:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166856.175354:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49197:x1847765444434432:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 271us (424us total) trans 8589934810 rc 0/0 00000100:00100000:0.0:1762166856.175362:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 85 00000100:00100000:2.0:1762166856.184493:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.184575:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444434560 00000100:00100000:0.0:1762166856.184591:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444434560 00000100:00100000:0.0:1762166856.184660:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 222 00000100:00100000:0.0:1762166856.184690:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49199:x1847765444434560:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166856.184737:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.184755:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e1cb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9153f expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.184863:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1d2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.184884:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1d2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.184895:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1d2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.184924:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1d9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.184932:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.184939:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185064:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e1e0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185070:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185074:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.185102:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166856.185105:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166856.185120:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185134:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185140:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1d2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185144:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1d2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185153:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1d2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185156:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.185159:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1d2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185165:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1d2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185172:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166856.185178:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.185182:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1d2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185188:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e1d2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185200:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185212:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1d9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185218:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1d9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185229:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.185232:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1d9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185245:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1d9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185253:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4200) 00010000:00010000:0.0:1762166856.185255:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.185258:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1d9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185262:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e1d9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.185299:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e1cb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9153f expref: 45 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.185307:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9153f expref: 44 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.185312:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.185313:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166856.185315:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199000, rc 0) 00000100:00100000:0.0:1762166856.185366:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49199:x1847765444434560:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 699us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.185371:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 222 00000100:00100000:1.0:1762166856.187329:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.187425:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444434688 00000100:00100000:2.0:1762166856.187445:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444434688 00000100:00100000:2.0:1762166856.187503:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1099 00000100:00100000:2.0:1762166856.187513:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444434688:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166856.187526:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.187540:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e1e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91546 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.187609:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451969152:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166856.187688:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348626000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.189620:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451969152:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166856.189653:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e1e7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91546 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.189698:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e1e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91546 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.189716:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d400, rc 0) 00000100:00100000:0.0:1762166856.189792:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444434688:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 2280us (2469us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166856.189811:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1099 00000100:00100000:0.0:1762166856.203879:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.203993:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444434816 00000100:00100000:2.0:1762166856.204003:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444434816 00000100:00100000:2.0:1762166856.204058:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 223 00000100:00100000:2.0:1762166856.204070:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49203:x1847765444434816:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166856.204140:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e1ee lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204157:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e1ee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204168:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e1ee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204183:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e1f5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204189:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204196:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204302:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e1fc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204310:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e1fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204317:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e1fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.204358:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166856.204362:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166856.204373:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e1fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204385:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e1ee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204391:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e1ee lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204398:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e1ee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204403:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.204407:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e1ee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204414:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e1ee lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204438:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166856.204442:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166856.204447:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e1ee lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204452:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e1ee lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204466:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204471:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e1f5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204484:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204489:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7dc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.204492:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204499:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e1f5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204507:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee343a13800) 00010000:00010000:2.0:1762166856.204510:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166856.204513:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e1f5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204519:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e1f5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204535:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e1fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204541:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e1fc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204546:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e1fc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204551:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.204554:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e1fc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204560:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e1fc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204573:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166856.204576:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166856.204579:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e1fc lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.204585:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e1fc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166856.204667:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49203:x1847765444434816:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 600us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.204675:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 223 00000100:00100000:1.0:1762166856.217635:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.218496:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444435072 00000100:00100000:2.0:1762166856.218506:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444435072 00000100:00100000:2.0:1762166856.218575:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 224 00000100:00100000:2.0:1762166856.218587:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49205:x1847765444435072:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.218607:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.218628:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e203 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9154d expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.218712:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e20a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.218725:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e20a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.218738:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e20a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.218749:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166856.218916:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e203 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9154d expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.218948:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e20a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9154d expref: 46 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.218959:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166856.218962:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166856.218966:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7dc00, rc 0) 00000100:00100000:2.0:1762166856.219040:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49205:x1847765444435072:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 455us (1412us total) trans 8589934811 rc 0/0 00000100:00100000:2.0:1762166856.219049:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 224 00000100:00100000:3.0:1762166856.223412:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.223522:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444435200 00000100:00100000:0.0:1762166856.223532:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444435200 00000100:00100000:0.0:1762166856.223590:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1100 00000100:00100000:0.0:1762166856.223601:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444435200:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.223620:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.223638:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e218 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91554 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.223694:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451969280:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166856.223838:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.225327:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451969280:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166856.225359:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e218 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91554 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.225379:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e218 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91554 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.225406:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199c00, rc 0) 00000100:00100000:0.0:1762166856.225471:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444435200:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1872us (2071us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166856.225479:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1100 00000100:00100000:1.0:1762166856.228207:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.228260:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444435456 00000100:00100000:2.0:1762166856.228274:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444435456 00000100:00100000:2.0:1762166856.228336:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 225 00000100:00100000:2.0:1762166856.228346:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49205:x1847765444435456:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.228369:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.228389:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e21f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9155b expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.228492:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e226 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.228504:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e1e0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9153f expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.228510:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e226 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.228535:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9153f expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.228560:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e1e0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9153f expref: 47 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.228571:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451969408:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.228646:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eef900 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.230183:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451969408:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.230208:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e226 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166856.230904:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.231018:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444435584 00000100:00100000:0.0:1762166856.231025:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444435584 00010000:00010000:0.0:1762166856.231058:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e1e0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9153f expref: 48 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.231092:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 698 00000100:00100000:0.0:1762166856.231101:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2360:x1847765444435584:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.231115:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.231121:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e1e0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9153f expref: 48 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.231132:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9153f expref: 48 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.231151:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e1e0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9153f expref: 48 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.231167:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.231172:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e226 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.231179:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e226 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.231196:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e226 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.231219:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.231254:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e226 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.231261:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e226 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166856.231269:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:2360:x1847765444435584:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 169us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.231276:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 698 00000004:00200000:2.0:1762166856.231278:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166856.231421:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e21f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9155b expref: 48 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.231448:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e226 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9155b expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.231455:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166856.231458:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166856.231460:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c400, rc 0) 00000100:00100000:2.0:1762166856.231495:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49205:x1847765444435456:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3151us (3298us total) trans 8589934812 rc 0/0 00000100:00100000:2.0:1762166856.231503:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 225 00000100:00100000:1.0:1762166856.233691:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.233803:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444435840 00000100:00100000:2.0:1762166856.233811:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444435840 00000100:00100000:2.0:1762166856.233858:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 226 00000100:00100000:2.0:1762166856.233867:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49205:x1847765444435840:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.233891:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.233908:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e234 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91562 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.234392:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e23b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.234406:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e23b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.234415:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e23b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.234437:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2b:0x0]: returning size 0 00010000:00010000:2.0:1762166856.234485:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e234 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91562 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.234501:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e23b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91562 expref: 49 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.234510:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2b:0x0].0x0 (ffff9ee343a13800) 00010000:00010000:2.0:1762166856.234514:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166856.234517:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c600, rc 0) 00000100:00100000:2.0:1762166856.234573:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49205:x1847765444435840:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 706us (888us total) trans 8589934813 rc 0/0 00000100:00100000:2.0:1762166856.234586:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 226 00000100:00100000:3.0:1762166856.237892:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.238098:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444436096 00000100:00100000:2.0:1762166856.238108:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444436096 00000100:00100000:2.0:1762166856.238173:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 227 00000100:00100000:2.0:1762166856.238183:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49205:x1847765444436096:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.238208:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.238229:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e249 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91569 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.238317:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e250 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.238331:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e23b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91562 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.238339:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e250 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.238371:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e23b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91562 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.238384:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e23b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91562 expref: 50 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.238398:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451969536:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.238493:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9a300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.240223:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451969536:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.240249:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e250 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166856.240815:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.240848:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444436224 00000100:00100000:0.0:1762166856.240856:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444436224 00010000:00010000:0.0:1762166856.240889:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e23b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91562 expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.240931:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 699 00000100:00100000:0.0:1762166856.240941:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2360:x1847765444436224:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.240954:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.240960:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e23b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91562 expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.240972:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e23b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91562 expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.240992:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e23b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91562 expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.241009:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2b:0x0].0x0 (ffff9ee343a13800) 00010000:00010000:0.0:1762166856.241013:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e250 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.241039:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e250 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.241047:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e250 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.241077:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166856.241125:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2360:x1847765444436224:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 185us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.241133:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 699 00010000:00010000:2.0:1762166856.241216:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e250 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.241229:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e250 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.241245:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2b:0x0]: returning size 0 00000004:00080000:2.0:1762166856.241567:0:30817:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x87:0x0], index 1: 0 00010000:00010000:2.0:1762166856.241709:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e250 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.241716:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e250 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.241723:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e250 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.241729:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.241733:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e250 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.241740:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e250 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.241750:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2b:0x0].0x0 (ffff9ee343a13800) 00010000:00010000:2.0:1762166856.241753:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166856.241756:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e250 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.241795:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e250 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.241840:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e249 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91569 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.241860:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166856.241863:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166856.241867:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e249 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91569 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.241877:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d400, rc 0) 00000100:00100000:2.0:1762166856.241917:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49205:x1847765444436096:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3736us (4034us total) trans 8589934814 rc 301/301 00000100:00100000:2.0:1762166856.241925:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 227 00000100:00100000:3.0:1762166856.243269:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.243323:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444436480 00000100:00100000:0.0:1762166856.243332:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444436480 00000100:00100000:0.0:1762166856.243387:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 86 00000100:00100000:0.0:1762166856.243397:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49205:x1847765444436480:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166856.243708:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49205:x1847765444436480:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 311us (441us total) trans 8589934815 rc 0/0 00000100:00100000:0.0:1762166856.243716:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 86 00000100:00100000:1.0:1762166856.246003:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.246483:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444436608 00000100:00100000:2.0:1762166856.246497:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444436608 00000100:00100000:2.0:1762166856.246571:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 228 00000100:00100000:2.0:1762166856.246583:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49205:x1847765444436608:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.246620:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.246655:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e25e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91570 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.246846:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e265 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.246863:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e226 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9155b expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.246873:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e265 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.246912:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e226 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9155b expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.246941:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e226 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9155b expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.246956:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451969664:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.247050:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eef240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.248850:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451969664:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.248874:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e265 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166856.249454:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.249633:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444436736 00000100:00100000:3.0:1762166856.249643:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444436736 00010000:00010000:3.0:1762166856.249678:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e226 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9155b expref: 52 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:3.0:1762166856.249721:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 700 00000100:00100000:3.0:1762166856.249730:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2361:x1847765444436736:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.249745:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.249751:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e226 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9155b expref: 52 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166856.249808:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e226 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9155b expref: 52 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166856.249835:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e226 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9155b expref: 52 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166856.249868:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:3.0:1762166856.249873:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e265 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.249882:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e265 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.249889:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e265 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.249916:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166856.249979:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444436736:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 249us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.249987:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 700 00010000:00010000:2.0:1762166856.250245:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e265 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.250254:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e265 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.250294:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166856.250298:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166856.250316:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e265 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.250345:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e25e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91570 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.250362:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e265 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91570 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.250369:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166856.250372:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166856.250382:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2600, rc 0) 00000100:00100000:2.0:1762166856.250439:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49205:x1847765444436608:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3847us (4435us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.250451:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 228 00000100:00100000:1.0:1762166856.253413:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.253498:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444436864 00000100:00100000:0.0:1762166856.253508:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444436864 00000100:00100000:0.0:1762166856.253566:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1101 00000100:00100000:0.0:1762166856.253576:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444436864:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.253595:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.253613:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e26c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91577 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.253669:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451969792:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166856.253747:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.255422:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451969792:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166856.255469:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e26c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91577 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.255492:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e26c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91577 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.255505:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199000, rc 0) 00000100:00100000:0.0:1762166856.255563:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444436864:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1983us (2152us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166856.255572:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1101 00000100:00100000:1.0:1762166856.257455:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.257532:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444436992 00000100:00100000:2.0:1762166856.257542:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444436992 00000100:00100000:2.0:1762166856.257604:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 229 00000100:00100000:2.0:1762166856.257615:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49205:x1847765444436992:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.257640:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.257668:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e273 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9157e expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.257742:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e27a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.257755:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e27a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.257795:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e27a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.257843:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2b:0x0]: returning size 0 00000004:00200000:2.0:1762166856.257848:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166856.257868:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e27a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.257896:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e273 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9157e expref: 52 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.257913:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e27a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9157e expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.257938:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2b:0x0].0x0 (ffff9ee343a13800) 00010000:00010000:2.0:1762166856.257941:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166856.257943:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2e00, rc 0) 00000100:00100000:2.0:1762166856.258009:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49205:x1847765444436992:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 396us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.258017:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 229 00000100:00100000:1.0:1762166856.261164:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.261245:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444437120 00000100:00100000:0.0:1762166856.261255:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444437120 00000100:00100000:0.0:1762166856.261322:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1102 00000100:00100000:0.0:1762166856.261334:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765444437120:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.261353:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.261372:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e281 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91585 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166856.261395:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166856.261413:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.261416:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.261424:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e281 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91585 expref: 25 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.261455:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e281 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91585 expref: 25 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.261487:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199c00, rc 0) 00000100:00100000:0.0:1762166856.261542:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444437120:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 210us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.261550:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1102 00000100:00100000:1.0:1762166856.264022:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.264074:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444437376 00000100:00100000:2.0:1762166856.264084:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444437376 00000100:00100000:2.0:1762166856.264138:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 230 00000100:00100000:2.0:1762166856.264149:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49205:x1847765444437376:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.264168:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.264185:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e288 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9158c expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.264270:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e28f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.264283:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e28f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.264293:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e28f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.264305:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166856.264458:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e288 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9158c expref: 54 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.264476:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e28f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9158c expref: 53 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.264498:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166856.264501:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166856.264505:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3400, rc 0) 00000100:00100000:2.0:1762166856.264573:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49205:x1847765444437376:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 425us (559us total) trans 8589934816 rc 0/0 00000100:00100000:2.0:1762166856.264585:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 230 00000100:00100000:1.0:1762166856.266402:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.266452:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444437504 00000100:00100000:0.0:1762166856.266460:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444437504 00000100:00100000:0.0:1762166856.266509:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1103 00000100:00100000:0.0:1762166856.266518:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444437504:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.266534:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.266549:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e29d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91593 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.266601:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451969920:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166856.266675:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.268399:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451969920:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166856.268458:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e29d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91593 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.268485:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e29d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91593 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.268500:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199000, rc 0) 00000100:00100000:0.0:1762166856.268575:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444437504:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2058us (2178us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166856.268606:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1103 00000100:00100000:1.0:1762166856.271099:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.271195:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444437632 00000100:00100000:0.0:1762166856.271204:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444437632 00000100:00100000:0.0:1762166856.271248:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1104 00000100:00100000:0.0:1762166856.271259:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444437632:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.271277:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.271293:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e2a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9159a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.271342:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451970048:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166856.271417:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.272831:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451970048:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166856.272878:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e2a4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9159a expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.272899:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e2a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9159a expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.272912:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199600, rc 0) 00000100:00100000:0.0:1762166856.272966:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444437632:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1709us (1875us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166856.272976:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1104 00000100:00100000:1.0:1762166856.274892:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.274973:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444437760 00000100:00100000:0.0:1762166856.274986:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444437760 00000100:00100000:0.0:1762166856.275062:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1105 00000100:00100000:0.0:1762166856.275091:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444437760:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762166856.275151:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e2ab lrc: 3/1,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.275172:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e0d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f2 expref: 26 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.275180:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166856.275182:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166856.275186:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e2ab lrc: 4/1,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.275224:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e0d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f2 expref: 26 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.275237:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e0d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f2 expref: 26 pid: 6532 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.275253:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451970176:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.275341:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.277083:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451970176:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.277125:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e2ab lrc: 3/1,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166856.277650:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.277746:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444437888 00000100:00100000:0.0:1762166856.277754:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444437888 00010000:00010000:0.0:1762166856.277829:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e0d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f2 expref: 27 pid: 6532 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.277886:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 701 00000100:00100000:0.0:1762166856.277895:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444437888:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.277912:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.277933:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e0d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f2 expref: 27 pid: 6532 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.277944:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e0d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f2 expref: 27 pid: 6532 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.277968:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e0d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f2 expref: 27 pid: 6532 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.277982:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.277984:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.277989:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e2ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.277998:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e2ab lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.278029:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.278055:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e2ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.278074:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e2ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.278084:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444437888:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 187us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.278092:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 701 00010000:00010000:2.0:1762166856.278103:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e2ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.278112:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e2ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.278124:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e2ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.278130:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166856.278134:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e2ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.278142:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e2ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.278161:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e2ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.278168:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e2ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.278223:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444437760:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3135us (3341us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.278231:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1105 00000100:00100000:1.0:1762166856.279837:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.279958:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444438016 00000100:00100000:2.0:1762166856.279965:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444438016 00000100:00100000:2.0:1762166856.280014:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1106 00000100:00100000:2.0:1762166856.280022:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444438016:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.280038:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.280056:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e2b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f915a1 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166856.280074:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x87:0x0] initial LVB size: 0, mtime: 0x69088847, atime: 0x69088847, ctime: 0x69088848, blocks: 0x1 00010000:00010000:2.0:1762166856.280091:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.280093:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.280099:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e2b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915a1 expref: 26 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.280123:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e2b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915a1 expref: 26 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.280149:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2200, rc 0) 00000100:00100000:2.0:1762166856.280193:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444438016:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 172us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.280199:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1106 00000100:00100000:1.0:1762166856.305122:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.305180:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444438144 00000100:00100000:2.0:1762166856.305192:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444438144 00000100:00100000:2.0:1762166856.305241:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 231 00000100:00100000:2.0:1762166856.305249:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49205:x1847765444438144:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:2.0:1762166856.316785:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934815 is committed 00000020:00080000:2.0:1762166856.316870:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969116 batchid updated 00000001:00080000:2.0:1762166856.316891:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934816 is committed 00000020:00080000:2.0:1762166856.316921:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee246eefd80 refcount 2 committed 0 result 0 batchid 4294969117 00000020:00080000:2.0:1762166856.316928:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee37f672700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee246eeff00 00000020:00080000:2.0:1762166856.316935:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee37f672800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee37f7b4400 00000100:00100000:0.0:1762166856.316937:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49205:x1847765444438144:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 11678us (11815us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.316960:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 231 00000020:00080000:1.0:1762166856.316982:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969117 committed batchid 4294969116 00000020:00080000:1.0:1762166856.317192:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969116 00000100:00100000:1.0:1762166856.318670:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.318725:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444438272 00000100:00100000:2.0:1762166856.318737:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444438272 00000100:00100000:2.0:1762166856.318824:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1107 00000100:00100000:2.0:1762166856.318835:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444438272:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:2.0:1762166856.318953:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444438272:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 120us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.318961:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1107 00000100:00100000:3.0:1762166856.325587:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.325647:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444438400 00000100:00100000:2.0:1762166856.325660:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444438400 00000100:00100000:2.0:1762166856.325734:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1108 00000100:00100000:2.0:1762166856.325787:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444438400:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166856.325845:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e2b9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.325862:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.325864:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.325870:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e2b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.325887:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e2b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.325923:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e2b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.325932:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e2b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.325941:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e2b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.325949:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166856.325954:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e2b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.325964:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e2b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.325995:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e2b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.326003:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e2b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.326094:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444438400:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 333us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.326103:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1108 00000100:00100000:3.0:1762166856.327330:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.327394:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444438656 00000100:00100000:0.0:1762166856.327403:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444438656 00000100:00100000:0.0:1762166856.327468:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 232 00000100:00100000:0.0:1762166856.327478:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49205:x1847765444438656:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166856.327523:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.327548:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e27a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9157e expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.327567:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2b:0x0].0x0 (ffff9ee343a13800) 00010000:00010000:0.0:1762166856.327579:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.327609:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e2c0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.327618:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.327625:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762166856.327798:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ce92a14b reply state 000000001002e009 transno 8589934817 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166856.327805:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166856.327890:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49205:x1847765444438656:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 413us (569us total) trans 8589934817 rc 0/0 00000100:00100000:0.0:1762166856.327897:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 232 00010000:00010000:3.0:1762166856.328658:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.328668:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e2c0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.328674:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e2c0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.328739:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166856.328742:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e2c0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.328751:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e2c0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.328817:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2b:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:3.0:1762166856.328821:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166856.328826:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e2c0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.328832:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e2c0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166856.328878:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.328932:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444438784 00000100:00100000:0.0:1762166856.328941:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444438784 00000100:00100000:0.0:1762166856.329006:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 233 00000100:00100000:0.0:1762166856.329018:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49205:x1847765444438784:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.329042:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.329064:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e2c7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f915a8 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.329119:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e2c7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915a8 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.329130:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e2c7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915a8 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.329144:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2b:0x0].0x0 (ffff9ee34bdb4400) 00010000:00010000:0.0:1762166856.329146:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166856.329148:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199000, rc 0) 00000100:00100000:0.0:1762166856.329194:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49205:x1847765444438784:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 181us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.329199:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 233 00000100:00100000:1.0:1762166856.330320:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.330370:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444438912 00000100:00100000:2.0:1762166856.330376:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444438912 00000100:00100000:2.0:1762166856.330436:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1109 00000100:00100000:2.0:1762166856.330447:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:49205:x1847765444438912:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.330459:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.330473:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e2ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f915af expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.330494:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e281 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91585 expref: 26 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.330501:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.330502:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.330506:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e2ce lrc: 4/0,0 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915af expref: 26 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.330534:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e281 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91585 expref: 26 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.330553:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e281 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91585 expref: 26 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:2.0:1762166856.330565:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451970304:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.330630:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34aab0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.331467:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451970304:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.331498:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e2ce lrc: 3/0,0 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915af expref: 26 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.331520:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d200, rc 0) 00000100:00100000:2.0:1762166856.331569:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49205:x1847765444438912:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1125us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.331576:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1109 00000100:00100000:3.0:1762166856.331709:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.331792:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444439040 00000100:00100000:0.0:1762166856.331801:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444439040 00010000:00010000:0.0:1762166856.331828:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e281 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91585 expref: 26 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:3.0:1762166856.331874:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 702 00000100:00100000:3.0:1762166856.331886:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444439040:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.331900:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.331921:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e281 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91585 expref: 26 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:3.0:1762166856.331936:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e281 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91585 expref: 26 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:3.0:1762166856.331964:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e281 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91585 expref: 26 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:3.0:1762166856.331977:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166856.331980:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166856.331985:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e2ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915af expref: 25 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.331995:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e2ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915af expref: 25 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.332034:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e2ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915af expref: 25 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166856.332047:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765451970432:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762166856.332107:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166856.333052:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765451970432:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762166856.333066:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166856.333115:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765444439040:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1231us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.333123:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 702 00000100:00100000:3.0:1762166856.333304:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.333355:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444439168 00000100:00100000:2.0:1762166856.333360:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444439168 00000100:00100000:2.0:1762166856.333388:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1110 00000100:00100000:2.0:1762166856.333394:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765444439168:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166856.333577:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166856.333579:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x87:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:2.0:1762166856.333581:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x87:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:2.0:1762166856.333582:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x87:0x0] updating lvb ctime from disk: 0 -> 1762166856 00002000:00010000:2.0:1762166856.333584:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x87:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166856.333613:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444439168:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 219us (309us total) trans 17179869447 rc 0/0 00000100:00100000:2.0:1762166856.333633:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1110 00000100:00100000:1.0:1762166856.334540:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.334579:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444439424 00000100:00100000:0.0:1762166856.334584:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444439424 00000100:00100000:0.0:1762166856.334620:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 234 00000100:00100000:0.0:1762166856.334629:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49205:x1847765444439424:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166856.334668:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.334694:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e265 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91570 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.334708:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.334711:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.334738:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e2d5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.334747:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e2d5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.334753:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e2d5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762166856.334862:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ab86806c reply state 00000000be184e64 transno 8589934818 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e2d5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166856.334869:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166856.334921:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49205:x1847765444439424:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 295us (384us total) trans 8589934818 rc 0/0 00000100:00100000:0.0:1762166856.334926:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 234 00010000:00010000:2.0:1762166856.335542:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e2d5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.335553:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e2d5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.335559:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e2d5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.335565:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.335569:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e2d5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.335576:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e2d5 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.335586:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166856.335589:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166856.335593:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e2d5 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.335598:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e2d5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166856.335812:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.335844:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444439552 00000100:00100000:2.0:1762166856.335850:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444439552 00000100:00100000:2.0:1762166856.335894:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1111 00000100:00100000:2.0:1762166856.335902:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49205:x1847765444439552:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.335913:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.335926:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e2dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f915b6 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.335959:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e2b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915a1 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.335967:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.335970:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.335974:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e2dc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915b6 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.336002:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e2b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915a1 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.336016:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e2b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915a1 expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:2.0:1762166856.336029:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451970560:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.336090:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34aab0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.337031:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451970560:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.337077:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e2dc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915b6 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.337099:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c400, rc 0) 00000100:00100000:2.0:1762166856.337161:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49205:x1847765444439552:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1258us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.337172:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1111 00000100:00100000:3.0:1762166856.337376:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.337457:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444439680 00000100:00100000:1.0:1762166856.337464:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444439680 00010000:00010000:1.0:1762166856.337493:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e2b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915a1 expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.337543:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 703 00000100:00100000:1.0:1762166856.337553:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444439680:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166856.337565:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.337584:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e2b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915a1 expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:1.0:1762166856.337596:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e2b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915a1 expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:1.0:1762166856.337615:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e2b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915a1 expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:1.0:1762166856.337628:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166856.337630:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166856.337635:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e2dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915b6 expref: 26 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.337644:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e2dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915b6 expref: 26 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.337671:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e2dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915b6 expref: 26 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166856.337688:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765451970688:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762166856.337756:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee351428480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166856.338679:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765451970688:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762166856.338864:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166856.338918:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444439680:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1365us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.338973:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 703 00000100:00100000:1.0:1762166856.338981:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.339030:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444439808 00000100:00100000:0.0:1762166856.339038:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444439808 00000100:00100000:0.0:1762166856.339089:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1112 00000100:00100000:0.0:1762166856.339100:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444439808:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166856.339302:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166856.339307:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x87:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166856.339309:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x87:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166856.339312:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x87:0x0] updating lvb ctime from disk: 1762166856 -> 1762166856 00002000:00010000:0.0:1762166856.339314:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x87:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166856.339372:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444439808:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 274us (400us total) trans 21474836777 rc 0/0 00000100:00100000:0.0:1762166856.339380:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1112 00000100:00100000:2.0:1762166856.340334:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.340396:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444440064 00000100:00100000:0.0:1762166856.340403:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444440064 00000100:00100000:0.0:1762166856.340457:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 87 00000100:00100000:0.0:1762166856.340467:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342fe8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49205:x1847765444440064:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166856.340537:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e28f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9158c expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.340574:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2e3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.340588:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e1bd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91538 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.340596:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e20a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9154d expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.340604:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2e3 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.340642:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e20a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9154d expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.340655:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e20a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9154d expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.340670:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451970816:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.340760:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e1bd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91538 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.340796:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e1bd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91538 expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.340807:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451970944:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.340839:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.341758:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451970816:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.341788:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451970944:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.341808:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2e3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166856.341925:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.342013:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444440320 00000100:00100000:3.0:1762166856.342022:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444440320 00000100:00100000:1.0:1762166856.342070:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.342081:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 88 00000100:00100000:3.0:1762166856.342092:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:37762:x1847765444440320:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1762166856.342142:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444440448 00000100:00100000:0.0:1762166856.342151:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444440448 00010000:00010000:0.0:1762166856.342178:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e1bd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91538 expref: 29 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.342214:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 704 00000100:00100000:0.0:1762166856.342230:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765444440448:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.342242:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.342253:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e1bd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91538 expref: 30 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.342264:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e1bd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91538 expref: 30 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.342297:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e1bd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91538 expref: 30 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:3.0:1762166856.342299:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:37762:x1847765444440320:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 203us (373us total) trans 8589934819 rc 0/0 00010000:00010000:0.0:1762166856.342332:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.342339:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2e3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166856.342345:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 88 00010000:00010000:0.0:1762166856.342360:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2e3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.342369:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166856.342413:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444440448:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 190us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.342421:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 704 00000100:00100000:1.0:1762166856.343286:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.343337:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444440576 00000100:00100000:0.0:1762166856.343343:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444440576 00010000:00010000:0.0:1762166856.343365:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e20a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9154d expref: 28 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.343388:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 705 00000100:00100000:0.0:1762166856.343394:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444440576:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.343414:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.343421:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e20a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9154d expref: 28 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.343443:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e20a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9154d expref: 28 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.343475:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e20a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9154d expref: 28 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.343490:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.343495:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2e3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.343504:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2e3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.343510:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2e3 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.343541:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166856.343567:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2e3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166856.343576:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444440576:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 179us (291us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166856.343577:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2e3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166856.343593:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 705 00010000:00010000:1.0:1762166856.343603:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e2ea lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.343613:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e2c7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915a8 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.343619:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e2ea lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.343644:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e2c7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915a8 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.343658:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e2c7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915a8 expref: 26 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.343671:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451971072:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166856.343731:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee351428e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166856.344680:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.344685:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451971072:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.344706:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e2ea lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166856.344790:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444440704 00000100:00100000:3.0:1762166856.344797:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444440704 00010000:00010000:3.0:1762166856.344816:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e2c7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915a8 expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:3.0:1762166856.344838:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 706 00000100:00100000:3.0:1762166856.344843:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444440704:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.344850:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.344854:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e2c7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915a8 expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166856.344861:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e2c7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915a8 expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166856.344873:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e2c7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915a8 expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166856.344882:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2b:0x0].0x0 (ffff9ee34bdb4400) 00010000:00010000:3.0:1762166856.344886:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e2ea lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.344893:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e2ea lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.344899:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e2ea lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.344921:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.344940:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e2ea lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.344949:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e2ea lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166856.344968:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444440704:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 123us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.344977:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 706 00000100:00100000:0.0:1762166856.345289:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451971200:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166856.345320:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166856.345351:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166856.345373:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451971200 00000100:00100000:3.0:1762166856.345378:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451971200 00000100:00100000:3.0:1762166856.345409:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1762166856.345416:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:30821:x1847765451971200:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166856.345497:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:30821:x1847765451971200:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 80us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.345505:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1762166856.345513:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451971200:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166856.345550:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451971328:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166856.345572:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166856.345586:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166856.345595:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451971328 00000100:00100000:3.0:1762166856.345599:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451971328 00000100:00100000:3.0:1762166856.345626:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1762166856.345635:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:30821:x1847765451971328:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166856.345686:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:30821:x1847765451971328:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 53us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.345694:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1762166856.345702:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451971328:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1762166856.345865:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934820 00000100:00100000:0.0:1762166856.345906:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451971456:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166856.345929:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166856.345953:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166856.345979:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451971456 00000100:00100000:3.0:1762166856.345985:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451971456 00000100:00100000:3.0:1762166856.346013:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1762166856.346022:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:30821:x1847765451971456:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166856.346145:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:30821:x1847765451971456:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 125us (214us total) trans 17179869448 rc 0/0 00000100:00100000:3.0:1762166856.346154:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1762166856.346173:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451971456:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1762166856.346219:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934821 00010000:00010000:0.0:1762166856.346236:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e2ea lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.346242:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e2ea lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.346246:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e2ea lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.346249:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.346252:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e2ea lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.346256:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e2ea lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.346264:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2b:0x0].0x0 (ffff9ee34bdb4400) 00010000:00010000:0.0:1762166856.346272:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166856.346276:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e2ea lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.346280:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e2ea lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.346292:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2e3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.346296:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2e3 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.346299:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2e3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.346302:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.346303:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2e3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.346306:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2e3 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.346311:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.346314:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166856.346316:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2e3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.346321:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2e3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.346331:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.346332:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166856.346338:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e28f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9158c expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.346411:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342fe8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49205:x1847765444440064:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 5947us (6080us total) trans 8589934822 rc 0/0 00000100:00100000:0.0:1762166856.346416:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 87 00000020:00080000:0.0:1762166856.346419:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166856.347320:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.347363:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444440832 00000100:00100000:0.0:1762166856.347368:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444440832 00000100:00100000:0.0:1762166856.347405:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 235 00000100:00100000:0.0:1762166856.347415:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49205:x1847765444440832:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.347444:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.347460:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e2f1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f915bd expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.347505:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e2f1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915bd expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.347518:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e2f1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915bd expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.347534:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166856.347536:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166856.347539:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198000, rc 0) 00000100:00100000:0.0:1762166856.347574:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49205:x1847765444440832:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 161us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.347580:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 235 00000100:00100000:2.0:1762166856.348859:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.348899:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444441088 00000100:00100000:0.0:1762166856.348906:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444441088 00000100:00100000:0.0:1762166856.348958:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 89 00000100:00100000:0.0:1762166856.348966:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49205:x1847765444441088:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166856.349129:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49205:x1847765444441088:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 162us (269us total) trans 8589934823 rc 0/0 00000100:00100000:0.0:1762166856.349135:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 89 00000100:00100000:1.0:1762166856.350057:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.350101:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444441344 00000100:00100000:0.0:1762166856.350107:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444441344 00000100:00100000:0.0:1762166856.350143:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 90 00000100:00100000:0.0:1762166856.350152:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49205:x1847765444441344:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:0.0:1762166856.350335:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x2b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166856.350414:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e2f8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.350441:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e2f8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.350460:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e2f8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.350466:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e2f8 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.350470:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e2f8 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.350473:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e2f8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.350487:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166856.350525:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166856.350532:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e2f8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.350538:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166856.350541:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e2f8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.350547:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e2f8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166856.350553:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49205:x1847765444441344:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 400us (495us total) trans 8589934824 rc 0/0 00010000:00010000:2.0:1762166856.350559:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2b:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:2.0:1762166856.350562:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166856.350565:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e2f8 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.350574:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e2f8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166856.350584:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 90 00010000:00010000:2.0:1762166856.350592:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166856.350596:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166856.350598:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166856.358701:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.358855:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444441472 00000100:00100000:0.0:1762166856.358869:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444441472 00000100:00100000:0.0:1762166856.358932:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 236 00000100:00100000:0.0:1762166856.358942:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49207:x1847765444441472:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166856.358962:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.358978:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2ff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f915c4 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.359024:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e306 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359033:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e306 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359040:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e306 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359049:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e30d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359053:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e30d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359057:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e30d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359137:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e314 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359141:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e314 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359157:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e314 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.359181:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166856.359184:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166856.359196:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e314 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359203:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e314 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359208:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e306 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359212:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e306 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359216:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e306 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359220:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.359223:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e306 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359230:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e306 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359240:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166856.359243:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.359247:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e306 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359253:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e306 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359272:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e30d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359278:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e30d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359284:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e30d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359288:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.359291:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e30d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359297:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e30d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359304:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.359307:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.359310:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e30d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359315:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e30d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.359343:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e2ff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915c4 expref: 32 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.359355:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e314 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915c4 expref: 31 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.359362:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166856.359369:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166856.359372:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199000, rc 0) 00000100:00100000:0.0:1762166856.359445:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49207:x1847765444441472:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 504us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.359451:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 236 00000100:00100000:3.0:1762166856.372095:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.372148:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444441600 00000100:00100000:0.0:1762166856.372159:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444441600 00000100:00100000:0.0:1762166856.372219:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 237 00000100:00100000:0.0:1762166856.372230:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49211:x1847765444441600:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166856.372300:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e31b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372318:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e31b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372329:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e31b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372344:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e322 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372350:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e322 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372356:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e322 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372475:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e329 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372483:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e329 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372514:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e329 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.372545:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166856.372550:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166856.372561:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e329 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372573:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e31b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372579:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e31b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372586:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e31b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372591:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.372595:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e31b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372601:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e31b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372612:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166856.372615:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.372620:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e31b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372625:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e31b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372637:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e322 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372648:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e322 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372653:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e322 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372658:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.372661:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e322 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372667:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e322 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372675:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.372677:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.372680:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e322 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372684:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e322 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372694:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e329 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372698:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e329 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372701:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e329 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372704:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.372706:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e329 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372714:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e329 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372719:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166856.372720:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.372721:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e329 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.372725:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e329 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166856.372855:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49211:x1847765444441600:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 626us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.372861:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 237 00000100:00100000:1.0:1762166856.382157:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.382230:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444441856 00000100:00100000:0.0:1762166856.382239:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444441856 00000100:00100000:0.0:1762166856.382286:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 238 00000100:00100000:0.0:1762166856.382293:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49213:x1847765444441856:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.382313:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.382338:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e330 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f915cb expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.382446:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e337 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.382460:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e337 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.382471:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e337 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.382494:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166856.382614:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e330 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915cb expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.382630:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e337 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915cb expref: 33 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.382640:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166856.382643:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166856.382646:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198400, rc 0) 00000100:00100000:0.0:1762166856.382711:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49213:x1847765444441856:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 418us (559us total) trans 8589934825 rc 0/0 00000100:00100000:0.0:1762166856.382718:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 238 00000100:00100000:1.0:1762166856.384394:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.384452:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444442112 00000100:00100000:0.0:1762166856.384459:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444442112 00000100:00100000:0.0:1762166856.384501:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 239 00000100:00100000:0.0:1762166856.384530:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49213:x1847765444442112:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.384554:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.384567:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e345 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f915d2 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.384650:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e34c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.384664:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e314 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915c4 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.384672:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e34c lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.384706:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e314 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915c4 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.384716:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e314 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915c4 expref: 34 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.384726:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451971584:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.384802:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.385752:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451971584:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.385795:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e34c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166856.385986:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.386071:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444442240 00000100:00100000:3.0:1762166856.386077:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444442240 00010000:00010000:3.0:1762166856.386109:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e314 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915c4 expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:3.0:1762166856.386140:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 707 00000100:00100000:3.0:1762166856.386149:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444442240:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.386160:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.386167:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e314 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915c4 expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166856.386180:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e314 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915c4 expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166856.386197:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e314 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915c4 expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166856.386211:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:3.0:1762166856.386216:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e34c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.386224:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e34c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.386231:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e34c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.386253:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.386276:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e34c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.386282:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e34c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166856.386293:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765444442240:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 144us (307us total) trans 0 rc 0/0 00000004:00200000:0.0:1762166856.386295:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000100:00100000:3.0:1762166856.386305:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 707 00010000:00010000:0.0:1762166856.386409:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e345 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915d2 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.386423:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e34c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915d2 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.386444:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166856.386447:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166856.386450:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199e00, rc 0) 00000100:00100000:0.0:1762166856.386499:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49213:x1847765444442112:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1971us (2109us total) trans 8589934826 rc 0/0 00000100:00100000:0.0:1762166856.386505:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 239 00000100:00100000:1.0:1762166856.387577:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.387622:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444442368 00000100:00100000:0.0:1762166856.387627:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444442368 00000100:00100000:0.0:1762166856.387659:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 91 00000100:00100000:0.0:1762166856.387667:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49213:x1847765444442368:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:0.0:1762166856.387754:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49213:x1847765444442368:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 88us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.387786:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 91 00000100:00100000:3.0:1762166856.388614:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.388676:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444442624 00000100:00100000:0.0:1762166856.388681:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444442624 00000100:00100000:0.0:1762166856.388715:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 92 00000100:00100000:0.0:1762166856.388721:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49213:x1847765444442624:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166856.388863:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49213:x1847765444442624:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 142us (252us total) trans 8589934827 rc 0/0 00000100:00100000:0.0:1762166856.388868:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 92 00000100:00100000:1.0:1762166856.389758:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.389853:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444442880 00000100:00100000:0.0:1762166856.389859:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444442880 00000100:00100000:0.0:1762166856.389904:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 240 00000100:00100000:0.0:1762166856.389913:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49213:x1847765444442880:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.389926:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.389929:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166856.389950:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e34c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915d2 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.389984:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e337 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915cb expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.389992:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166856.389995:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.390004:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e35a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f915d9 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.390058:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e361 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.390069:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e361 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.390078:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e361 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.390089:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166856.390179:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e35a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915d9 expref: 36 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.390192:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e361 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915d9 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.390198:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166856.390201:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166856.390203:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199c00, rc 0) 00000100:00100000:0.0:1762166856.390243:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49213:x1847765444442880:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 332us (487us total) trans 8589934828 rc 0/0 00000100:00100000:0.0:1762166856.390257:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 240 00000100:00100000:1.0:1762166856.391408:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.391474:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444443136 00000100:00100000:0.0:1762166856.391485:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444443136 00000100:00100000:0.0:1762166856.391532:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 93 00000100:00100000:0.0:1762166856.391540:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342feb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49213:x1847765444443136:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166856.391579:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e361 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915d9 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.391598:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e36f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.391605:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e2f1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915bd expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.391611:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e36f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.391633:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e2f1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915bd expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.391641:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e2f1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915bd expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.391650:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451971712:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.391708:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.392968:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451971712:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.392998:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e36f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166856.393004:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.393068:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444443264 00000100:00100000:1.0:1762166856.393080:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444443264 00010000:00010000:1.0:1762166856.393128:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e2f1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915bd expref: 36 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.393181:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 708 00000100:00100000:1.0:1762166856.393192:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765444443264:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166856.393210:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.393218:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e2f1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915bd expref: 36 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.393230:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e2f1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915bd expref: 36 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.393266:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e2f1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915bd expref: 36 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.393285:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:1.0:1762166856.393291:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e36f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.393300:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e36f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.393308:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e36f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.393357:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.393405:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e36f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.393414:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e36f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166856.393424:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444443264:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 229us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.393443:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 708 00010000:00010000:0.0:1762166856.393656:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e36f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.393668:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e36f lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.393675:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e36f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.393681:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.393685:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e36f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.393692:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e36f lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.393706:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166856.393709:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166856.393714:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e36f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.393719:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e36f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.393730:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166856.393732:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166856.393746:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e361 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915d9 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.393896:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342feb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49213:x1847765444443136:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2355us (2497us total) trans 8589934829 rc -22/-22 00000100:00100000:0.0:1762166856.393905:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 93 00000100:00100000:3.0:1762166856.395120:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.395191:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444443392 00000100:00100000:0.0:1762166856.395199:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444443392 00000100:00100000:0.0:1762166856.395253:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 241 00000100:00100000:0.0:1762166856.395265:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49213:x1847765444443392:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.395291:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.395316:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e376 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f915e0 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.395378:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e376 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915e0 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.395393:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e376 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915e0 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.395411:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.395414:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166856.395417:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198800, rc 0) 00000100:00100000:0.0:1762166856.395478:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49213:x1847765444443392:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 216us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.395485:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 241 00000100:00100000:1.0:1762166856.397246:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.397307:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444443648 00000100:00100000:0.0:1762166856.397317:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444443648 00000100:00100000:0.0:1762166856.397396:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 242 00000100:00100000:0.0:1762166856.397407:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49213:x1847765444443648:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.397439:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.397459:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e37d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f915e7 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.398035:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e384 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.398049:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e384 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.398061:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e384 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.398073:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2c:0x0]: returning size 0 00010000:00010000:0.0:1762166856.398126:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e37d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915e7 expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.398145:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e384 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915e7 expref: 37 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.398154:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2c:0x0].0x0 (ffff9ee34bdb4400) 00010000:00010000:0.0:1762166856.398158:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166856.398161:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198400, rc 0) 00000100:00100000:0.0:1762166856.398221:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49213:x1847765444443648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 816us (983us total) trans 8589934830 rc 0/0 00000100:00100000:0.0:1762166856.398227:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 242 00000100:00100000:3.0:1762166856.399732:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.399824:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444443904 00000100:00100000:0.0:1762166856.399832:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444443904 00000100:00100000:0.0:1762166856.399894:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 243 00000100:00100000:0.0:1762166856.399904:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49213:x1847765444443904:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.399930:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.399945:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e392 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f915ee expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.400024:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e399 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.400037:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e399 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.400047:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e399 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.400059:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166856.400164:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e392 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915ee expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.400179:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e399 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915ee expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.400189:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.400192:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166856.400195:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199600, rc 0) 00000100:00100000:0.0:1762166856.400246:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49213:x1847765444443904:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 344us (519us total) trans 8589934831 rc 0/0 00000100:00100000:0.0:1762166856.400264:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 243 00000100:00100000:3.0:1762166856.401294:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.401351:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444444160 00000100:00100000:0.0:1762166856.401359:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444444160 00000100:00100000:0.0:1762166856.401417:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 94 00000100:00100000:0.0:1762166856.401436:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49213:x1847765444444160:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166856.401508:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e399 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915ee expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.401545:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3a7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.401557:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e376 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915e0 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.401566:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3a7 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.401598:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e376 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915e0 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.401611:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e376 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915e0 expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.401624:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451971840:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.401694:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.402664:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451971840:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.402694:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3a7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166856.402816:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.402864:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444444288 00000100:00100000:1.0:1762166856.402873:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444444288 00010000:00010000:1.0:1762166856.402907:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e376 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915e0 expref: 40 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.402946:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 709 00000100:00100000:1.0:1762166856.402956:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2361:x1847765444444288:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166856.402971:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.402977:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e376 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915e0 expref: 40 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.402990:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e376 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915e0 expref: 40 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.403009:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e376 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915e0 expref: 40 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.403025:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:1.0:1762166856.403029:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3a7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.403038:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3a7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.403063:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3a7 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.403092:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.403112:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3a7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.403119:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3a7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.403141:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3ae lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166856.403146:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444444288:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 189us (334us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166856.403153:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e384 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915e7 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.403161:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3ae lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166856.403162:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 709 00010000:00010000:0.0:1762166856.403190:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e384 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915e7 expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.403201:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e384 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915e7 expref: 38 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.403211:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451971968:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.403269:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.403981:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451971968:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.403996:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3ae lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166856.404612:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.404655:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444444416 00000100:00100000:1.0:1762166856.404660:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444444416 00010000:00010000:1.0:1762166856.404678:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e384 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915e7 expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.404706:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 710 00000100:00100000:1.0:1762166856.404712:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444444416:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166856.404720:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.404724:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e384 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915e7 expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.404730:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e384 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915e7 expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.404741:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e384 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915e7 expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.404750:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2c:0x0].0x0 (ffff9ee34bdb4400) 00010000:00010000:1.0:1762166856.404753:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3ae lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.404790:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.404795:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3ae lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.404809:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.404820:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.404830:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166856.404852:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2360:x1847765444444416:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 138us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.404860:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 710 00000100:00100000:0.0:1762166856.405323:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451972096:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166856.405373:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166856.405419:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166856.405464:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451972096 00000100:00100000:3.0:1762166856.405474:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451972096 00000100:00100000:3.0:1762166856.405527:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1762166856.405536:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:30821:x1847765451972096:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166856.405645:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:30821:x1847765451972096:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 109us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.405653:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1762166856.405690:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451972096:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1762166856.405824:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934832 00000001:00080000:0.0:1762166856.405953:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934833 00010000:00010000:0.0:1762166856.405977:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.405986:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3ae lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.405993:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3ae lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.405999:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.406003:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3ae lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.406010:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3ae lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.406023:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2c:0x0].0x0 (ffff9ee34bdb4400) 00010000:00010000:0.0:1762166856.406026:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166856.406031:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3ae lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.406036:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3ae lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.406054:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3a7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.406057:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3a7 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.406069:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3a7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.406072:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.406074:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3a7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.406077:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3a7 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.406082:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.406083:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166856.406085:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3a7 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.406088:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3a7 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.406096:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.406097:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166856.406100:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e399 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915ee expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.406173:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49213:x1847765444444160:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 4749us (4890us total) trans 8589934834 rc 0/0 00000100:00100000:0.0:1762166856.406180:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 94 00000020:00080000:0.0:1762166856.406182:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166856.407050:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.407089:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444444544 00000100:00100000:0.0:1762166856.407094:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444444544 00000100:00100000:0.0:1762166856.407133:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 244 00000100:00100000:0.0:1762166856.407142:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49213:x1847765444444544:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.407164:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.407181:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e3b5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f915f5 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.407223:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e3b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915f5 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.407235:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e3b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915f5 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.407250:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166856.407253:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166856.407255:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198600, rc 0) 00000100:00100000:0.0:1762166856.407292:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49213:x1847765444444544:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 151us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.407299:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 244 00000100:00100000:3.0:1762166856.408403:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.408457:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444444800 00000100:00100000:0.0:1762166856.408463:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444444800 00000100:00100000:0.0:1762166856.408497:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 95 00000100:00100000:0.0:1762166856.408506:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49213:x1847765444444800:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:0.0:1762166856.408902:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x2c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1762166856.408991:0:30821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].14, 64 off9280 00000004:00080000:0.0:1762166856.409001:0:30821:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 477201238408ns, next at 478201236340ns, rc = 0 00000001:00080000:0.0:1762166856.409007:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934835 00010000:00010000:0.0:1762166856.409045:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e3bc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.409057:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e3bc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.409074:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e3bc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.409082:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e3bc lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.409088:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e3bc lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.409094:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e3bc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.409115:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166856.409148:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166856.409156:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e3bc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.409164:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166856.409169:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e3bc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.409176:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e3bc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.409188:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2c:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:1.0:1762166856.409191:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166856.409195:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e3bc lrc: 1/0,0 mode: --/PW res: [0x200000404:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166856.409201:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49213:x1847765444444800:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 694us (798us total) trans 8589934836 rc 0/0 00010000:00010000:1.0:1762166856.409204:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e3bc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166856.409214:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 95 00000020:00080000:0.0:1762166856.409220:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762166856.409228:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166856.409232:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166856.409235:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166856.410575:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.410615:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444445056 00000100:00100000:0.0:1762166856.410622:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444445056 00000100:00100000:0.0:1762166856.410657:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 96 00000100:00100000:0.0:1762166856.410669:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49213:x1847765444445056:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166856.410937:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49213:x1847765444445056:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 272us (365us total) trans 8589934837 rc 0/0 00000100:00100000:0.0:1762166856.410944:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 96 00000100:00100000:3.0:1762166856.418642:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.418705:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444445184 00000100:00100000:0.0:1762166856.418714:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444445184 00000100:00100000:0.0:1762166856.418790:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 245 00000100:00100000:0.0:1762166856.418802:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49215:x1847765444445184:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166856.418839:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.418857:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e3c3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f915fc expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.418913:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3ca lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.418926:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3ca lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.418936:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3ca lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.418949:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3d1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.418956:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.418962:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419049:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e3d8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419055:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419059:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.419085:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166856.419088:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166856.419118:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419136:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419144:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3ca lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419149:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3ca lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419155:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3ca lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419161:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.419165:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3ca lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419171:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3ca lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419181:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166856.419184:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.419189:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3ca lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419194:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e3ca lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419206:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419212:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3d1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419217:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419229:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.419232:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419238:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3d1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419246:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.419248:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.419251:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3d1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419256:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3d1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.419286:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e3c3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915fc expref: 45 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.419298:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915fc expref: 44 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.419305:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166856.419307:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166856.419309:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199a00, rc 0) 00000100:00100000:0.0:1762166856.419363:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49215:x1847765444445184:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 564us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.419369:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 245 00000100:00100000:3.0:1762166856.421064:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.421114:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444445312 00000100:00100000:0.0:1762166856.421124:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444445312 00000100:00100000:0.0:1762166856.421175:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1113 00000100:00100000:0.0:1762166856.421181:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444445312:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166856.421193:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.421204:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e3df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91603 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.421247:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345733100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451972224:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166856.421304:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.422308:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345733100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451972224:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166856.422336:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e3df lrc: 1/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91603 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.422354:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e3df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91603 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.422366:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198e00, rc 0) 00000100:00100000:0.0:1762166856.422413:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444445312:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 1231us (1355us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166856.422422:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1113 00000100:00100000:3.0:1762166856.436839:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.436886:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444445440 00000100:00100000:0.0:1762166856.436896:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444445440 00000100:00100000:0.0:1762166856.436946:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 246 00000100:00100000:0.0:1762166856.436955:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49219:x1847765444445440:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166856.437018:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e3e6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437050:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e3e6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437061:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e3e6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437075:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e3ed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437082:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e3ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437088:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e3ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437191:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3f4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437198:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437204:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.437233:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166856.437237:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166856.437253:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437264:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e3e6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437270:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e3e6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437286:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e3e6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437291:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.437295:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e3e6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437302:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e3e6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437314:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166856.437317:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.437321:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e3e6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437327:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e3e6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437339:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e3ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437345:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e3ed lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437349:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e3ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437354:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.437356:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e3ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437362:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e3ed lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437375:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166856.437377:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.437380:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e3ed lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437385:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e3ed lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437398:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437404:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3f4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437409:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437414:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.437416:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437422:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3f4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437442:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166856.437444:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.437447:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3f4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.437452:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3f4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166856.437527:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49219:x1847765444445440:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 573us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.437541:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 246 00000100:00100000:3.0:1762166856.447107:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.447208:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444445696 00000100:00100000:0.0:1762166856.447217:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444445696 00000100:00100000:0.0:1762166856.447282:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 247 00000100:00100000:0.0:1762166856.447292:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49221:x1847765444445696:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.447314:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.447332:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3fb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9160a expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.447422:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e402 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.447449:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e402 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.447461:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e402 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.447472:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166856.447592:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e3fb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9160a expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.447610:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e402 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9160a expref: 46 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.447618:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166856.447621:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166856.447624:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199600, rc 0) 00000100:00100000:0.0:1762166856.447698:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49221:x1847765444445696:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 408us (597us total) trans 8589934838 rc 0/0 00000100:00100000:0.0:1762166856.447719:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 247 00000100:00100000:3.0:1762166856.449497:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.449583:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444445824 00000100:00100000:0.0:1762166856.449592:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444445824 00000100:00100000:0.0:1762166856.449646:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1114 00000100:00100000:0.0:1762166856.449656:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765444445824:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.449671:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.449686:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e410 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91611 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.449736:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345733100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451972352:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166856.449834:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.450992:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345733100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451972352:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166856.451022:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e410 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91611 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.451038:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e410 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91611 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.451046:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198e00, rc 0) 00000100:00100000:0.0:1762166856.451096:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765444445824:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1441us (1605us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166856.451103:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1114 00000100:00100000:3.0:1762166856.452923:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.453008:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444446080 00000100:00100000:0.0:1762166856.453017:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444446080 00000100:00100000:0.0:1762166856.453077:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 248 00000100:00100000:0.0:1762166856.453106:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49221:x1847765444446080:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.453126:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.453143:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e417 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91618 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.453233:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e41e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.453247:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e3d8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915fc expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.453255:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e41e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.453285:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915fc expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.453298:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e3d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915fc expref: 47 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.453310:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345733100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451972480:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.453377:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.454505:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345733100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451972480:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.454530:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e41e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166856.454814:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.454866:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444446208 00000100:00100000:1.0:1762166856.454874:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444446208 00010000:00010000:1.0:1762166856.454903:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e3d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915fc expref: 48 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.454942:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 711 00000100:00100000:1.0:1762166856.454952:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2360:x1847765444446208:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166856.454966:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.454972:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e3d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915fc expref: 48 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.454983:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915fc expref: 48 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.455001:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e3d8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915fc expref: 48 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.455021:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:1.0:1762166856.455025:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e41e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.455033:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e41e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.455040:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e41e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.455065:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.455099:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e41e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.455107:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e41e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166856.455110:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:2360:x1847765444446208:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 158us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.455119:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 711 00000004:00200000:2.0:1762166856.455122:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166856.455247:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e417 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91618 expref: 48 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.455276:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e41e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91618 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.455284:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:2.0:1762166856.455287:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166856.455289:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199e00, rc 0) 00000100:00100000:2.0:1762166856.455323:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49221:x1847765444446080:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2219us (2406us total) trans 8589934839 rc 0/0 00000100:00100000:2.0:1762166856.455330:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 248 00000100:00100000:3.0:1762166856.457276:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.457328:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444446464 00000100:00100000:2.0:1762166856.457335:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444446464 00000100:00100000:2.0:1762166856.457386:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 249 00000100:00100000:2.0:1762166856.457397:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49221:x1847765444446464:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.457420:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.457456:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e42c lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9161f expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.457945:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e433 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.457963:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e433 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.457974:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e433 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.457985:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 0 00010000:00010000:2.0:1762166856.458025:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e42c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9161f expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.458049:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e433 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9161f expref: 49 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.458055:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:2.0:1762166856.458057:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166856.458059:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7cc00, rc 0) 00000100:00100000:2.0:1762166856.458103:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49221:x1847765444446464:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 709us (834us total) trans 8589934840 rc 0/0 00000100:00100000:2.0:1762166856.458110:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 249 00000100:00100000:3.0:1762166856.459820:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.459861:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444446720 00000100:00100000:2.0:1762166856.459869:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444446720 00000100:00100000:2.0:1762166856.459919:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 250 00000100:00100000:2.0:1762166856.459928:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49221:x1847765444446720:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.459948:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.459964:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e441 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91626 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.460049:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e448 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.460058:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e433 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9161f expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.460064:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e448 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.460090:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e433 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9161f expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.460121:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e433 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9161f expref: 50 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.460131:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451972608:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.460197:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34aab0480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.461208:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451972608:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.461229:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e448 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166856.461481:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.461550:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444446848 00000100:00100000:0.0:1762166856.461556:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444446848 00010000:00010000:0.0:1762166856.461579:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e433 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9161f expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.461624:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 712 00000100:00100000:0.0:1762166856.461635:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f623b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444446848:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.461648:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.461654:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e433 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9161f expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.461667:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e433 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9161f expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.461687:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e433 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9161f expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.461702:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:0.0:1762166856.461707:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e448 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.461715:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e448 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.461722:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e448 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.461744:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.461788:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e448 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.461797:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e448 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.461812:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 0 00000100:00100000:0.0:1762166856.461817:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f623b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2361:x1847765444446848:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 183us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.461827:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 712 00000004:00080000:2.0:1762166856.462116:0:30817:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x88:0x0], index 0: 0 00010000:00010000:2.0:1762166856.462237:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e448 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.462242:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e448 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.462246:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e448 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.462250:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.462252:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e448 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.462265:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e448 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.462272:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:2.0:1762166856.462274:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166856.462276:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e448 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.462279:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e448 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.462319:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e441 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91626 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.462328:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166856.462330:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166856.462334:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e441 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91626 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.462342:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7ce00, rc 0) 00000100:00100000:2.0:1762166856.462379:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49221:x1847765444446720:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2452us (2566us total) trans 8589934841 rc 301/301 00000100:00100000:2.0:1762166856.462387:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 250 00000100:00100000:3.0:1762166856.463533:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.463577:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444447104 00000100:00100000:0.0:1762166856.463584:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444447104 00000100:00100000:0.0:1762166856.463630:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 97 00000100:00100000:0.0:1762166856.463636:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49221:x1847765444447104:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166856.463946:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49221:x1847765444447104:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 309us (418us total) trans 8589934842 rc 0/0 00000100:00100000:0.0:1762166856.463951:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 97 00000100:00100000:3.0:1762166856.464914:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.464968:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444447232 00000100:00100000:2.0:1762166856.464975:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444447232 00000100:00100000:2.0:1762166856.465017:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 251 00000100:00100000:2.0:1762166856.465027:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49221:x1847765444447232:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.465042:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.465062:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e456 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9162d expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.465112:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e45d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.465122:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e41e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91618 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.465127:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e45d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.465150:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e41e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91618 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.465159:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e41e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91618 expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.465168:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451972736:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.465220:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.466034:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451972736:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.466068:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e45d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166856.466204:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.466251:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444447360 00000100:00100000:0.0:1762166856.466257:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444447360 00010000:00010000:0.0:1762166856.466282:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e41e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91618 expref: 52 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.466316:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 713 00000100:00100000:0.0:1762166856.466327:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2360:x1847765444447360:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.466339:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.466346:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e41e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91618 expref: 52 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.466359:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e41e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91618 expref: 52 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.466379:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e41e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91618 expref: 52 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.466392:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166856.466397:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e45d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.466405:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e45d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.466436:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e45d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.466462:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.466485:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e45d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.466495:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e45d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166856.466507:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2360:x1847765444447360:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 182us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.466517:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 713 00000004:00200000:2.0:1762166856.466528:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166856.466539:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166856.466559:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e45d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.466588:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e456 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9162d expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.466604:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e45d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9162d expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.466612:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:2.0:1762166856.466614:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166856.466616:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3400, rc 0) 00000100:00100000:2.0:1762166856.466645:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49221:x1847765444447232:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1621us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.466649:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 251 00000100:00100000:3.0:1762166856.467849:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.467887:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444447488 00000100:00100000:0.0:1762166856.467896:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444447488 00000100:00100000:0.0:1762166856.467948:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1115 00000100:00100000:0.0:1762166856.467956:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444447488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.467970:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.467986:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e464 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91634 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.468038:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345733100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451972864:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166856.468110:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.469006:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345733100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451972864:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166856.469033:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e464 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91634 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.469052:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e464 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91634 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.469064:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198e00, rc 0) 00000100:00100000:0.0:1762166856.469109:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444447488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1150us (1261us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166856.469128:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1115 00000100:00100000:3.0:1762166856.470234:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.470286:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444447616 00000100:00100000:2.0:1762166856.470294:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444447616 00000100:00100000:2.0:1762166856.470352:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 252 00000100:00100000:2.0:1762166856.470363:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49221:x1847765444447616:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.470381:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.470403:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e46b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9163b expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.470486:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e472 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.470499:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e472 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.470511:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e472 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.470558:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2d:0x0]: returning size 0 00000004:00200000:2.0:1762166856.470562:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166856.470577:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e472 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.470603:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e46b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9163b expref: 52 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.470619:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e472 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9163b expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.470627:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff9ee359d01a00) 00010000:00010000:2.0:1762166856.470630:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166856.470633:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2600, rc 0) 00000100:00100000:2.0:1762166856.470680:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49221:x1847765444447616:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 320us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.470687:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 252 00000100:00100000:3.0:1762166856.472038:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.472077:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444447744 00000100:00100000:0.0:1762166856.472083:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444447744 00000100:00100000:0.0:1762166856.472117:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1116 00000100:00100000:0.0:1762166856.472129:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444447744:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.472144:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.472160:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e479 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91642 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166856.472183:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166856.472199:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.472201:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.472208:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e479 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91642 expref: 28 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.472223:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e479 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91642 expref: 28 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.472239:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198c00, rc 0) 00000100:00100000:0.0:1762166856.472282:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444447744:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 154us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.472289:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1116 00000100:00100000:3.0:1762166856.473500:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.473567:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444448000 00000100:00100000:2.0:1762166856.473573:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444448000 00000100:00100000:2.0:1762166856.473613:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 253 00000100:00100000:2.0:1762166856.473622:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49221:x1847765444448000:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.473636:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.473652:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e480 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91649 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.473732:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e487 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.473785:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e487 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.473794:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e487 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.473806:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166856.473911:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e480 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91649 expref: 54 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.473925:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e487 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91649 expref: 53 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.473931:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:2.0:1762166856.473933:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166856.473936:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2400, rc 0) 00000100:00100000:2.0:1762166856.473987:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49221:x1847765444448000:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 367us (491us total) trans 8589934843 rc 0/0 00000100:00100000:2.0:1762166856.473992:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 253 00000100:00100000:3.0:1762166856.475348:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.475391:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444448128 00000100:00100000:0.0:1762166856.475399:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444448128 00000100:00100000:0.0:1762166856.475453:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1117 00000100:00100000:0.0:1762166856.475464:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444448128:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.475485:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.475497:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9e495 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91650 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.475538:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345733100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451972992:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166856.475607:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.476649:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345733100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451972992:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166856.476680:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9e495 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91650 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.476698:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9e495 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91650 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.476709:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199200, rc 0) 00000100:00100000:0.0:1762166856.476755:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444448128:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1293us (1410us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166856.476789:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1117 00000100:00100000:3.0:1762166856.478213:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.478283:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444448256 00000100:00100000:0.0:1762166856.478291:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444448256 00000100:00100000:0.0:1762166856.478338:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1118 00000100:00100000:0.0:1762166856.478345:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444448256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.478359:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.478375:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e49c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91657 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.478440:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345733100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451973120:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166856.478524:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.479470:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345733100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451973120:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166856.479502:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e49c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91657 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.479523:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e49c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91657 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.479535:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198a00, rc 0) 00000100:00100000:0.0:1762166856.479576:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444448256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1231us (1369us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166856.479582:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1118 00000100:00100000:3.0:1762166856.480609:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.480655:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444448384 00000100:00100000:0.0:1762166856.480663:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444448384 00000100:00100000:0.0:1762166856.480706:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1119 00000100:00100000:0.0:1762166856.480715:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444448384:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762166856.480750:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4a3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.480792:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e2ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915af expref: 26 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.480800:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166856.480802:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166856.480805:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4a3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.480852:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e2ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915af expref: 26 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.480865:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e2ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915af expref: 26 pid: 6532 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.480878:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345733100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451973248:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.480938:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.481899:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345733100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451973248:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.481920:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4a3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166856.482066:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.482102:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444448512 00000100:00100000:0.0:1762166856.482108:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444448512 00010000:00010000:0.0:1762166856.482131:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e2ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915af expref: 27 pid: 6532 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.482165:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 714 00000100:00100000:0.0:1762166856.482173:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444448512:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.482188:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.482209:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e2ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915af expref: 27 pid: 6532 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.482221:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e2ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915af expref: 27 pid: 6532 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.482256:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e2ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915af expref: 27 pid: 6532 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.482269:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.482272:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.482276:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4a3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.482284:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4a3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.482307:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.482332:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4a3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.482348:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4a3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.482350:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444448512:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 177us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.482366:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 714 00010000:00010000:2.0:1762166856.482382:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4a3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.482403:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.482410:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.482417:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166856.482421:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.482442:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.482456:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.482464:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.482526:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444448384:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 1811us (1920us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.482534:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1119 00000100:00100000:3.0:1762166856.483515:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.483558:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444448640 00000100:00100000:2.0:1762166856.483565:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444448640 00000100:00100000:2.0:1762166856.483605:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1120 00000100:00100000:2.0:1762166856.483614:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444448640:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.483637:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.483655:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e4aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9165e expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166856.483674:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x87:0x0] initial LVB size: 0, mtime: 0x69088847, atime: 0x69088847, ctime: 0x69088848, blocks: 0x1 00010000:00010000:2.0:1762166856.483691:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.483693:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.483700:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e4aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9165e expref: 26 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.483715:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e4aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9165e expref: 26 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.483725:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c600, rc 0) 00000100:00100000:2.0:1762166856.483798:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444448640:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 184us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.483805:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1120 00000100:00100000:3.0:1762166856.507959:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.508033:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444448768 00000100:00100000:2.0:1762166856.508043:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444448768 00000100:00100000:2.0:1762166856.508104:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 254 00000100:00100000:2.0:1762166856.508114:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49221:x1847765444448768:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:2.0:1762166856.519297:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934842 is committed 00000004:00080000:2.0:1762166856.519329:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000020:00080000:2.0:1762166856.519404:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee3606c9b40 refcount 2 committed 0 result 0 batchid 4294969118 00000020:00080000:2.0:1762166856.519412:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee34368fd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3606c9f00 00000020:00080000:2.0:1762166856.519416:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee34368f700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee36e364000 00000100:00100000:0.0:1762166856.519459:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49221:x1847765444448768:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 11337us (11500us total) trans 0 rc 0/0 00000020:00080000:2.0:1762166856.519460:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969117 batchid updated 00000001:00080000:2.0:1762166856.519472:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934843 is committed 00000100:00100000:0.0:1762166856.519487:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 254 00000020:00080000:2.0:1762166856.519504:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969118 committed batchid 4294969117 00000100:00100000:1.0:1762166856.519564:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee3819b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451973376:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166856.519611:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1762166856.519628:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451973632:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166856.519640:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166856.519708:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451973376 00000020:00080000:2.0:1762166856.519709:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969117 00000100:00100000:0.0:1762166856.519718:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451973376 00000100:00100000:2.0:1762166856.519728:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee3819bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451973504:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166856.519737:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166856.519785:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451973632 00000100:00100000:0.0:1762166856.519789:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451973632 00000100:00100000:2.0:1762166856.519796:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166856.519825:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451973504 00000100:00100000:3.0:1762166856.519830:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451973504 00000100:00100000:0.0:1762166856.519837:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1762166856.519848:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:0.0:1762166856.519849:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765451973376:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166856.519863:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765451973632:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762166856.519872:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00002000:00080000:1.0:1762166856.519884:0:6533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:135 count 1 00002000:00080000:0.0:1762166856.519884:0:6532:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:133 count 1 00000100:00100000:2.0:1762166856.519885:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765451973504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1762166856.519906:0:26444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:134 count 1 00010000:00010000:1.0:1762166856.519919:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e4b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.519920:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e4b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.519922:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e4bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.519954:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e2dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915b6 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.519954:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d871 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911aa expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.519955:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9deec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9143c expref: 27 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.519981:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166856.519982:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166856.519983:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9dabd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9129f expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.519985:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166856.519987:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166856.519991:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e4bf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.519993:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e4b1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.519998:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9dab6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91298 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.520020:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daaf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91291 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.520025:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9daa8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9128a expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.520030:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9da9a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91283 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.520035:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9da93 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9127c expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.520041:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9deec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9143c expref: 27 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.520042:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e2dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915b6 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.520043:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9da62 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91260 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.520067:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9da0e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9123d expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.520072:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9deec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9143c expref: 27 pid: 7858 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.520074:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e2dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915b6 expref: 27 pid: 6532 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.520099:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d9dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9122f expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1762166856.520102:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451973888:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166856.520106:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451973760:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.520108:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.520111:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.520115:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e4b8 lrc: 13/0,1 mode: --/PW res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.520137:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d9dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9122f expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.520144:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d9dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9122f expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:0.0:1762166856.520153:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345733100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451974016:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.520186:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34aab0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166856.520186:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a180 going to sleep for 11 seconds 00010000:00010000:0.0:1762166856.520195:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9da0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9123d expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.520207:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9da0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9123d expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:0.0:1762166856.520217:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345731c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451974144:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.520248:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9da62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91260 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.520270:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9da62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91260 expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:0.0:1762166856.520281:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451974272:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.520321:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9da93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9127c expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.520331:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9da93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9127c expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:0.0:1762166856.520340:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451974400:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.520370:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9da9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91283 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.520379:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9da9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91283 expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:0.0:1762166856.520389:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451974528:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.520442:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9daa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9128a expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.520452:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9daa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9128a expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:0.0:1762166856.520475:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451974656:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.520515:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91291 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.520524:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91291 expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:0.0:1762166856.520534:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451974784:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.520581:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9dab6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91298 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.520590:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9dab6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91298 expref: 27 pid: 6532 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.520601:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451974912:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.520640:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9dabd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9129f expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.520649:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9dabd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9129f expref: 27 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:0.0:1762166856.520659:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f623b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451975040:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.520689:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d871 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911aa expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.520708:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d871 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911aa expref: 27 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:0.0:1762166856.520718:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451975168:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.520747:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166856.521134:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.521189:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444448896 00000100:00100000:1.0:1762166856.521195:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444448896 00000100:00100000:1.0:1762166856.521238:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1124 00000100:00100000:1.0:1762166856.521246:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444448896:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:1.0:1762166856.521333:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444448896:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 87us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.521341:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1124 00000100:00100000:1.0:1762166856.522398:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451973760:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.522447:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e4b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.522585:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345733100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451974016:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.522599:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451973888:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.522608:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345731c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451974144:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.522626:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e4bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.522629:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451974272:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.522649:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451974400:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.522668:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451974528:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.522680:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451974656:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.522691:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451974784:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.522701:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451974912:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.522710:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f623b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451975040:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166856.523060:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.523120:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444449536 00000100:00100000:1.0:1762166856.523128:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444449536 00000100:00100000:3.0:1762166856.523162:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166856.523167:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9da62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91260 expref: 28 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.523216:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 715 00000100:00100000:1.0:1762166856.523228:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2358:x1847765444449536:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166856.523246:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.523253:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9da62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91260 expref: 28 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:3.0:1762166856.523263:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166856.523274:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9da62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91260 expref: 28 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:1.0:1762166856.523301:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9da62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91260 expref: 28 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:1.0:1762166856.523321:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166856.523342:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451975168:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166856.523362:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.523466:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444449920 00000100:00100000:2.0:1762166856.523472:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444449920 00010000:00010000:0.0:1762166856.523476:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e4b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.523494:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91291 expref: 28 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:3.0:1762166856.523498:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.523514:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444449152 00000100:00100000:0.0:1762166856.523523:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444449152 00000100:00100000:2.0:1762166856.523524:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444449024 00000100:00100000:2.0:1762166856.523531:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444449024 00010000:00010000:2.0:1762166856.523548:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e2dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915b6 expref: 30 pid: 6532 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.523565:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444449408 00000100:00100000:2.0:1762166856.523569:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444449408 00010000:00010000:0.0:1762166856.523572:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9deec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9143c expref: 30 pid: 7858 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166856.523602:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9da0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9123d expref: 31 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.523604:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2358:x1847765444449536:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 370us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.523611:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 716 00000100:00100000:0.0:1762166856.523640:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2358:x1847765444449920:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166856.523641:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 715 00010000:00010000:0.0:1762166856.523661:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.523670:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91291 expref: 30 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:2.0:1762166856.523677:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 717 00000100:00100000:3.0:1762166856.523688:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762166856.523692:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91291 expref: 30 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.523698:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 718 00000100:00100000:2.0:1762166856.523710:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765444449024:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166856.523726:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765444449152:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166856.523728:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.523736:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9daaf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91291 expref: 30 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:1.0:1762166856.523747:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166856.523748:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166856.523749:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e2dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915b6 expref: 30 pid: 6532 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.523831:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.523839:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e2dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915b6 expref: 29 pid: 6532 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.523842:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9deec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9143c expref: 29 pid: 7858 timeout: 577 lvb_type: 0 00000100:00100000:3.0:1762166856.523863:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.523889:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765444449920:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 256us (725us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166856.523897:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9deec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9143c expref: 29 pid: 7858 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.523906:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 716 00010000:00010000:2.0:1762166856.523917:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e2dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915b6 expref: 29 pid: 6532 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.523929:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9deec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9143c expref: 27 pid: 7858 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166856.523936:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.523941:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1762166856.523948:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444449280 00010000:00010000:2.0:1762166856.523951:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e4b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.523956:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444449280 00010000:00010000:1.0:1762166856.523964:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166856.523969:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.523970:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e4b1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.523977:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e4bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166856.523984:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762166856.523986:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d9dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9122f expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:1.0:1762166856.524022:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e4bf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166856.524025:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.524045:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444450432 00000100:00100000:0.0:1762166856.524052:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444450432 00010000:00010000:2.0:1762166856.524054:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166856.524068:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.524081:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d871 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911aa expref: 28 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:3.0:1762166856.524089:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.524103:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444449024:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 398us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.524116:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444449152:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 394us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.524139:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 717 00000100:00100000:1.0:1762166856.524150:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 718 00000100:00100000:2.0:1762166856.524183:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444449664 00000100:00100000:0.0:1762166856.524185:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444450048 00000100:00100000:1.0:1762166856.524188:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444450304 00000100:00100000:2.0:1762166856.524192:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444449664 00000100:00100000:1.0:1762166856.524193:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444450304 00000100:00100000:0.0:1762166856.524193:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444450048 00010000:00010000:1.0:1762166856.524228:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9dabd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9129f expref: 29 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:0.0:1762166856.524234:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9da9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91283 expref: 29 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166856.524238:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9daa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9128a expref: 29 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.524248:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444449792 00000100:00100000:1.0:1762166856.524256:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444449792 00010000:00010000:1.0:1762166856.524276:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9da93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9127c expref: 30 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:3.0:1762166856.524282:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.524295:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444450176 00000100:00100000:0.0:1762166856.524297:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 719 00000100:00100000:2.0:1762166856.524304:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444450176 00000100:00100000:0.0:1762166856.524317:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765444449408:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166856.524323:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 720 00010000:00010000:2.0:1762166856.524330:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9dab6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91298 expref: 31 pid: 6532 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.524332:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166856.524342:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765444449280:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.524346:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9da0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9123d expref: 31 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:1.0:1762166856.524379:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.524385:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9da0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9123d expref: 31 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:1.0:1762166856.524391:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d9dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9122f expref: 31 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:2.0:1762166856.524403:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 721 00010000:00010000:0.0:1762166856.524407:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9da0e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9123d expref: 31 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:3.0:1762166856.524436:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 722 00010000:00010000:1.0:1762166856.524438:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d9dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9122f expref: 31 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:2.0:1762166856.524445:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2358:x1847765444450432:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.524454:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166856.524463:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9d9dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9122f expref: 30 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166856.524475:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.524480:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.524487:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d871 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911aa expref: 29 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:3.0:1762166856.524497:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444450304:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166856.524504:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765444449408:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 187us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.524513:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444449280:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 172us (968us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166856.524525:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d871 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911aa expref: 29 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:3.0:1762166856.524526:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.524540:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9dabd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9129f expref: 29 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:0.0:1762166856.524541:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 719 00000100:00100000:1.0:1762166856.524562:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 720 00010000:00010000:3.0:1762166856.524577:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9dabd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9129f expref: 28 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166856.524579:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee244472c00/0xf915a5bdf3c9d871 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f911aa expref: 28 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:0.0:1762166856.524580:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 723 00000100:00100000:1.0:1762166856.524600:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 724 00000100:00100000:0.0:1762166856.524605:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444450048:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.524618:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166856.524624:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444449664:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.524635:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9da9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91283 expref: 26 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:1.0:1762166856.524639:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.524650:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9daa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9128a expref: 26 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166856.524678:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.524684:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9da9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91283 expref: 26 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:3.0:1762166856.524711:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9dabd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9129f expref: 26 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:1.0:1762166856.524712:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9daa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9128a expref: 26 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:2.0:1762166856.524716:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2358:x1847765444450432:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 292us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.524752:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 721 00010000:00010000:0.0:1762166856.524796:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9da9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91283 expref: 25 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:3.0:1762166856.524808:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166856.524809:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9daa8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9128a expref: 23 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:0.0:1762166856.524814:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166856.524832:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166856.524849:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765444450304:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 355us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.524859:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765444450048:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 258us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.524863:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 725 00000100:00100000:1.0:1762166856.524871:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765444449664:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 246us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.524883:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 722 00000100:00100000:2.0:1762166856.524887:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444449792:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166856.524899:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 723 00010000:00010000:2.0:1762166856.524907:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166856.524908:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 724 00010000:00010000:2.0:1762166856.524921:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9da93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9127c expref: 20 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:3.0:1762166856.524923:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 726 00000100:00100000:3.0:1762166856.524945:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765444450176:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166856.524948:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9da93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9127c expref: 19 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:3.0:1762166856.524956:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.524965:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9dab6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91298 expref: 19 pid: 6532 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.524968:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e4b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.524977:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9da93 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9127c expref: 19 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:1.0:1762166856.525003:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e4b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.525009:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9dab6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x85:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91298 expref: 19 pid: 6532 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.525042:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e4b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.525069:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e4b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.525079:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166856.525093:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9dab6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91298 expref: 18 pid: 6532 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.525109:0:6533:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166856.525113:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166856.525117:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166856.525121:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e4b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.525125:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444449792:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 244us (1051us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166856.525130:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e4b8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.525141:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 725 00010000:00010000:3.0:1762166856.525158:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.525171:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e4b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.525183:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e4b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.525193:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e4b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.525195:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e4bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.525217:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e4b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.525222:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e4bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.525232:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e4bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.525239:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e4bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.525240:0:6532:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1762166856.525266:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1762166856.525303:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444450176:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 366us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.525314:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 726 00010000:00010000:3.0:1762166856.525356:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1762166856.525364:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e4b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.525374:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166856.525382:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e4b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.525392:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e4b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.525410:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e4b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.525439:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9e4b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.525472:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1762166856.525478:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e4b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.525487:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166856.525599:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e4b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.525611:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e4b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.525630:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e4b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.525638:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e4b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.525665:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166856.525669:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e4bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.525678:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7ce00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166856.525683:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e4bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166856.525698:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765451973632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5837us (5958us total) trans 21474836778 rc 0/0 00010000:00010000:3.0:1762166856.525699:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e4bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.525717:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765451973376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5867us (6074us total) trans 21474836779 rc 0/0 00000100:00100000:1.0:1762166856.525731:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00010000:00010000:3.0:1762166856.525742:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e4bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.525753:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e4bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.525759:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00010000:00010000:3.0:1762166856.525831:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166856.525836:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166856.525840:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1762166856.525856:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee3819b9500/2, rc 0, transno 21474836779 00000100:00100000:1.0:1762166856.525866:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee3819b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451973376:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762166856.525898:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765451973504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6013us (6100us total) trans 21474836780 rc 0/0 00000004:00080000:3.0:1762166856.525903:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b1180/2, rc 0, transno 21474836778 00000100:00100000:2.0:1762166856.525909:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:3.0:1762166856.525913:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451973632:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762166856.525938:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166856.525945:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1762166856.526005:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee3819bb100/2, rc 0, transno 21474836780 00000100:00100000:0.0:1762166856.526013:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee3819bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451973504:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762166856.530486:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.530568:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444450560 00000100:00100000:0.0:1762166856.530578:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444450560 00000100:00100000:0.0:1762166856.530645:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1125 00000100:00100000:0.0:1762166856.530655:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444450560:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762166856.530712:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4c6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.530727:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.530729:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.530734:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.530749:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.530808:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.530817:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.530828:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.530852:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166856.530856:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.530864:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.530877:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.530884:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.530958:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444450560:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 303us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.530966:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1125 00000100:00100000:3.0:1762166856.532423:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.532510:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444450816 00000100:00100000:0.0:1762166856.532516:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444450816 00000100:00100000:0.0:1762166856.532564:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 255 00000100:00100000:0.0:1762166856.532573:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49221:x1847765444450816:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166856.532616:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.532638:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e472 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9163b expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.532655:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff9ee359d01a00) 00010000:00010000:0.0:1762166856.532695:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.532730:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4cd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.532741:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4cd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.532749:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4cd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762166856.532943:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000257002b2 reply state 0000000088204a06 transno 8589934844 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4cd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166856.532952:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166856.533031:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49221:x1847765444450816:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 459us (613us total) trans 8589934844 rc 0/0 00000100:00100000:0.0:1762166856.533038:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 255 00010000:00010000:3.0:1762166856.533917:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4cd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.533982:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4cd lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.533990:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4cd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.533995:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166856.533998:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4cd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.534004:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4cd lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.534021:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff9ee34bdb4200) 00010000:00010000:3.0:1762166856.534023:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166856.534026:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4cd lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.534030:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e4cd lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166856.534055:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.534106:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444450944 00000100:00100000:2.0:1762166856.534113:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444450944 00000100:00100000:2.0:1762166856.534153:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 256 00000100:00100000:2.0:1762166856.534170:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49221:x1847765444450944:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.534186:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.534199:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e4d4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91665 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.534242:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91665 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.534254:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91665 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.534269:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff9ee359d01e00) 00010000:00010000:2.0:1762166856.534272:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166856.534279:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7cc00, rc 0) 00000100:00100000:2.0:1762166856.534317:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49221:x1847765444450944:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 150us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.534323:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 256 00000100:00100000:2.0:1762166856.535399:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.535453:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444451072 00000100:00100000:0.0:1762166856.535458:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444451072 00000100:00100000:0.0:1762166856.535497:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1126 00000100:00100000:0.0:1762166856.535507:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:49221:x1847765444451072:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.535519:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.535531:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e4db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9166c expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.535555:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e479 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91642 expref: 17 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.535563:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.535575:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.535580:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e4db lrc: 4/0,0 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9166c expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.535627:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e479 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91642 expref: 17 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.535641:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e479 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91642 expref: 17 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:0.0:1762166856.535659:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f623b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451975296:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.535727:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.536733:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f623b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451975296:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.536756:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e4db lrc: 3/0,0 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9166c expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.536802:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199a00, rc 0) 00000100:00100000:0.0:1762166856.536843:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:49221:x1847765444451072:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1338us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.536851:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1126 00000100:00100000:3.0:1762166856.537033:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.537082:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444451200 00000100:00100000:0.0:1762166856.537088:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444451200 00010000:00010000:0.0:1762166856.537111:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e479 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91642 expref: 17 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:0.0:1762166856.537142:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 727 00000100:00100000:0.0:1762166856.537150:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444451200:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.537174:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.537194:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e479 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91642 expref: 17 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:0.0:1762166856.537206:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e479 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91642 expref: 17 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:0.0:1762166856.537225:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e479 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91642 expref: 17 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:0.0:1762166856.537236:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.537238:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.537243:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e4db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9166c expref: 16 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.537252:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e4db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9166c expref: 16 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.537278:0:7415:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e4db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9166c expref: 16 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.537289:0:7415:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f623b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765451975424:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762166856.537338:0:7415:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.538151:0:7415:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f623b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765451975424:192.168.203.35@tcp:105: 00010000:00010000:0.0:1762166856.538163:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166856.538202:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444451200:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1052us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.538219:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 727 00000100:00100000:3.0:1762166856.538319:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.538351:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444451328 00000100:00100000:0.0:1762166856.538356:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444451328 00000100:00100000:0.0:1762166856.538392:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1127 00000100:00100000:0.0:1762166856.538401:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444451328:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166856.538644:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x88:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166856.538648:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x88:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:0.0:1762166856.538650:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x88:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:0.0:1762166856.538652:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x88:0x0] updating lvb ctime from disk: 0 -> 1762166856 00002000:00010000:0.0:1762166856.538654:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x88:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166856.538688:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444451328:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 288us (371us total) trans 21474836781 rc 0/0 00000100:00100000:0.0:1762166856.538695:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1127 00000100:00100000:2.0:1762166856.539759:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.539830:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444451584 00000100:00100000:0.0:1762166856.539837:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444451584 00000100:00100000:0.0:1762166856.539877:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 257 00000100:00100000:0.0:1762166856.539886:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49221:x1847765444451584:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166856.539935:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.539953:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e45d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9162d expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.539968:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166856.539971:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.540006:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4e2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.540017:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4e2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.540033:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4e2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762166856.540139:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b75b7e9c reply state 00000000c423b0b4 transno 8589934845 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4e2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166856.540146:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166856.540201:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49221:x1847765444451584:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 317us (445us total) trans 8589934845 rc 0/0 00000100:00100000:0.0:1762166856.540206:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 257 00010000:00010000:1.0:1762166856.540988:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4e2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.541006:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4e2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.541013:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4e2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.541020:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166856.541025:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4e2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.541034:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4e2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.541051:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:1.0:1762166856.541055:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166856.541060:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4e2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.541067:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e4e2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166856.541156:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.541202:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444451712 00000100:00100000:0.0:1762166856.541207:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444451712 00000100:00100000:0.0:1762166856.541248:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1128 00000100:00100000:0.0:1762166856.541258:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49221:x1847765444451712:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.541271:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.541284:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e4e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91673 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.541306:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e4aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9165e expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.541315:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.541316:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.541320:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e4e9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91673 expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.541348:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e4aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9165e expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.541372:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e4aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9165e expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:0.0:1762166856.541384:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f623b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451975552:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.541450:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.542442:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f623b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451975552:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.542465:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e4e9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91673 expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.542479:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199800, rc 0) 00000100:00100000:0.0:1762166856.542522:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49221:x1847765444451712:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1266us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.542529:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1128 00000100:00100000:2.0:1762166856.542633:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.542709:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444451840 00000100:00100000:0.0:1762166856.542715:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444451840 00010000:00010000:0.0:1762166856.542735:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e4aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9165e expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:0.0:1762166856.542786:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 728 00000100:00100000:0.0:1762166856.542799:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444451840:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.542813:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.542832:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e4aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9165e expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:0.0:1762166856.542853:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e4aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9165e expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:0.0:1762166856.542867:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e4aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9165e expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:0.0:1762166856.542874:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.542876:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.542879:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e4e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91673 expref: 26 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.542885:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e4e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91673 expref: 26 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.542901:0:7415:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e4e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91673 expref: 26 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.542909:0:7415:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f623b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7415:1847765451975680:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762166856.542946:0:7415:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.543882:0:7415:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f623b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7415:1847765451975680:192.168.203.35@tcp:105: 00010000:00010000:0.0:1762166856.543905:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166856.543940:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444451840:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1147us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.543949:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 728 00000100:00100000:2.0:1762166856.544187:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.544268:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444451968 00000100:00100000:0.0:1762166856.544280:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444451968 00000100:00100000:0.0:1762166856.544311:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1129 00000100:00100000:0.0:1762166856.544319:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444451968:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166856.544485:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166856.544489:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x87:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166856.544492:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x87:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166856.544494:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x87:0x0] updating lvb ctime from disk: 1762166856 -> 1762166856 00002000:00010000:0.0:1762166856.544496:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x87:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166856.544535:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444451968:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 216us (350us total) trans 17179869449 rc 0/0 00000100:00100000:0.0:1762166856.544542:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1129 00000100:00100000:2.0:1762166856.546065:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.546108:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444452224 00000100:00100000:0.0:1762166856.546114:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444452224 00000100:00100000:0.0:1762166856.546150:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 98 00000100:00100000:0.0:1762166856.546155:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3586a2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49221:x1847765444452224:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166856.546214:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e487 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91649 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.546248:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e4f0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.546260:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e3b5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915f5 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.546268:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e402 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9160a expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.546275:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e4f0 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.546309:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e402 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9160a expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.546318:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e402 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9160a expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.546328:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f623b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451975808:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.546418:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e3b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915f5 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.546439:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e3b5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915f5 expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.546450:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451975936:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.546483:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166856.547403:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.547482:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444452480 00000100:00100000:2.0:1762166856.547489:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444452480 00000100:00100000:2.0:1762166856.547533:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 99 00000100:00100000:2.0:1762166856.547543:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:43349:x1847765444452480:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1762166856.547576:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.547620:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444452608 00000100:00100000:1.0:1762166856.547625:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444452608 00010000:00010000:1.0:1762166856.547643:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e3b5 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915f5 expref: 29 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.547669:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f623b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451975808:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166856.547677:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 729 00000100:00100000:0.0:1762166856.547686:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451975936:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166856.547691:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765444452608:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166856.547705:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.547711:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e3b5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915f5 expref: 30 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.547712:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e4f0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.547741:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e3b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915f5 expref: 30 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.547744:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:43349:x1847765444452480:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 202us (342us total) trans 8589934846 rc 0/0 00000100:00100000:2.0:1762166856.547785:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 99 00010000:00010000:1.0:1762166856.547929:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e3b5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f915f5 expref: 29 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.547945:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:1.0:1762166856.547949:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e4f0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.547956:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e4f0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.547962:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166856.547999:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444452608:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 314us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.548006:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 729 00000100:00100000:3.0:1762166856.548701:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.548739:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444452736 00000100:00100000:0.0:1762166856.548745:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444452736 00010000:00010000:0.0:1762166856.548799:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e402 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9160a expref: 28 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.548828:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 730 00000100:00100000:0.0:1762166856.548843:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444452736:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.548852:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.548858:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e402 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9160a expref: 28 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.548868:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e402 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9160a expref: 28 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.548880:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e402 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9160a expref: 28 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.548891:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166856.548895:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e4f0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.548903:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e4f0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.548910:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e4f0 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.548935:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166856.548965:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e4f0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166856.548974:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444452736:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 131us (272us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166856.548977:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e4f0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166856.548986:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 730 00010000:00010000:1.0:1762166856.549007:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e4f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.549019:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e4d4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91665 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.549027:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e4f7 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.549055:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91665 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.549069:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e4d4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91665 expref: 26 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.549085:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451976064:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166856.549135:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a240 going to sleep for 11 seconds 00000100:00100000:1.0:1762166856.550081:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451976064:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.550093:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e4f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166856.550343:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.550395:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444452864 00000100:00100000:2.0:1762166856.550402:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444452864 00010000:00010000:2.0:1762166856.550435:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e4d4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91665 expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.550473:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 731 00000100:00100000:2.0:1762166856.550483:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444452864:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166856.550493:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166856.550499:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e4d4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91665 expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166856.550509:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91665 expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166856.550524:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e4d4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91665 expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166856.550538:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff9ee359d01e00) 00010000:00010000:2.0:1762166856.550542:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e4f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.550549:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e4f7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.550555:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e4f7 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.550589:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166856.550609:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e4f7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.550616:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e4f7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166856.550622:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444452864:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 139us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.550632:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 731 00000100:00100000:1.0:1762166856.550980:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451976192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166856.551012:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166856.551032:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166856.551056:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451976192 00000100:00100000:3.0:1762166856.551060:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451976192 00000100:00100000:3.0:1762166856.551084:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1762166856.551088:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:30821:x1847765451976192:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166856.551142:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:30821:x1847765451976192:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 53us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.551148:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1762166856.551178:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451976192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166856.551208:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451976320:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166856.551227:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166856.551239:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.551242:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451976320 00000100:00100000:0.0:1762166856.551248:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451976320 00000100:00100000:0.0:1762166856.551285:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1762166856.551294:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30821:x1847765451976320:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166856.551362:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30821:x1847765451976320:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 69us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.551376:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1762166856.551395:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451976320:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1762166856.551529:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934847 00000100:00100000:1.0:1762166856.551572:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451976448:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166856.551595:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166856.551616:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.551639:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451976448 00000100:00100000:0.0:1762166856.551645:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451976448 00000100:00100000:0.0:1762166856.551676:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1762166856.551683:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30821:x1847765451976448:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166856.551854:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30821:x1847765451976448:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 171us (257us total) trans 21474836782 rc 0/0 00000100:00100000:0.0:1762166856.551862:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1762166856.551872:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451976448:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1762166856.551915:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934848 00010000:00010000:1.0:1762166856.551933:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e4f7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.551941:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e4f7 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.551953:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e4f7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.551958:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166856.551961:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e4f7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.551979:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e4f7 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.551989:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff9ee359d01e00) 00010000:00010000:1.0:1762166856.551991:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166856.551995:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e4f7 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.552000:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e4f7 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.552017:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e4f0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.552022:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e4f0 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.552027:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e4f0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.552032:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166856.552035:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e4f0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.552040:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e4f0 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.552046:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:1.0:1762166856.552048:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166856.552051:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e4f0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.552056:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e4f0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.552074:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:1.0:1762166856.552076:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166856.552081:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e487 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91649 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166856.552155:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3586a2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49221:x1847765444452224:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 5998us (6092us total) trans 8589934849 rc 0/0 00000100:00100000:1.0:1762166856.552165:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 98 00000020:00080000:1.0:1762166856.552169:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166856.553187:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.553234:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444452992 00000100:00100000:0.0:1762166856.553240:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444452992 00000100:00100000:0.0:1762166856.553278:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 258 00000100:00100000:0.0:1762166856.553285:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49221:x1847765444452992:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.553301:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.553318:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e4fe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9167a expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.553369:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e4fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9167a expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.553382:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e4fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9167a expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.553400:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166856.553403:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166856.553406:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198800, rc 0) 00000100:00100000:0.0:1762166856.553460:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49221:x1847765444452992:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 175us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.553478:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 258 00000100:00100000:3.0:1762166856.554837:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.555000:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444453248 00000100:00100000:1.0:1762166856.555014:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444453248 00000100:00100000:1.0:1762166856.555091:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 100 00000100:00100000:1.0:1762166856.555105:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49221:x1847765444453248:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166856.555435:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49221:x1847765444453248:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 323us (591us total) trans 8589934850 rc 0/0 00000100:00100000:1.0:1762166856.555444:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 100 00000100:00100000:3.0:1762166856.556904:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.556961:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444453504 00000100:00100000:1.0:1762166856.556971:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444453504 00000100:00100000:1.0:1762166856.557018:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 101 00000100:00100000:1.0:1762166856.557028:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49221:x1847765444453504:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:1.0:1762166856.557355:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x2d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1762166856.557501:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e505 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.557519:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e505 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.557554:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e505 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.557563:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e505 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.557569:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e505 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.557576:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e505 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.557604:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166856.557642:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166856.557651:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e505 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.557657:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166856.557667:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e505 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.557674:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e505 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.557687:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:3.0:1762166856.557690:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166856.557694:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e505 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.557698:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e505 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.557713:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166856.557714:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166856.557716:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166856.557732:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49221:x1847765444453504:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 705us (833us total) trans 8589934851 rc 0/0 00000100:00100000:1.0:1762166856.557739:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 101 00000100:00100000:3.0:1762166856.565060:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.565144:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444453632 00000100:00100000:0.0:1762166856.565153:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444453632 00000100:00100000:0.0:1762166856.565213:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 259 00000100:00100000:0.0:1762166856.565224:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49223:x1847765444453632:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166856.565260:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.565283:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e50c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91681 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.565340:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e513 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565353:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e513 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565370:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e513 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565382:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e51a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565388:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e51a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565394:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e51a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565506:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e521 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565513:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e521 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565530:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e521 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.565560:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166856.565563:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166856.565579:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e521 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565588:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e521 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565595:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e513 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565600:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e513 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565606:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e513 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565611:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.565614:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e513 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565620:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e513 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565629:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166856.565632:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.565635:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e513 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565641:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e513 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565659:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e51a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565664:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e51a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565669:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e51a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565674:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.565676:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e51a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565682:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e51a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565689:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4700) 00010000:00010000:0.0:1762166856.565691:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.565693:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e51a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565698:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e51a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.565725:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e50c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91681 expref: 32 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.565737:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e521 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91681 expref: 31 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.565743:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166856.565750:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166856.565753:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198c00, rc 0) 00000100:00100000:0.0:1762166856.565853:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49223:x1847765444453632:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 630us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.565861:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 259 00000100:00100000:2.0:1762166856.582259:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.582363:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444453760 00000100:00100000:0.0:1762166856.582379:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444453760 00000100:00100000:0.0:1762166856.582445:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 260 00000100:00100000:0.0:1762166856.582455:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49227:x1847765444453760:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166856.582521:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e528 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582537:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e528 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582547:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e528 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582558:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e52f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582564:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e52f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582569:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e52f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582662:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e536 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582670:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e536 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582692:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e536 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.582720:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166856.582724:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166856.582733:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e536 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582745:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e528 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582751:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e528 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582756:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e528 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582799:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.582803:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e528 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582809:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e528 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582819:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166856.582823:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.582827:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e528 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582836:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e528 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582848:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e52f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582858:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e52f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582863:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e52f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582869:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.582871:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e52f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582876:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e52f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582882:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4700) 00010000:00010000:0.0:1762166856.582885:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.582887:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e52f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582892:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e52f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582905:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e536 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582910:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e536 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582915:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e536 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582919:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.582922:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e536 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582931:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e536 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582938:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166856.582940:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.582943:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e536 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.582948:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e536 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166856.583019:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49227:x1847765444453760:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 564us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.583027:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 260 00000100:00100000:3.0:1762166856.594714:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.594866:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444454016 00000100:00100000:0.0:1762166856.594876:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444454016 00000100:00100000:0.0:1762166856.594938:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 261 00000100:00100000:0.0:1762166856.594948:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49229:x1847765444454016:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.594967:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.594986:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e53d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91688 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.595077:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e544 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.595090:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e544 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.595100:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e544 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.595128:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166856.595270:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e53d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91688 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.595289:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e544 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91688 expref: 33 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.595297:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166856.595300:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166856.595302:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199000, rc 0) 00000100:00100000:0.0:1762166856.595381:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49229:x1847765444454016:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 434us (679us total) trans 8589934852 rc 0/0 00000100:00100000:0.0:1762166856.595389:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 261 00000100:00100000:3.0:1762166856.598162:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.598220:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444454272 00000100:00100000:0.0:1762166856.598231:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444454272 00000100:00100000:0.0:1762166856.598289:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 262 00000100:00100000:0.0:1762166856.598300:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49229:x1847765444454272:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.598324:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.598344:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e552 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9168f expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.598447:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e559 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.598462:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e521 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91681 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.598471:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e559 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.598517:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e521 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91681 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.598529:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e521 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91681 expref: 34 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.598542:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451976576:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.598665:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.600000:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451976576:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.600003:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762166856.600027:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e559 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166856.600060:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444454400 00000100:00100000:1.0:1762166856.600069:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444454400 00010000:00010000:1.0:1762166856.600098:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e521 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91681 expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.600138:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 732 00000100:00100000:1.0:1762166856.600147:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444454400:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166856.600160:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.600166:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e521 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91681 expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.600178:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e521 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91681 expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.600214:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e521 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91681 expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.600229:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:1.0:1762166856.600233:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e559 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.600240:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e559 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.600247:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e559 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.600271:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.600299:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e559 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.600307:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e559 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166856.600322:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765444454400:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 175us (324us total) trans 0 rc 0/0 00000004:00200000:0.0:1762166856.600323:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000100:00100000:1.0:1762166856.600335:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 732 00010000:00010000:0.0:1762166856.600498:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e552 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9168f expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.600513:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e559 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9168f expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.600521:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166856.600524:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166856.600526:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198600, rc 0) 00000100:00100000:0.0:1762166856.600566:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49229:x1847765444454272:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2268us (2412us total) trans 8589934853 rc 0/0 00000100:00100000:0.0:1762166856.600575:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 262 00000100:00100000:2.0:1762166856.602315:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.602361:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444454528 00000100:00100000:1.0:1762166856.602369:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444454528 00000100:00100000:1.0:1762166856.602412:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 102 00000100:00100000:1.0:1762166856.602421:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49229:x1847765444454528:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:1.0:1762166856.602566:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49229:x1847765444454528:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 145us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.602573:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 102 00000100:00100000:3.0:1762166856.604436:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.604505:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444454784 00000100:00100000:1.0:1762166856.604513:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444454784 00000100:00100000:1.0:1762166856.604561:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 103 00000100:00100000:1.0:1762166856.604570:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49229:x1847765444454784:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166856.604835:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49229:x1847765444454784:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 265us (417us total) trans 8589934854 rc 0/0 00000100:00100000:1.0:1762166856.604844:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 103 00000100:00100000:3.0:1762166856.606283:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.606348:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444455040 00000100:00100000:0.0:1762166856.606365:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444455040 00000100:00100000:0.0:1762166856.606458:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 263 00000100:00100000:0.0:1762166856.606469:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49229:x1847765444455040:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.606492:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.606496:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166856.606531:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e559 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9168f expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.606555:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e544 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91688 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.606566:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166856.606571:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.606587:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e567 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91696 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.606684:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e56e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.606696:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e56e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.606705:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e56e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.606717:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166856.606945:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e567 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91696 expref: 36 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.606960:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e56e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91696 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.606968:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166856.606970:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166856.606973:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198200, rc 0) 00000100:00100000:0.0:1762166856.607055:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49229:x1847765444455040:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 588us (774us total) trans 8589934855 rc 0/0 00000100:00100000:0.0:1762166856.607063:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 263 00000100:00100000:3.0:1762166856.608407:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.608489:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444455296 00000100:00100000:1.0:1762166856.608499:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444455296 00000100:00100000:1.0:1762166856.608554:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 104 00000100:00100000:1.0:1762166856.608566:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3586a0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49229:x1847765444455296:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166856.608634:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e56e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91696 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.608666:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e57c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.608680:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e4fe lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9167a expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.608689:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e57c lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.608729:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e4fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9167a expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.608744:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e4fe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9167a expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.608789:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451976704:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166856.608897:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166856.609941:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451976704:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.609989:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e57c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166856.610234:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.610411:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444455424 00000100:00100000:1.0:1762166856.610422:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444455424 00010000:00010000:1.0:1762166856.610473:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e4fe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9167a expref: 36 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.610550:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 733 00000100:00100000:0.0:1762166856.610564:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765444455424:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.610595:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.610603:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e4fe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9167a expref: 36 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.610621:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e4fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9167a expref: 36 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.610642:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e4fe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9167a expref: 36 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.610658:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166856.610662:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e57c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.610671:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e57c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.610693:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e57c lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.610730:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166856.610808:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e57c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.610820:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e57c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166856.610832:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444455424:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 269us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.610843:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 733 00010000:00010000:1.0:1762166856.611140:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e57c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.611150:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e57c lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.611158:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e57c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.611164:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166856.611170:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e57c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.611178:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e57c lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.611190:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:1.0:1762166856.611194:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166856.611198:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e57c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.611214:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e57c lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.611229:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:1.0:1762166856.611231:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166856.611237:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e56e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91696 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166856.611387:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3586a0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49229:x1847765444455296:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2825us (2985us total) trans 8589934856 rc -22/-22 00000100:00100000:1.0:1762166856.611396:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 104 00000100:00100000:3.0:1762166856.612243:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.612285:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444455552 00000100:00100000:0.0:1762166856.612292:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444455552 00000100:00100000:0.0:1762166856.612346:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 264 00000100:00100000:0.0:1762166856.612353:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49229:x1847765444455552:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.612380:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.612395:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e583 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9169d expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.612456:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e583 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9169d expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.612465:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e583 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9169d expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.612482:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4700) 00010000:00010000:0.0:1762166856.612485:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166856.612491:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199600, rc 0) 00000100:00100000:0.0:1762166856.612544:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49229:x1847765444455552:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 190us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.612551:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 264 00000100:00100000:3.0:1762166856.614162:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.614214:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444455808 00000100:00100000:0.0:1762166856.614222:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444455808 00000100:00100000:0.0:1762166856.614272:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 265 00000100:00100000:0.0:1762166856.614281:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49229:x1847765444455808:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.614295:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.614311:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e58a lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f916a4 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.614864:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e591 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.614879:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e591 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.614889:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e591 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.614900:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 0 00010000:00010000:0.0:1762166856.614949:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e58a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916a4 expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.614966:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e591 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916a4 expref: 37 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.614974:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166856.614976:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166856.614980:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198600, rc 0) 00000100:00100000:0.0:1762166856.615049:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49229:x1847765444455808:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 769us (891us total) trans 8589934857 rc 0/0 00000100:00100000:0.0:1762166856.615057:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 265 00000100:00100000:3.0:1762166856.617392:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.617476:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444456064 00000100:00100000:0.0:1762166856.617492:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444456064 00000100:00100000:0.0:1762166856.617576:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 266 00000100:00100000:0.0:1762166856.617587:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49229:x1847765444456064:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.617614:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.617634:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e59f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f916ab expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.617732:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e5a6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.617745:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e5a6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.617754:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e5a6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.617792:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166856.617951:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e59f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916ab expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.617965:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e5a6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916ab expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.617972:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4700) 00010000:00010000:0.0:1762166856.617974:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166856.617977:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198000, rc 0) 00000100:00100000:0.0:1762166856.618048:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49229:x1847765444456064:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 462us (662us total) trans 8589934858 rc 0/0 00000100:00100000:0.0:1762166856.618055:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 266 00000100:00100000:3.0:1762166856.619180:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.619264:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444456320 00000100:00100000:1.0:1762166856.619273:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444456320 00000100:00100000:1.0:1762166856.619321:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 105 00000100:00100000:1.0:1762166856.619329:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49229:x1847765444456320:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166856.619390:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e5a6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916ab expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.619419:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e5b4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.619441:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e583 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9169d expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.619453:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e5b4 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.619585:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e583 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9169d expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.619623:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e583 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9169d expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.619640:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451976832:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166856.619739:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3514283c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166856.622334:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.622346:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451976832:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.622385:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e5b4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166856.622393:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444456448 00000100:00100000:0.0:1762166856.622403:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444456448 00010000:00010000:0.0:1762166856.622453:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e583 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9169d expref: 40 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.622500:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 734 00000100:00100000:0.0:1762166856.622511:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2361:x1847765444456448:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.622526:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.622533:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e583 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9169d expref: 40 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.622545:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e583 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9169d expref: 40 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.622564:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e583 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9169d expref: 40 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.622580:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4700) 00010000:00010000:0.0:1762166856.622584:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e5b4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.622592:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e5b4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.622596:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e5b4 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.622619:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166856.622636:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e5b4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.622644:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e5b4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.622662:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e5bb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.622673:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e591 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916a4 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.622679:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444456448:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 170us (354us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166856.622695:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e5bb lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166856.622704:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 734 00010000:00010000:1.0:1762166856.622726:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e591 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916a4 expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.622738:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e591 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916a4 expref: 38 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.622808:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451976960:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166856.622870:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3514283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166856.623894:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451976960:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.623913:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e5bb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166856.624103:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.624150:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444456576 00000100:00100000:0.0:1762166856.624157:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444456576 00010000:00010000:0.0:1762166856.624179:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e591 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916a4 expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.624215:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 735 00000100:00100000:0.0:1762166856.624223:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444456576:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.624236:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.624241:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e591 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916a4 expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.624252:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e591 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916a4 expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.624268:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e591 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916a4 expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.624284:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166856.624288:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e5bb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.624296:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e5bb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.624304:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e5bb lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.624328:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166856.624356:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e5bb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.624369:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e5bb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166856.624385:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2360:x1847765444456576:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 160us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.624394:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 735 00000100:00100000:1.0:1762166856.625079:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451977088:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166856.625184:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166856.625237:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.625306:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451977088 00000100:00100000:0.0:1762166856.625314:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451977088 00000100:00100000:0.0:1762166856.625373:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1762166856.625383:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30821:x1847765451977088:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166856.625495:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30821:x1847765451977088:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 113us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.625504:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1762166856.625583:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451977088:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1762166856.625638:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934859 00000001:00080000:1.0:1762166856.625712:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934860 00010000:00010000:1.0:1762166856.625739:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e5bb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.625748:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e5bb lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.625756:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e5bb lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.625864:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166856.625878:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e5bb lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.625888:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e5bb lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.625913:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:1.0:1762166856.625917:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166856.625923:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e5bb lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.625930:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9e5bb lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.625955:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e5b4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.625962:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e5b4 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.625968:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e5b4 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.625973:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166856.625976:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e5b4 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.625981:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e5b4 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.625988:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4700) 00010000:00010000:1.0:1762166856.625990:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166856.625994:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e5b4 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.626010:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e5b4 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.626024:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4700) 00010000:00010000:1.0:1762166856.626026:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166856.626033:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9e5a6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916ab expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166856.626139:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49229:x1847765444456320:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 6810us (6964us total) trans 8589934861 rc 0/0 00000100:00100000:1.0:1762166856.626149:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 105 00000020:00080000:1.0:1762166856.626153:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166856.627908:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.628000:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444456704 00000100:00100000:0.0:1762166856.628013:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444456704 00000100:00100000:0.0:1762166856.628072:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 267 00000100:00100000:0.0:1762166856.628083:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49229:x1847765444456704:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.628107:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.628130:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e5c2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f916b2 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.628182:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e5c2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916b2 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.628196:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e5c2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916b2 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.628213:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:0.0:1762166856.628216:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166856.628220:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199000, rc 0) 00000100:00100000:0.0:1762166856.628283:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49229:x1847765444456704:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 202us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.628297:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 267 00000100:00100000:3.0:1762166856.630102:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.630152:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444456960 00000100:00100000:1.0:1762166856.630160:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444456960 00000100:00100000:1.0:1762166856.630214:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 106 00000100:00100000:1.0:1762166856.630222:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49229:x1847765444456960:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:1.0:1762166856.630660:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x2e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1762166856.630820:0:30821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].13, 64 off9216 00000004:00080000:1.0:1762166856.630833:0:30821:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 477423065465ns, next at 478423063358ns, rc = 0 00000001:00080000:1.0:1762166856.630842:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934862 00010000:00010000:1.0:1762166856.630883:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e5c9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.630898:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e5c9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.630909:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e5c9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.630934:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e5c9 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.630940:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e5c9 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.630946:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e5c9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.630965:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166856.630987:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166856.630996:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e5c9 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.631004:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166856.631009:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e5c9 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.631017:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e5c9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.631030:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff9ee34ada3a00) 00010000:00010000:2.0:1762166856.631034:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166856.631038:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e5c9 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.631045:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9e5c9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.631064:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166856.631066:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166856.631068:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166856.631089:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49229:x1847765444456960:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 866us (989us total) trans 8589934863 rc 0/0 00000100:00100000:1.0:1762166856.631098:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 106 00000020:00080000:1.0:1762166856.631104:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166856.632665:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.632783:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444457216 00000100:00100000:1.0:1762166856.632802:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444457216 00000100:00100000:1.0:1762166856.632849:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 107 00000100:00100000:1.0:1762166856.632861:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49229:x1847765444457216:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166856.633132:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49229:x1847765444457216:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 274us (471us total) trans 8589934864 rc 0/0 00000100:00100000:1.0:1762166856.633139:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 107 00000100:00100000:3.0:1762166856.644065:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.644139:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444457344 00000100:00100000:0.0:1762166856.644150:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444457344 00000100:00100000:0.0:1762166856.644214:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 268 00000100:00100000:0.0:1762166856.644226:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49231:x1847765444457344:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166856.644265:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.644285:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e5d0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f916b9 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.644349:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e5d7 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644364:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e5d7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644381:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e5d7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644397:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e5de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644404:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e5de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644411:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e5de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644530:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e5e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644538:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644562:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.644595:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166856.644599:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166856.644616:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644628:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644636:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e5d7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644642:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e5d7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644648:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e5d7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644653:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.644657:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e5d7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644665:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e5d7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644677:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166856.644680:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.644684:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e5d7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644690:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e5d7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644709:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e5de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644715:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e5de lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644720:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e5de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644724:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.644726:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e5de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644730:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e5de lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644734:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4c00) 00010000:00010000:0.0:1762166856.644736:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.644737:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e5de lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644740:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e5de lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.644830:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e5d0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916b9 expref: 45 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.644845:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e5e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916b9 expref: 44 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.644852:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:0.0:1762166856.644860:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166856.644863:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198400, rc 0) 00000100:00100000:0.0:1762166856.644938:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49231:x1847765444457344:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 715us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.644957:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 268 00000100:00100000:3.0:1762166856.646799:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.646877:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444457472 00000100:00100000:0.0:1762166856.646886:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444457472 00000100:00100000:0.0:1762166856.646930:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1130 00000100:00100000:0.0:1762166856.646938:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765444457472:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166856.646955:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.646972:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e5ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f916c0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.647039:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451977216:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166856.647117:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.648567:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451977216:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166856.648601:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e5ec lrc: 1/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916c0 expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.648622:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e5ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916c0 expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.648634:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199c00, rc 0) 00000100:00100000:0.0:1762166856.648702:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765444457472:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 1762us (1936us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166856.648710:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1130 00000100:00100000:3.0:1762166856.661376:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.661458:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444457600 00000100:00100000:0.0:1762166856.661471:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444457600 00000100:00100000:0.0:1762166856.661539:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 269 00000100:00100000:0.0:1762166856.661549:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49235:x1847765444457600:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166856.661620:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e5f3 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661636:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e5f3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661649:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e5f3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661664:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e5fa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661671:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e5fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661678:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e5fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661807:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e601 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661815:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e601 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661821:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e601 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.661851:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166856.661855:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166856.661864:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e601 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661889:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e5f3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661895:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e5f3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661901:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e5f3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661906:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.661909:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e5f3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661914:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e5f3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661923:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166856.661925:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.661927:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e5f3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661930:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e5f3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661939:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e5fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661943:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e5fa lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661946:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e5fa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661950:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.661959:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e5fa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661965:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e5fa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661972:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4c00) 00010000:00010000:0.0:1762166856.661974:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.661977:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e5fa lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661982:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e5fa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.661996:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e601 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.662002:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e601 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.662007:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e601 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.662012:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.662014:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e601 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.662019:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e601 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.662026:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:0.0:1762166856.662028:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166856.662031:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e601 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.662045:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e601 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166856.662113:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49235:x1847765444457600:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 564us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.662120:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 269 00000100:00100000:3.0:1762166856.671812:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.671960:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444457856 00000100:00100000:0.0:1762166856.671970:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444457856 00000100:00100000:0.0:1762166856.672035:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 270 00000100:00100000:0.0:1762166856.672046:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49237:x1847765444457856:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.672066:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.672086:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e608 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f916c7 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.672200:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e60f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.672214:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e60f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.672230:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e60f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166856.672241:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166856.672370:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9e608 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916c7 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.672388:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e60f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916c7 expref: 46 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.672407:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:0.0:1762166856.672409:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166856.672412:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198600, rc 0) 00000100:00100000:0.0:1762166856.672478:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49237:x1847765444457856:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 434us (674us total) trans 8589934865 rc 0/0 00000100:00100000:0.0:1762166856.672485:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 270 00000100:00100000:2.0:1762166856.674051:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.674104:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444457984 00000100:00100000:0.0:1762166856.674111:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444457984 00000100:00100000:0.0:1762166856.674159:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1131 00000100:00100000:0.0:1762166856.674169:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444457984:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.674183:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.674197:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e61d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f916ce expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.674247:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451977344:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166856.674310:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.675271:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451977344:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166856.675299:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e61d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916ce expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.675319:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e61d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916ce expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.675336:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199c00, rc 0) 00000100:00100000:0.0:1762166856.675394:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444457984:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1227us (1346us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166856.675402:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1131 00000100:00100000:3.0:1762166856.676664:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.676699:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444458240 00000100:00100000:0.0:1762166856.676705:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444458240 00000100:00100000:0.0:1762166856.676743:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 271 00000100:00100000:0.0:1762166856.676749:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49237:x1847765444458240:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.676788:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.676802:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e624 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f916d5 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.676875:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e62b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.676887:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e5e5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916b9 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.676895:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e62b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.676921:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e5e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916b9 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.676930:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e5e5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916b9 expref: 47 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.676938:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451977472:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.676991:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.677907:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451977472:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.677938:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e62b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166856.678128:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.678163:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444458368 00000100:00100000:0.0:1762166856.678169:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444458368 00010000:00010000:0.0:1762166856.678193:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e5e5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916b9 expref: 48 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.678223:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 736 00000100:00100000:0.0:1762166856.678233:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f278a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2361:x1847765444458368:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.678247:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.678254:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e5e5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916b9 expref: 48 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.678266:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e5e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916b9 expref: 48 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.678285:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e5e5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916b9 expref: 48 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.678299:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:0.0:1762166856.678303:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e62b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.678311:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e62b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.678318:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e62b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.678343:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.678376:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e62b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.678385:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e62b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166856.678397:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f278a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:2361:x1847765444458368:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 165us (267us total) trans 0 rc 0/0 00000004:00200000:2.0:1762166856.678398:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000100:00100000:0.0:1762166856.678414:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 736 00010000:00010000:2.0:1762166856.678541:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e624 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916d5 expref: 48 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.678555:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e62b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916d5 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.678563:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:2.0:1762166856.678566:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166856.678568:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199e00, rc 0) 00000100:00100000:2.0:1762166856.678607:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49237:x1847765444458240:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1857us (1944us total) trans 8589934866 rc 0/0 00000100:00100000:2.0:1762166856.678614:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 271 00000100:00100000:3.0:1762166856.680103:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.680149:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444458624 00000100:00100000:2.0:1762166856.680157:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444458624 00000100:00100000:2.0:1762166856.680204:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 272 00000100:00100000:2.0:1762166856.680213:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49237:x1847765444458624:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.680230:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.680246:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e639 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f916dc expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.680693:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e640 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.680716:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e640 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.680722:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e640 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.680729:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2f:0x0]: returning size 0 00010000:00010000:2.0:1762166856.680757:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e639 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916dc expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.680784:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e640 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916dc expref: 49 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.680789:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2f:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166856.680792:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166856.680794:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d200, rc 0) 00000100:00100000:2.0:1762166856.680838:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49237:x1847765444458624:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 626us (740us total) trans 8589934867 rc 0/0 00000100:00100000:2.0:1762166856.680846:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 272 00000100:00100000:0.0:1762166856.682358:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.682405:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444458880 00000100:00100000:2.0:1762166856.682413:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444458880 00000100:00100000:2.0:1762166856.682466:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 273 00000100:00100000:2.0:1762166856.682477:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49237:x1847765444458880:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.682494:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.682508:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e64e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f916e3 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.682564:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e655 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.682585:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e640 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916dc expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.682590:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e655 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.682612:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e640 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916dc expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.682620:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e640 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916dc expref: 50 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.682630:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451977600:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.682684:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee248001cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.683808:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451977600:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.683830:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e655 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166856.684148:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.684455:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444459008 00000100:00100000:3.0:1762166856.684461:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444459008 00010000:00010000:3.0:1762166856.684488:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e640 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916dc expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:3.0:1762166856.684522:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 737 00000100:00100000:3.0:1762166856.684533:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f623b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2360:x1847765444459008:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.684546:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.684553:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e640 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916dc expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166856.684565:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e640 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916dc expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166856.684584:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e640 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916dc expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166856.684599:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2f:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:3.0:1762166856.684603:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e655 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.684624:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e655 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.684630:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e655 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.684655:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.684690:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e655 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.684700:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e655 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.684713:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2f:0x0]: returning size 0 00000100:00100000:3.0:1762166856.684718:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f623b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2360:x1847765444459008:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 187us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.684727:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 737 00000004:00080000:2.0:1762166856.685021:0:30817:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x88:0x0], index 1: 0 00010000:00010000:2.0:1762166856.685152:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e655 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.685160:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e655 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.685173:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e655 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.685178:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36dc7c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.685182:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e655 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.685189:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e655 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.685198:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2f:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166856.685201:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166856.685205:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e655 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.685210:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e655 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.685254:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e64e lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916e3 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.685263:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166856.685266:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166856.685269:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e64e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916e3 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.685278:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c400, rc 0) 00000100:00100000:2.0:1762166856.685312:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49237:x1847765444458880:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2840us (2959us total) trans 8589934868 rc 301/301 00000100:00100000:2.0:1762166856.685317:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 273 00000100:00100000:0.0:1762166856.686362:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.686499:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444459264 00000100:00100000:1.0:1762166856.686514:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444459264 00000100:00100000:1.0:1762166856.686599:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 108 00000100:00100000:1.0:1762166856.686610:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49237:x1847765444459264:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166856.687055:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49237:x1847765444459264:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 446us (693us total) trans 8589934869 rc 0/0 00000100:00100000:1.0:1762166856.687075:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 108 00000100:00100000:3.0:1762166856.688242:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.688318:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444459392 00000100:00100000:2.0:1762166856.688330:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444459392 00000100:00100000:2.0:1762166856.688387:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 274 00000100:00100000:2.0:1762166856.688397:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49237:x1847765444459392:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.688421:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.688448:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e663 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f916ea expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.688540:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e66a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.688554:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e62b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916d5 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.688563:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e66a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.688593:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e62b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916d5 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.688603:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e62b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916d5 expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.688612:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451977728:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.688686:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.689587:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451977728:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.689616:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e66a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166856.689739:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.689802:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444459520 00000100:00100000:0.0:1762166856.689808:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444459520 00010000:00010000:0.0:1762166856.689834:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e62b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916d5 expref: 52 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.689861:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 738 00000100:00100000:0.0:1762166856.689871:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2361:x1847765444459520:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.689885:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.689893:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e62b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916d5 expref: 52 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.689905:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e62b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916d5 expref: 52 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.689928:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9e62b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916d5 expref: 52 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.689940:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:0.0:1762166856.689944:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e66a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.689951:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e66a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.689968:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e66a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166856.689991:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.690012:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e66a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.690026:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e66a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166856.690027:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444459520:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 159us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.690043:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 738 00000004:00200000:2.0:1762166856.690081:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166856.690086:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166856.690101:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e66a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.690135:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e663 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916ea expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.690152:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e66a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916ea expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.690159:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:2.0:1762166856.690162:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166856.690165:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7cc00, rc 0) 00000100:00100000:2.0:1762166856.690199:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49237:x1847765444459392:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1804us (1961us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.690205:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 274 00000100:00100000:3.0:1762166856.691154:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.691193:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444459648 00000100:00100000:0.0:1762166856.691198:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444459648 00000100:00100000:0.0:1762166856.691228:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1132 00000100:00100000:0.0:1762166856.691234:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444459648:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166856.691245:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166856.691260:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e671 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f916f1 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.691317:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451977856:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166856.691379:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.692288:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451977856:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166856.692305:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e671 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916f1 expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.692317:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e671 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916f1 expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.692324:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199600, rc 0) 00000100:00100000:2.0:1762166856.692363:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444459648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1128us (1211us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166856.692370:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1132 00000100:00100000:1.0:1762166856.693200:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.693241:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444459776 00000100:00100000:2.0:1762166856.693248:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444459776 00000100:00100000:2.0:1762166856.693287:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 275 00000100:00100000:2.0:1762166856.693297:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49237:x1847765444459776:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.693310:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.693323:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e678 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f916f8 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.693373:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e67f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.693381:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e67f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.693389:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e67f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.693411:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2f:0x0]: returning size 0 00000004:00200000:2.0:1762166856.693414:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166856.693434:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e67f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.693450:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c400/0xf915a5bdf3c9e678 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916f8 expref: 52 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.693459:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e67f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2f:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916f8 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.693478:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2f:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166856.693481:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166856.693483:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7c600, rc 0) 00000100:00100000:2.0:1762166856.693517:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49237:x1847765444459776:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 223us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.693523:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 275 00000100:00100000:3.0:1762166856.694809:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.694905:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444459904 00000100:00100000:2.0:1762166856.694916:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444459904 00000100:00100000:2.0:1762166856.694991:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1133 00000100:00100000:2.0:1762166856.695002:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444459904:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.695016:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.695033:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e686 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f916ff expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166856.695051:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166856.695065:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.695067:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.695072:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e686 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916ff expref: 28 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.695083:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e686 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916ff expref: 28 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.695092:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7ce00, rc 0) 00000100:00100000:2.0:1762166856.695143:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444459904:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 145us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.695161:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1133 00000100:00100000:0.0:1762166856.696255:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.696317:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444460160 00000100:00100000:2.0:1762166856.696325:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444460160 00000100:00100000:2.0:1762166856.696375:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 276 00000100:00100000:2.0:1762166856.696384:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49237:x1847765444460160:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.696398:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.696412:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e68d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91706 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.696506:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e694 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.696519:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e694 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.696528:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e694 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.696541:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166856.696652:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7dc00/0xf915a5bdf3c9e68d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91706 expref: 54 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.696665:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e694 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91706 expref: 53 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.696670:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:2.0:1762166856.696672:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166856.696673:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d200, rc 0) 00000100:00100000:2.0:1762166856.696711:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49237:x1847765444460160:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 330us (461us total) trans 8589934870 rc 0/0 00000100:00100000:2.0:1762166856.696721:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 276 00000100:00100000:1.0:1762166856.697867:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.697914:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444460288 00000100:00100000:2.0:1762166856.697922:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444460288 00000100:00100000:2.0:1762166856.697965:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1134 00000100:00100000:2.0:1762166856.697979:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444460288:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.697991:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.698002:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e6a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9170d expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.698053:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451977984:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166856.698126:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.699001:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451977984:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166856.699023:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e6a2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9170d expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.699037:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dc7d400/0xf915a5bdf3c9e6a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9170d expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.699045:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc7d400, rc 0) 00000100:00100000:2.0:1762166856.699083:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444460288:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1111us (1222us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166856.699088:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1134 00000100:00100000:0.0:1762166856.700276:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.700329:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444460416 00000100:00100000:2.0:1762166856.700337:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444460416 00000100:00100000:2.0:1762166856.700398:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1135 00000100:00100000:2.0:1762166856.700435:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444460416:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.700452:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.700470:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e6a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91714 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.700516:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451978112:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166856.700579:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.701359:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451978112:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166856.701379:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e6a9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91714 expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.701397:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e6a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91714 expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.701409:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2400, rc 0) 00000100:00100000:2.0:1762166856.701455:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444460416:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1035us (1185us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166856.701461:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1135 00000100:00100000:3.0:1762166856.702220:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.702251:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444460544 00000100:00100000:2.0:1762166856.702256:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444460544 00000100:00100000:2.0:1762166856.702280:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1136 00000100:00100000:2.0:1762166856.702286:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444460544:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166856.702310:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6b0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.702321:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e4db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9166c expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.702333:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166856.702339:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166856.702341:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6b0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.702363:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e4db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9166c expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.702378:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e4db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9166c expref: 17 pid: 26444 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.702391:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451978240:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.702443:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.703116:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451978240:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.703131:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6b0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166856.703270:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.703324:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444460672 00000100:00100000:0.0:1762166856.703329:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444460672 00010000:00010000:0.0:1762166856.703355:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e4db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9166c expref: 18 pid: 26444 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.703392:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 739 00000100:00100000:0.0:1762166856.703399:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444460672:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.703419:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.703444:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e4db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9166c expref: 18 pid: 26444 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.703453:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e4db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9166c expref: 18 pid: 26444 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.703466:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e4db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9166c expref: 18 pid: 26444 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.703474:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.703475:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.703478:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6b0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.703489:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6b0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.703507:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.703531:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6b0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.703532:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444460672:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 134us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.703547:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 739 00010000:00010000:2.0:1762166856.703548:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6b0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.703570:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6b0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.703585:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.703592:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.703598:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166856.703604:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.703613:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.703627:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.703635:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.703689:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444460544:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 1402us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.703699:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1136 00000100:00100000:3.0:1762166856.704788:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.704825:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444460800 00000100:00100000:2.0:1762166856.704831:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444460800 00000100:00100000:2.0:1762166856.704863:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1137 00000100:00100000:2.0:1762166856.704872:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444460800:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.704892:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.704907:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e6b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9171b expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166856.704924:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x88:0x0] initial LVB size: 0, mtime: 0x69088847, atime: 0x69088847, ctime: 0x69088848, blocks: 0x1 00010000:00010000:2.0:1762166856.704935:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.704937:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.704942:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e6b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9171b expref: 17 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.704955:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e6b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9171b expref: 17 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.704965:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2600, rc 0) 00000100:00100000:2.0:1762166856.704998:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444460800:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 128us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.705006:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1137 00000100:00100000:0.0:1762166856.740709:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.740811:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444460928 00000100:00100000:2.0:1762166856.740824:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444460928 00000100:00100000:2.0:1762166856.740897:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 277 00000100:00100000:2.0:1762166856.740909:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49237:x1847765444460928:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:0.0:1762166856.755096:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934865 is committed 00000001:00080000:0.0:1762166856.755135:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934869 is committed 00000004:00080000:0.0:1762166856.755147:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 11 committed 00000100:00100000:2.0:1762166856.755187:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49237:x1847765444460928:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 14273us (14484us total) trans 0 rc 0/0 00000020:00080000:0.0:1762166856.755190:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee349c6a240 refcount 2 committed 0 result 0 batchid 4294969119 00000020:00080000:0.0:1762166856.755199:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee34aa0ee00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee349c6a480 00000100:00100000:2.0:1762166856.755203:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 277 00000020:00080000:0.0:1762166856.755216:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee34aa0ed00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3728ac800 00000001:00080000:0.0:1762166856.755239:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934870 is committed 00000020:00080000:0.0:1762166856.755261:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969118 batchid updated 00000020:00080000:0.0:1762166856.755275:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969119 committed batchid 4294969118 00000100:00100000:2.0:1762166856.755325:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451978368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166856.755367:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451978496:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762166856.755385:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166856.755456:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451978368 00000100:00100000:1.0:1762166856.755465:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451978368 00000100:00100000:3.0:1762166856.755471:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166856.755511:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1762166856.755514:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451978496 00000100:00100000:2.0:1762166856.755520:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451978496 00000100:00100000:1.0:1762166856.755520:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1762166856.755522:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451978624:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1762166856.755524:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969118 00000100:00100000:1.0:1762166856.755536:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765451978368:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166856.755555:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166856.755559:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:2.0:1762166856.755570:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765451978496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1762166856.755572:0:26444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:133 count 1 00000100:00100000:0.0:1762166856.755578:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451978624 00000100:00100000:0.0:1762166856.755584:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451978624 00002000:00080000:2.0:1762166856.755586:0:6532:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:134 count 1 00010000:00010000:1.0:1762166856.755604:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9e6be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.755605:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.755620:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:0.0:1762166856.755633:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765451978624:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1762166856.755643:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9e0e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f9 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.755643:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9da77 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9126e expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1762166856.755648:0:6533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:135 count 1 00010000:00010000:1.0:1762166856.755664:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199400/0xf915a5bdf3c9dcc3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91363 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.755666:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e6cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.755679:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166856.755683:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166856.755689:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6c5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.755690:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dcbc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9135c expref: 27 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.755695:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e4e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91673 expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.755716:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166856.755718:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dcb5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91355 expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166856.755719:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166856.755724:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e6cc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.755734:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dcae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9134e expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.755735:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9e0e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f9 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.755753:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e4e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91673 expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.755793:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e4e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91673 expref: 27 pid: 26444 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166856.755795:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9e0e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f9 expref: 27 pid: 6532 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.755802:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dca0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91347 expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1762166856.755819:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451978752:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.755828:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc99 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91340 expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762166856.755834:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765451978880:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.755841:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dc68 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91324 expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.755853:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dc14 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91301 expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.755863:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9dbe3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912f3 expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.755871:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166856.755873:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166856.755877:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9e6be lrc: 13/0,1 mode: --/PW res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.755885:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.755886:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a780 going to sleep for 11 seconds 00010000:00010000:1.0:1762166856.755901:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9dbe3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912f3 expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.755911:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9dbe3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912f3 expref: 27 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.755952:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451979008:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.756004:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dc14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91301 expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.756014:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dc14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91301 expref: 27 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.756038:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451979136:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.756080:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dc68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91324 expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.756089:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dc68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91324 expref: 27 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.756098:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451979264:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.756147:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91340 expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.756158:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91340 expref: 27 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.756168:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451979392:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.756211:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dca0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91347 expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.756226:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dca0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91347 expref: 27 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.756236:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451979520:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.756278:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dcae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9134e expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.756287:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dcae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9134e expref: 27 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.756296:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451979648:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.756329:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dcb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91355 expref: 27 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.756338:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dcb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91355 expref: 27 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.756348:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451979776:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.756380:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dcbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9135c expref: 27 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.756388:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dcbc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9135c expref: 27 pid: 7858 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.756407:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451979904:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.756454:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347199400/0xf915a5bdf3c9dcc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91363 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.756463:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199400/0xf915a5bdf3c9dcc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91363 expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.756474:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451980032:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.756511:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9da77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9126e expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.756521:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9da77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9126e expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.756531:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242409880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451980160:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166856.756563:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.757641:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.757692:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444461056 00000100:00100000:1.0:1762166856.757700:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444461056 00000100:00100000:1.0:1762166856.757753:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1141 00000100:00100000:1.0:1762166856.757791:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444461056:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:2.0:1762166856.757795:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451979264:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166856.757879:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444461056:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 118us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.757886:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1141 00000100:00100000:0.0:1762166856.759123:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765451978880:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166856.759125:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762166856.759152:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e6cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.759199:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444461184 00000100:00100000:0.0:1762166856.759206:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444461184 00010000:00010000:0.0:1762166856.759234:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dc68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91324 expref: 28 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.759250:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451979008:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.759268:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 740 00000100:00100000:1.0:1762166856.759269:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451979136:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.759281:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444461184:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166856.759288:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451979392:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.759295:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.759303:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dc68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91324 expref: 28 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.759304:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451979520:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.759323:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dc68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91324 expref: 28 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:0.0:1762166856.759344:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d600/0xf915a5bdf3c9dc68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91324 expref: 28 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:0.0:1762166856.759359:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166856.759393:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444461184:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 116us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.759410:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 740 00000100:00100000:1.0:1762166856.759484:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451979648:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.759527:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765451978752:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.759542:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166856.759612:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451979776:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166856.759626:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451979904:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166856.759636:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.759676:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.759705:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.759745:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.759798:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444461440 00000100:00100000:1.0:1762166856.759812:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444461440 00000100:00100000:0.0:1762166856.759848:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444461696 00000100:00100000:0.0:1762166856.759856:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444461696 00000100:00100000:3.0:1762166856.759860:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166856.759861:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9e0e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f9 expref: 27 pid: 6532 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.759878:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dc14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91301 expref: 28 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:3.0:1762166856.759900:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.760108:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.760319:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444461824 00000100:00100000:0.0:1762166856.760320:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444462080 00000100:00100000:1.0:1762166856.760328:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444461824 00000100:00100000:0.0:1762166856.760330:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444462080 00000100:00100000:3.0:1762166856.760335:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166856.760365:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91340 expref: 30 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:0.0:1762166856.760367:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dcb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91355 expref: 30 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:3.0:1762166856.760390:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.760406:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.760434:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444462208 00000100:00100000:0.0:1762166856.760440:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444461312 00000100:00100000:1.0:1762166856.760441:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444462208 00000100:00100000:3.0:1762166856.760448:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.760450:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444461312 00010000:00010000:1.0:1762166856.760474:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dcbc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9135c expref: 32 pid: 7858 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.760476:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e4e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91673 expref: 32 pid: 26444 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.760515:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444461568 00000100:00100000:2.0:1762166856.760518:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444461568 00000100:00100000:1.0:1762166856.760527:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444461952 00000100:00100000:1.0:1762166856.760533:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444461952 00000100:00100000:0.0:1762166856.760534:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444462336 00010000:00010000:2.0:1762166856.760541:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9dbe3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912f3 expref: 34 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:0.0:1762166856.760542:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444462336 00010000:00010000:1.0:1762166856.760556:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dca0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91347 expref: 35 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:2.0:1762166856.760558:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444462592 00000100:00100000:2.0:1762166856.760561:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444462592 00010000:00010000:0.0:1762166856.760561:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199400/0xf915a5bdf3c9dcc3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91363 expref: 35 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166856.760570:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9da77 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9126e expref: 36 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:0.0:1762166856.760571:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444462464 00000100:00100000:0.0:1762166856.760576:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444462464 00010000:00010000:0.0:1762166856.760591:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dcae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9134e expref: 37 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:2.0:1762166856.760602:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 741 00000100:00100000:2.0:1762166856.760616:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:2360:x1847765444461440:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166856.760626:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166856.760630:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9e0e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f9 expref: 37 pid: 6532 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166856.760648:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9e0e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f9 expref: 37 pid: 6532 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.760648:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 742 00000100:00100000:0.0:1762166856.760664:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 743 00000100:00100000:1.0:1762166856.760671:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:2360:x1847765444461696:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166856.760681:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:2359:x1847765444461824:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166856.760689:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.760700:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dc14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91301 expref: 37 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:0.0:1762166856.760706:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.760716:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dc14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91301 expref: 37 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:0.0:1762166856.760717:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91340 expref: 37 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:1.0:1762166856.760801:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ca00/0xf915a5bdf3c9dc14 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91301 expref: 37 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:0.0:1762166856.760805:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91340 expref: 37 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:0.0:1762166856.760842:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c200/0xf915a5bdf3c9dc99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91340 expref: 36 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:3.0:1762166856.760849:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 744 00010000:00010000:1.0:1762166856.760872:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.760874:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166856.760879:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444462080:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.760891:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166856.760896:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7da00/0xf915a5bdf3c9e0e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f914f9 expref: 35 pid: 6532 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166856.760903:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dcb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91355 expref: 35 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166856.760910:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.760913:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166856.760917:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dcb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91355 expref: 34 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166856.760920:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.760926:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2359:x1847765444461824:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 250us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.760939:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765444461696:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 271us (1258us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166856.760947:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d800/0xf915a5bdf3c9dcb5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91355 expref: 34 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:0.0:1762166856.760949:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 743 00000100:00100000:1.0:1762166856.760979:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 742 00010000:00010000:2.0:1762166856.760981:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6c5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.760985:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166856.760992:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 745 00000100:00100000:0.0:1762166856.761003:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765444462208:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.761015:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166856.761017:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 746 00010000:00010000:2.0:1762166856.761019:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.761025:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dcbc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9135c expref: 31 pid: 7858 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.761047:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765444461312:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166856.761048:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dcbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9135c expref: 31 pid: 7858 timeout: 577 lvb_type: 0 00000100:00100000:3.0:1762166856.761050:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765444462080:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 166us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.761058:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765444461440:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 437us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.761078:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 744 00010000:00010000:1.0:1762166856.761078:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166856.761084:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7d000/0xf915a5bdf3c9dcbc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9135c expref: 31 pid: 7858 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.761087:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 741 00010000:00010000:1.0:1762166856.761092:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e4e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91673 expref: 30 pid: 26444 timeout: 577 lvb_type: 0 00000100:00100000:3.0:1762166856.761110:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 747 00010000:00010000:1.0:1762166856.761122:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e4e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91673 expref: 28 pid: 26444 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1762166856.761125:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166856.761132:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444461568:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166856.761142:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 748 00000100:00100000:0.0:1762166856.761147:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2359:x1847765444462208:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 146us (1287us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166856.761154:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166856.761158:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 745 00000100:00100000:2.0:1762166856.761159:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444462336:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.761168:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9dbe3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912f3 expref: 28 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166856.761177:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166856.761182:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 749 00010000:00010000:2.0:1762166856.761186:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347199400/0xf915a5bdf3c9dcc3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91363 expref: 27 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:1.0:1762166856.761193:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e4e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91673 expref: 27 pid: 26444 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.761196:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765444462592:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.761208:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9dbe3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912f3 expref: 27 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:0.0:1762166856.761223:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.761237:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.761238:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9da77 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9126e expref: 26 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:1.0:1762166856.761243:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166856.761250:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e6cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.761256:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347199400/0xf915a5bdf3c9dcc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91363 expref: 26 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:1.0:1762166856.761283:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e6cc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.761299:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c000/0xf915a5bdf3c9dbe3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f912f3 expref: 26 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:0.0:1762166856.761299:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9da77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9126e expref: 26 pid: 6532 timeout: 577 lvb_type: 1 00010000:00010000:1.0:1762166856.761316:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166856.761337:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.761339:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.761339:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166856.761353:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765444461312:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 319us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.761363:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 746 00000100:00100000:3.0:1762166856.761376:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444461568:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 253us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.761376:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444462336:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 219us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.761376:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2358:x1847765444462592:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 181us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.761392:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 750 00000100:00100000:3.0:1762166856.761404:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 747 00000100:00100000:1.0:1762166856.761408:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444461952:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166856.761418:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 749 00010000:00010000:1.0:1762166856.761435:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166856.761441:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 748 00010000:00010000:1.0:1762166856.761446:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dca0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91347 expref: 22 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:3.0:1762166856.761459:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 751 00010000:00010000:1.0:1762166856.761478:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dca0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91347 expref: 21 pid: 7858 timeout: 577 lvb_type: 1 00000100:00100000:3.0:1762166856.761484:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765444462464:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166856.761489:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.761508:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.761518:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dcae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9134e expref: 21 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166856.761519:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.761524:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7de00/0xf915a5bdf3c9dca0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91347 expref: 21 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:3.0:1762166856.761572:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dcae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9134e expref: 21 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166856.761616:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.761623:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7c800/0xf915a5bdf3c9dcae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9134e expref: 20 pid: 7858 timeout: 577 lvb_type: 1 00010000:00010000:1.0:1762166856.761623:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.761628:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.761630:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166856.761631:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e6cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.761639:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9e6be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.761661:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e6cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.761667:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9e6be lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.761670:0:6532:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166856.761682:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e6cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.761705:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166856.761715:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.761716:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e6cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.761737:0:6533:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1762166856.761745:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765444462464:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 270us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.761757:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765444461952:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 349us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.761794:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 750 00000100:00100000:3.0:1762166856.761867:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 751 00010000:00010000:1.0:1762166856.761903:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199400/0xf915a5bdf3c9dcc3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91363 expref: 17 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.761919:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451980032:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.761939:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9da77 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9126e expref: 16 pid: 6532 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.761953:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242409880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451980160:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.762029:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9e6be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.762039:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9e6be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.762059:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9e6be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.762070:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9e6be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.762077:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9e6be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.762111:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1762166856.762142:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1762166856.762155:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.762166:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166856.762171:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.762179:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765451978496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6609us (6706us total) trans 17179869450 rc 0/0 00000100:00100000:0.0:1762166856.762179:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765451978624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6545us (6621us total) trans 17179869451 rc 0/0 00010000:00010000:3.0:1762166856.762186:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.762193:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:2.0:1762166856.762204:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00010000:00010000:3.0:1762166856.762212:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.762221:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e6c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.762224:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166856.762224:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1762166856.762231:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9e6be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.762240:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166856.762244:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9e6be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.762245:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166856.762249:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166856.762252:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166856.762258:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9e6be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.762271:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9e6be lrc: 1/0,0 mode: --/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.762278:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9e6be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.762307:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166856.762310:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166856.762312:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1762166856.762552:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee35047ca80/2, rc 0, transno 17179869451 00000100:00100000:0.0:1762166856.762563:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451978624:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1762166856.762582:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce4000/2, rc 0, transno 17179869450 00000100:00100000:0.0:1762166856.762586:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451978496:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1762166856.762673:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166856.762676:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166856.762678:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166856.762701:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e6cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.762711:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166856.762716:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e6cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166856.762726:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765451978368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7189us (7337us total) trans 17179869452 rc 0/0 00010000:00010000:0.0:1762166856.762730:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e6cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166856.762750:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00010000:00010000:0.0:1762166856.762756:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e6cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.762807:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9e6cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.762832:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166856.762834:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166856.762836:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1762166856.762880:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce6680/2, rc 0, transno 17179869452 00000100:00100000:3.0:1762166856.762888:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451978368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166856.766099:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.766180:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444462720 00000100:00100000:1.0:1762166856.766195:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444462720 00000100:00100000:1.0:1762166856.766274:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1142 00000100:00100000:1.0:1762166856.766285:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444462720:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762166856.766343:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9e6d3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.766362:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166856.766365:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166856.766370:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9e6d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.766385:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9e6d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.766457:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9e6d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.766476:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9e6d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.766488:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9e6d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.766495:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166856.766500:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9e6d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.766509:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9e6d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.766524:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9e6d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.766531:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9e6d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166856.766625:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444462720:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 341us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.766633:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1142 00000100:00100000:0.0:1762166856.768584:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.768641:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444462976 00000100:00100000:2.0:1762166856.768653:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444462976 00000100:00100000:2.0:1762166856.768713:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 278 00000100:00100000:2.0:1762166856.768725:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49237:x1847765444462976:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762166856.768808:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166856.768835:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7c600/0xf915a5bdf3c9e67f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916f8 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.768854:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2f:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166856.768866:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.768896:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e6da lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.768908:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e6da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.768917:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e6da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:2.0:1762166856.769096:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006265afd6 reply state 000000007d04660e transno 8589934871 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e6da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166856.769104:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166856.769213:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49237:x1847765444462976:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 492us (638us total) trans 8589934871 rc 0/0 00000100:00100000:2.0:1762166856.769219:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 278 00010000:00010000:3.0:1762166856.769977:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e6da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.769987:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e6da lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.770000:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e6da lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.770005:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166856.770009:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e6da lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.770015:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e6da lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.770025:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2f:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:3.0:1762166856.770028:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166856.770032:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e6da lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166856.770037:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e6da lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166856.770292:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.770341:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444463104 00000100:00100000:2.0:1762166856.770348:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444463104 00000100:00100000:2.0:1762166856.770397:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 279 00000100:00100000:2.0:1762166856.770405:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49237:x1847765444463104:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.770436:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.770449:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e6e1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91722 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.770487:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e6e1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91722 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.770499:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e6e1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91722 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.770516:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2f:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166856.770519:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166856.770522:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3a00, rc 0) 00000100:00100000:2.0:1762166856.770561:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49237:x1847765444463104:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 156us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.770567:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 279 00000100:00100000:0.0:1762166856.771618:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.771671:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444463232 00000100:00100000:1.0:1762166856.771705:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444463232 00000100:00100000:1.0:1762166856.771807:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1143 00000100:00100000:1.0:1762166856.771819:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:49237:x1847765444463232:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166856.771840:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166856.771860:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e6e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91729 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.771896:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e686 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916ff expref: 17 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.771902:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166856.771904:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166856.771908:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e6e8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91729 expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.771940:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e686 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916ff expref: 17 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166856.771951:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e686 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916ff expref: 17 pid: 26444 timeout: 577 lvb_type: 1 00000100:00100000:1.0:1762166856.771964:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242409880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451980288:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166856.772066:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157240 going to sleep for 11 seconds 00000100:00100000:1.0:1762166856.773035:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242409880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451980288:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.773063:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e6e8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91729 expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.773097:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159e00, rc 0) 00000100:00100000:1.0:1762166856.773159:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:49237:x1847765444463232:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1337us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.773169:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1143 00000100:00100000:0.0:1762166856.774236:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166856.774286:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444463360 00000100:00100000:3.0:1762166856.774296:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444463360 00010000:00010000:3.0:1762166856.774333:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e686 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916ff expref: 17 pid: 26444 timeout: 577 lvb_type: 1 00000100:00100000:3.0:1762166856.774375:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 752 00000100:00100000:3.0:1762166856.774385:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444463360:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166856.774400:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166856.774434:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e686 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916ff expref: 17 pid: 26444 timeout: 577 lvb_type: 1 00010000:00010000:3.0:1762166856.774449:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e686 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916ff expref: 17 pid: 26444 timeout: 577 lvb_type: 1 00010000:00010000:3.0:1762166856.774497:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dc7ce00/0xf915a5bdf3c9e686 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916ff expref: 17 pid: 26444 timeout: 577 lvb_type: 1 00010000:00010000:3.0:1762166856.774513:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166856.774515:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166856.774521:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e6e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91729 expref: 16 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.774531:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e6e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91729 expref: 16 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166856.774567:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e6e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91729 expref: 16 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166856.774581:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765451980416:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762166856.774657:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.776234:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765451980416:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762166856.776257:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166856.776317:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444463360:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1931us (2087us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.776328:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 752 00000100:00100000:0.0:1762166856.776392:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.776443:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444463488 00000100:00100000:2.0:1762166856.776450:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444463488 00000100:00100000:2.0:1762166856.776500:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1144 00000100:00100000:2.0:1762166856.776509:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444463488:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166856.776749:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x88:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166856.776753:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x88:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:2.0:1762166856.776754:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x88:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:2.0:1762166856.776756:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x88:0x0] updating lvb ctime from disk: 0 -> 1762166857 00002000:00010000:2.0:1762166856.776757:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x88:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166856.776814:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444463488:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 306us (423us total) trans 17179869453 rc 0/0 00000100:00100000:2.0:1762166856.776821:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1144 00000100:00100000:0.0:1762166856.778125:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.778188:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444463744 00000100:00100000:2.0:1762166856.778195:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444463744 00000100:00100000:2.0:1762166856.778262:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 280 00000100:00100000:2.0:1762166856.778272:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49237:x1847765444463744:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762166856.778332:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166856.778373:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7cc00/0xf915a5bdf3c9e66a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916ea expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.778396:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:2.0:1762166856.778400:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.778463:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e6ef lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.778477:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e6ef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.778487:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e6ef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:2.0:1762166856.778686:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ec97c6a3 reply state 00000000544141a2 transno 8589934872 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e6ef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166856.778701:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166856.778835:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49237:x1847765444463744:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 565us (714us total) trans 8589934872 rc 0/0 00000100:00100000:2.0:1762166856.778848:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 280 00010000:00010000:1.0:1762166856.779886:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e6ef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.779898:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e6ef lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166856.779908:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166856.779910:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e6ef lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.779918:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166856.779923:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e6ef lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.779930:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e6ef lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.779942:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:1.0:1762166856.779946:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166856.779950:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e6ef lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.779956:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e6ef lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166856.779958:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444463872 00000100:00100000:2.0:1762166856.779966:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444463872 00000100:00100000:2.0:1762166856.780013:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1145 00000100:00100000:2.0:1762166856.780022:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:49237:x1847765444463872:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.780036:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.780050:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9e6f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91730 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.780076:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e6b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9171b expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.780085:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.780087:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.780091:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9e6f6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91730 expref: 18 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.780124:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e6b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9171b expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.780137:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e6b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9171b expref: 18 pid: 26444 timeout: 577 lvb_type: 1 00000100:00100000:2.0:1762166856.780160:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451980544:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.780231:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.781308:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451980544:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.781342:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9e6f6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91730 expref: 18 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.781358:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3800, rc 0) 00000100:00100000:2.0:1762166856.781401:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:49237:x1847765444463872:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1379us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.781410:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1145 00000100:00100000:3.0:1762166856.781527:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.781570:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444464000 00000100:00100000:2.0:1762166856.781577:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444464000 00010000:00010000:2.0:1762166856.781602:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e6b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9171b expref: 18 pid: 26444 timeout: 577 lvb_type: 1 00000100:00100000:2.0:1762166856.781637:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 753 00000100:00100000:2.0:1762166856.781647:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765444464000:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166856.781660:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166856.781680:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e6b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9171b expref: 18 pid: 26444 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166856.781692:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e6b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9171b expref: 18 pid: 26444 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166856.781730:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e6b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9171b expref: 18 pid: 26444 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166856.781741:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.781743:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.781748:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9e6f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91730 expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.781757:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9e6f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91730 expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.781828:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9e6f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91730 expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.781840:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765451980672:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762166856.781914:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.783210:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765451980672:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762166856.783227:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166856.783263:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444464000:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1618us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.783272:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 753 00000100:00100000:1.0:1762166856.783614:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.783657:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444464128 00000100:00100000:2.0:1762166856.783664:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444464128 00000100:00100000:2.0:1762166856.783707:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1146 00000100:00100000:2.0:1762166856.783716:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444464128:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166856.783921:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x88:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166856.783925:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x88:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:2.0:1762166856.783927:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x88:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:2.0:1762166856.783930:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x88:0x0] updating lvb ctime from disk: 1762166856 -> 1762166857 00002000:00010000:2.0:1762166856.783932:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x88:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166856.783974:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444464128:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 259us (361us total) trans 21474836783 rc 0/0 00000100:00100000:2.0:1762166856.783982:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1146 00000100:00100000:3.0:1762166856.785330:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.785402:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444464384 00000100:00100000:1.0:1762166856.785420:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444464384 00000100:00100000:1.0:1762166856.785476:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 109 00000100:00100000:1.0:1762166856.785485:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3586a1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49237:x1847765444464384:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166856.785556:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e694 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91706 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.785592:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e6fd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.785605:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e5c2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916b2 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.785613:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e60f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916c7 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.785620:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e6fd lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.785652:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e60f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916c7 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.785665:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e60f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916c7 expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.785677:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242409880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451980800:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.785757:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e5c2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916b2 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.785789:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e5c2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916b2 expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.785807:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242408000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451980928:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166856.785838:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157240 going to sleep for 11 seconds 00000100:00100000:1.0:1762166856.787003:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242409880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451980800:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166856.787021:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242408000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451980928:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.787048:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e6fd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166856.787440:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.787492:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444464512 00000100:00100000:2.0:1762166856.787500:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444464512 00000100:00100000:3.0:1762166856.787501:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166856.787537:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e5c2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916b2 expref: 28 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.787581:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 754 00000100:00100000:2.0:1762166856.787593:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444464512:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166856.787598:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444464768 00000100:00100000:0.0:1762166856.787604:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444464768 00010000:00010000:2.0:1762166856.787606:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166856.787613:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e5c2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916b2 expref: 29 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166856.787624:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e5c2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916b2 expref: 29 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166856.787642:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9e5c2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916b2 expref: 29 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.787652:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 110 00010000:00010000:2.0:1762166856.787654:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:2.0:1762166856.787659:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e6fd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166856.787669:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:37763:x1847765444464768:12345-192.168.203.35@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1762166856.787676:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e6fd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.787682:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166856.787721:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444464512:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 132us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.787727:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 754 00000100:00100000:0.0:1762166856.787986:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:37763:x1847765444464768:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 324us (485us total) trans 8589934873 rc 0/0 00000100:00100000:0.0:1762166856.787994:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 110 00000100:00100000:3.0:1762166856.788992:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.789030:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444464896 00000100:00100000:2.0:1762166856.789037:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444464896 00010000:00010000:2.0:1762166856.789060:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e60f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916c7 expref: 28 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.789090:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 755 00000100:00100000:2.0:1762166856.789097:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2359:x1847765444464896:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166856.789109:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166856.789116:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e60f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916c7 expref: 28 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166856.789128:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e60f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916c7 expref: 28 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166856.789148:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9e60f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f916c7 expref: 28 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166856.789161:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:2.0:1762166856.789166:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e6fd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.789187:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e6fd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.789194:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e6fd lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.789224:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166856.789266:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e6fd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166856.789268:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765444464896:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 170us (278us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166856.789296:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e6fd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166856.789302:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 755 00010000:00010000:1.0:1762166856.789338:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e704 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.789359:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e6e1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91722 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.789368:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e704 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.789435:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e6e1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91722 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.789454:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e6e1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91722 expref: 26 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.789472:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242408000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451981056:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166856.789588:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157240 going to sleep for 11 seconds 00000100:00100000:1.0:1762166856.790538:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242408000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451981056:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166856.790564:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e704 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166856.790841:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.790889:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444465024 00000100:00100000:2.0:1762166856.790901:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444465024 00010000:00010000:2.0:1762166856.790942:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e6e1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91722 expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.790990:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 756 00000100:00100000:2.0:1762166856.791001:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444465024:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166856.791027:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166856.791038:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e6e1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91722 expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166856.791052:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e6e1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91722 expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166856.791074:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e6e1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91722 expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166856.791091:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2f:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166856.791106:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e704 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.791114:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e704 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.791122:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e704 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.791161:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.791209:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e704 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.791220:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e704 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166856.791228:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444465024:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 226us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.791250:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 756 00000100:00100000:0.0:1762166856.791613:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f286d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451981184:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166856.791665:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166856.791699:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166856.791725:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451981184 00000100:00100000:3.0:1762166856.791733:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451981184 00000100:00100000:3.0:1762166856.791813:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1762166856.791831:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30821:x1847765451981184:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166856.791910:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30821:x1847765451981184:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 81us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.791918:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1762166856.791935:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f286d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451981184:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166856.791966:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f286d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451981312:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166856.791983:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166856.791998:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166856.792072:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451981312 00000100:00100000:3.0:1762166856.792078:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451981312 00000100:00100000:3.0:1762166856.792112:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1762166856.792119:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30821:x1847765451981312:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166856.792183:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30821:x1847765451981312:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 65us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.792190:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1762166856.792222:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f286d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451981312:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1762166856.792349:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934874 00000100:00100000:0.0:1762166856.792384:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc30380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451981440:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166856.792401:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166856.792416:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166856.792453:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451981440 00000100:00100000:3.0:1762166856.792459:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451981440 00000100:00100000:3.0:1762166856.792489:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1762166856.792496:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30821:x1847765451981440:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166856.792648:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30821:x1847765451981440:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 151us (243us total) trans 17179869454 rc 0/0 00000100:00100000:3.0:1762166856.792657:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1762166856.792690:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc30380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451981440:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1762166856.792749:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934875 00010000:00010000:0.0:1762166856.792796:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e704 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.792808:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e704 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.792815:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e704 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.792822:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.792826:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e704 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.792833:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e704 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.792858:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2f:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:0.0:1762166856.792861:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166856.792866:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e704 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.792871:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9e704 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.792888:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e6fd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.792892:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e6fd lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.792896:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e6fd lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.792899:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.792900:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e6fd lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.792903:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e6fd lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.792908:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:0.0:1762166856.792909:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166856.792910:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e6fd lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.792913:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9e6fd lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.792920:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:0.0:1762166856.792925:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166856.792930:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc7d200/0xf915a5bdf3c9e694 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91706 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.793001:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3586a1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49237:x1847765444464384:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 7517us (7675us total) trans 8589934876 rc 0/0 00000100:00100000:0.0:1762166856.793010:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 109 00000020:00080000:0.0:1762166856.793014:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166856.794167:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.794205:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444465152 00000100:00100000:2.0:1762166856.794210:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444465152 00000100:00100000:2.0:1762166856.794244:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 281 00000100:00100000:2.0:1762166856.794250:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49237:x1847765444465152:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.794266:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.794284:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e70b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91737 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.794331:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e70b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91737 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.794345:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e70b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91737 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.794363:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166856.794367:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166856.794369:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2600, rc 0) 00000100:00100000:2.0:1762166856.794411:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49237:x1847765444465152:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 161us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.794416:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 281 00000100:00100000:3.0:1762166856.795706:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.795756:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444465408 00000100:00100000:0.0:1762166856.795788:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444465408 00000100:00100000:0.0:1762166856.795833:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 111 00000100:00100000:0.0:1762166856.795843:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49237:x1847765444465408:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166856.796026:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49237:x1847765444465408:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 185us (322us total) trans 8589934877 rc 0/0 00000100:00100000:0.0:1762166856.796034:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 111 00000100:00100000:3.0:1762166856.796868:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.796903:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444465664 00000100:00100000:0.0:1762166856.796909:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444465664 00000100:00100000:0.0:1762166856.796942:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 112 00000100:00100000:0.0:1762166856.796950:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49237:x1847765444465664:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:0.0:1762166856.797155:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x2f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166856.797257:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e712 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.797271:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e712 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.797282:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e712 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.797305:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e712 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.797312:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e712 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.797318:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e712 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.797340:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166856.797371:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166856.797380:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e712 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.797388:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166856.797393:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e712 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.797409:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e712 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.797433:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2f:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:3.0:1762166856.797437:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:0.0:1762166856.797443:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49237:x1847765444465664:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 492us (573us total) trans 8589934878 rc 0/0 00010000:00010000:3.0:1762166856.797446:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e712 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166856.797456:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 112 00010000:00010000:3.0:1762166856.797457:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9e712 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166856.797485:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166856.797487:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166856.797489:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166856.806278:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.806348:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444465792 00000100:00100000:2.0:1762166856.806359:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444465792 00000100:00100000:2.0:1762166856.806417:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 282 00000100:00100000:2.0:1762166856.806437:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49240:x1847765444465792:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166856.806459:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.806479:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e719 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9173e expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.806544:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e720 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806558:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e720 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806569:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e720 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806583:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e727 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806596:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e727 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806604:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e727 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806707:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e72e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806712:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e72e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806729:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e72e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.806757:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166856.806787:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166856.806805:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e72e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806817:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e72e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806824:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e720 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806830:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e720 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806836:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e720 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806842:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.806845:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e720 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806851:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e720 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806859:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166856.806869:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166856.806874:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e720 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806883:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e720 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806907:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e727 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806913:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e727 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806918:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e727 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806923:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.806926:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e727 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806931:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e727 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806938:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01300) 00010000:00010000:2.0:1762166856.806940:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166856.806943:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e727 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806948:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e727 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.806984:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e719 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9173e expref: 32 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.806996:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e72e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9173e expref: 31 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.807002:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166856.807010:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166856.807013:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2e00, rc 0) 00000100:00100000:2.0:1762166856.807069:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49240:x1847765444465792:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 644us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.807076:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 282 00000100:00100000:1.0:1762166856.820478:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.820560:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444465920 00000100:00100000:2.0:1762166856.820571:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444465920 00000100:00100000:2.0:1762166856.820626:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 283 00000100:00100000:2.0:1762166856.820639:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49244:x1847765444465920:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166856.820707:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e735 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.820724:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e735 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.820736:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e735 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.820751:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e73c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.820758:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e73c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.820805:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e73c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.820916:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e743 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.820924:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e743 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.820947:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e743 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.820979:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166856.820983:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166856.820994:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e743 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821006:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e735 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821013:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e735 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821019:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e735 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821025:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.821029:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e735 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821036:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e735 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821047:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166856.821050:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166856.821055:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e735 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821060:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e735 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821074:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e73c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821086:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e73c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821091:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e73c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821097:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.821100:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e73c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821105:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e73c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821114:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01300) 00010000:00010000:2.0:1762166856.821117:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166856.821119:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e73c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821125:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e73c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821140:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e743 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821146:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e743 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821151:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e743 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821156:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.821159:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e743 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821171:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e743 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821178:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166856.821181:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166856.821184:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e743 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.821189:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e743 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166856.821262:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49244:x1847765444465920:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 626us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.821270:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 283 00000100:00100000:3.0:1762166856.830563:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.830681:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444466176 00000100:00100000:2.0:1762166856.830690:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444466176 00000100:00100000:2.0:1762166856.830744:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 284 00000100:00100000:2.0:1762166856.830755:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49246:x1847765444466176:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.830813:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.830833:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e74a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91745 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.830924:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e751 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.830937:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e751 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.830947:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e751 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.830991:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166856.831124:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e74a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91745 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.831142:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e751 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91745 expref: 33 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.831150:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166856.831152:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166856.831156:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3200, rc 0) 00000100:00100000:2.0:1762166856.831212:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49246:x1847765444466176:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 458us (656us total) trans 8589934879 rc 0/0 00000100:00100000:2.0:1762166856.831219:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 284 00000100:00100000:3.0:1762166856.833820:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.833855:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444466432 00000100:00100000:2.0:1762166856.833866:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444466432 00000100:00100000:2.0:1762166856.833918:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 285 00000100:00100000:2.0:1762166856.833928:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49246:x1847765444466432:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.833957:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.833975:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e75f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9174c expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.834066:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e766 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.834081:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e72e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9173e expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.834090:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e766 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.834137:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e72e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9173e expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.834151:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e72e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9173e expref: 34 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.834165:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451981568:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.834247:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.835616:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451981568:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.835642:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e766 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166856.835888:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.836016:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444466560 00000100:00100000:1.0:1762166856.836032:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444466560 00010000:00010000:1.0:1762166856.836085:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e72e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9173e expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.836132:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 757 00000100:00100000:1.0:1762166856.836145:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444466560:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166856.836165:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.836173:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e72e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9173e expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.836189:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e72e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9173e expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.836216:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e72e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9173e expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.836237:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:1.0:1762166856.836242:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e766 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.836251:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e766 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.836280:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e766 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.836316:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.836345:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e766 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.836364:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e766 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.836387:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000100:00100000:1.0:1762166856.836388:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765444466560:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 244us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.836401:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 757 00010000:00010000:2.0:1762166856.836606:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e75f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9174c expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.836621:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e766 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9174c expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.836626:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166856.836628:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166856.836630:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2200, rc 0) 00000100:00100000:2.0:1762166856.836670:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49246:x1847765444466432:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2746us (2859us total) trans 8589934880 rc 0/0 00000100:00100000:2.0:1762166856.836677:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 285 00000100:00100000:3.0:1762166856.838009:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.838135:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444466688 00000100:00100000:0.0:1762166856.838143:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444466688 00000100:00100000:0.0:1762166856.838196:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 113 00000100:00100000:0.0:1762166856.838207:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49246:x1847765444466688:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:0.0:1762166856.838359:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49246:x1847765444466688:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 153us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.838368:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 113 00000100:00100000:1.0:1762166856.840022:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.840106:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444466944 00000100:00100000:0.0:1762166856.840116:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444466944 00000100:00100000:0.0:1762166856.840170:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 114 00000100:00100000:0.0:1762166856.840180:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49246:x1847765444466944:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166856.840387:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49246:x1847765444466944:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 208us (375us total) trans 8589934881 rc 0/0 00000100:00100000:0.0:1762166856.840394:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 114 00000100:00100000:3.0:1762166856.841669:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.841745:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444467200 00000100:00100000:2.0:1762166856.841758:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444467200 00000100:00100000:2.0:1762166856.841851:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 286 00000100:00100000:2.0:1762166856.841862:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49246:x1847765444467200:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.841887:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.841890:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762166856.841920:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e766 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9174c expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.841941:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e751 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91745 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.841953:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166856.841959:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.841974:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e774 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91753 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.842076:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9e77b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.842091:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9e77b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.842101:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9e77b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.842115:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166856.842274:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e774 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91753 expref: 36 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.842288:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9e77b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91753 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.842296:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166856.842299:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166856.842302:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2800, rc 0) 00000100:00100000:2.0:1762166856.842369:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49246:x1847765444467200:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 507us (704us total) trans 8589934882 rc 0/0 00000100:00100000:2.0:1762166856.842377:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 286 00000100:00100000:3.0:1762166856.843893:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.843927:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444467456 00000100:00100000:0.0:1762166856.843937:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444467456 00000100:00100000:0.0:1762166856.843992:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 115 00000100:00100000:0.0:1762166856.844004:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f4ed050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49246:x1847765444467456:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166856.844079:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9e77b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91753 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.844118:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e789 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.844131:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e70b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91737 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.844139:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e789 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.844171:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e70b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91737 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.844185:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e70b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91737 expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.844197:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc30000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451981696:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.844266:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.845519:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc30000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451981696:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.845550:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e789 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166856.845981:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.846051:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444467584 00000100:00100000:1.0:1762166856.846060:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444467584 00010000:00010000:1.0:1762166856.846100:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e70b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91737 expref: 36 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.846145:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 758 00000100:00100000:1.0:1762166856.846158:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765444467584:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166856.846174:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.846180:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e70b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91737 expref: 36 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.846189:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e70b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91737 expref: 36 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.846207:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e70b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91737 expref: 36 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.846222:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:1.0:1762166856.846226:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e789 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.846252:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e789 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.846259:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e789 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.846289:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.846315:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e789 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.846327:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e789 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166856.846348:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444467584:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 192us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.846359:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 758 00010000:00010000:0.0:1762166856.846619:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e789 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.846625:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e789 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.846629:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e789 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.846633:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.846636:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e789 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.846643:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e789 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.846653:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:0.0:1762166856.846656:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166856.846659:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e789 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.846665:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e789 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.846677:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:0.0:1762166856.846679:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166856.846684:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9e77b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91753 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.846853:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f4ed050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49246:x1847765444467456:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2853us (2968us total) trans 8589934883 rc -22/-22 00000100:00100000:0.0:1762166856.846866:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 115 00000100:00100000:3.0:1762166856.847864:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.847899:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444467712 00000100:00100000:2.0:1762166856.847906:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444467712 00000100:00100000:2.0:1762166856.847945:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 287 00000100:00100000:2.0:1762166856.847952:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49246:x1847765444467712:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.847972:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.847990:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e790 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9175a expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.848040:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e790 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9175a expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.848050:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e790 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9175a expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.848062:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166856.848064:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166856.848073:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3000, rc 0) 00000100:00100000:2.0:1762166856.848107:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49246:x1847765444467712:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 154us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.848113:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 287 00000100:00100000:1.0:1762166856.849878:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.849968:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444467968 00000100:00100000:2.0:1762166856.849975:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444467968 00000100:00100000:2.0:1762166856.850023:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 288 00000100:00100000:2.0:1762166856.850032:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49246:x1847765444467968:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.850050:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.850068:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e797 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91761 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.850723:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e79e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.850745:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e79e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.850758:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e79e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.850813:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 0 00010000:00010000:2.0:1762166856.850876:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e797 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91761 expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.850898:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e79e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91761 expref: 37 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.850908:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff9ee359d01100) 00010000:00010000:2.0:1762166856.850911:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166856.850922:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2000, rc 0) 00000100:00100000:2.0:1762166856.850986:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49246:x1847765444467968:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 954us (1114us total) trans 8589934884 rc 0/0 00000100:00100000:2.0:1762166856.850995:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 288 00000100:00100000:3.0:1762166856.852800:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.852845:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444468224 00000100:00100000:2.0:1762166856.852857:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444468224 00000100:00100000:2.0:1762166856.852918:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 289 00000100:00100000:2.0:1762166856.852939:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49246:x1847765444468224:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.852968:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.852987:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e7ac lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91768 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.853084:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e7b3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.853102:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e7b3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.853113:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e7b3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.853125:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166856.853241:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e7ac lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91768 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.853259:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e7b3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91768 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.853267:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166856.853270:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166856.853288:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3400, rc 0) 00000100:00100000:2.0:1762166856.853348:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49246:x1847765444468224:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 420us (585us total) trans 8589934885 rc 0/0 00000100:00100000:2.0:1762166856.853357:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 289 00000100:00100000:3.0:1762166856.854729:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.854806:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444468480 00000100:00100000:0.0:1762166856.854816:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444468480 00000100:00100000:0.0:1762166856.854881:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 116 00000100:00100000:0.0:1762166856.854892:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49246:x1847765444468480:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166856.854966:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e7b3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91768 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.855002:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e7c1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.855025:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e790 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9175a expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.855037:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e7c1 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.855077:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e790 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9175a expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.855091:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e790 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9175a expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.855107:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc30000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451981824:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.855197:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.856388:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc30000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451981824:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.856440:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e7c1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166856.856451:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.856584:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444468608 00000100:00100000:1.0:1762166856.856593:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444468608 00010000:00010000:1.0:1762166856.856629:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e790 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9175a expref: 40 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.856668:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 759 00000100:00100000:1.0:1762166856.856677:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2361:x1847765444468608:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166856.856694:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.856704:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e790 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9175a expref: 40 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.856717:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e790 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9175a expref: 40 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.856738:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e790 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9175a expref: 40 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.856756:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:1.0:1762166856.856807:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e7c1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.856816:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e7c1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.856823:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e7c1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.856850:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.856877:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e7c1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.856892:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e7c1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166856.856905:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444468608:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 226us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.856917:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 759 00010000:00010000:0.0:1762166856.856918:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e7c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.856937:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e79e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91761 expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.856946:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e7c8 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.856983:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e79e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91761 expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166856.856997:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e79e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91761 expref: 38 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166856.857013:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc30000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451981952:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166856.857093:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166856.858191:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc30000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451981952:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166856.858214:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e7c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166856.858332:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.858386:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444468736 00000100:00100000:1.0:1762166856.858394:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444468736 00010000:00010000:1.0:1762166856.858436:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e79e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91761 expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.858479:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 760 00000100:00100000:1.0:1762166856.858488:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444468736:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166856.858503:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.858509:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e79e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91761 expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.858521:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e79e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91761 expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.858541:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e79e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91761 expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.858577:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff9ee359d01100) 00010000:00010000:1.0:1762166856.858582:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e7c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.858590:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e7c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.858597:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e7c8 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166856.858623:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166856.858650:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e7c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166856.858668:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2360:x1847765444468736:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 180us (336us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166856.858681:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e7c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166856.858685:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 760 00000100:00100000:0.0:1762166856.859094:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc30000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451982080:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166856.859132:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166856.859161:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166856.859177:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451982080 00000100:00100000:3.0:1762166856.859182:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451982080 00000100:00100000:3.0:1762166856.859221:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1762166856.859228:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30821:x1847765451982080:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166856.859299:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30821:x1847765451982080:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 71us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.859306:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1762166856.859348:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc30000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451982080:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1762166856.859396:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934886 00000001:00080000:0.0:1762166856.859474:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934887 00010000:00010000:0.0:1762166856.859496:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e7c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.859505:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e7c8 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.859512:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e7c8 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.859518:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.859522:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e7c8 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.859529:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e7c8 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.859539:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff9ee359d01100) 00010000:00010000:0.0:1762166856.859542:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166856.859546:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e7c8 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.859551:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9e7c8 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.859576:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e7c1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.859582:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e7c1 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.859588:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e7c1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.859593:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166856.859596:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e7c1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.859601:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e7c1 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.859609:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:0.0:1762166856.859611:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166856.859613:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e7c1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.859616:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9e7c1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.859627:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:0.0:1762166856.859629:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166856.859634:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e7b3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91768 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166856.859708:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49246:x1847765444468480:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 4818us (4984us total) trans 8589934888 rc 0/0 00000100:00100000:0.0:1762166856.859715:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 116 00000020:00080000:0.0:1762166856.859723:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166856.860842:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.860892:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444468864 00000100:00100000:2.0:1762166856.860899:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444468864 00000100:00100000:2.0:1762166856.860947:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 290 00000100:00100000:2.0:1762166856.860961:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49246:x1847765444468864:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.860979:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.860998:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e7cf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9176f expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.861044:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e7cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9176f expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.861056:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e7cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9176f expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.861071:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166856.861074:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166856.861078:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3a00, rc 0) 00000100:00100000:2.0:1762166856.861124:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49246:x1847765444468864:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 168us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.861130:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 290 00000100:00100000:3.0:1762166856.862529:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.862576:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444469120 00000100:00100000:0.0:1762166856.862583:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444469120 00000100:00100000:0.0:1762166856.862618:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 117 00000100:00100000:0.0:1762166856.862624:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49246:x1847765444469120:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:0.0:1762166856.863054:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x30:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1762166856.863132:0:30821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].15, 64 off9344 00000001:00080000:0.0:1762166856.863138:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934889 00010000:00010000:0.0:1762166856.863170:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e7d6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.863181:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e7d6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.863188:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e7d6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.863193:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e7d6 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.863197:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e7d6 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.863200:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e7d6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166856.863215:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166856.863243:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166856.863249:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e7d6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.863255:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166856.863271:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e7d6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.863278:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e7d6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.863289:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:2.0:1762166856.863292:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166856.863295:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e7d6 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.863300:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9e7d6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166856.863315:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166856.863316:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166856.863318:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166856.863336:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49246:x1847765444469120:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 710us (812us total) trans 8589934890 rc 0/0 00000100:00100000:0.0:1762166856.863343:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 117 00000020:00080000:0.0:1762166856.863348:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166856.864547:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.864612:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444469376 00000100:00100000:0.0:1762166856.864629:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444469376 00000100:00100000:0.0:1762166856.864683:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 118 00000100:00100000:0.0:1762166856.864691:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49246:x1847765444469376:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166856.865003:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49246:x1847765444469376:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 311us (459us total) trans 8589934891 rc 0/0 00000100:00100000:0.0:1762166856.865011:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 118 00000100:00100000:3.0:1762166856.874005:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.874075:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444469504 00000100:00100000:2.0:1762166856.874086:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444469504 00000100:00100000:2.0:1762166856.874140:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 291 00000100:00100000:2.0:1762166856.874150:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49248:x1847765444469504:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166856.874172:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.874191:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e7dd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91776 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.874268:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e7e4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874282:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e7e4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874292:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e7e4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874320:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e7eb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874327:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e7eb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874333:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e7eb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874443:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e7f2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874452:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e7f2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874459:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e7f2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.874488:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166856.874493:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166856.874510:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e7f2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874520:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e7f2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874527:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e7e4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874532:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e7e4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874538:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e7e4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874554:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.874558:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e7e4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874564:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e7e4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874575:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166856.874578:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166856.874582:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e7e4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874588:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e7e4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874612:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e7eb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874618:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e7eb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874623:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e7eb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874628:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.874631:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e7eb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874637:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e7eb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874643:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01500) 00010000:00010000:2.0:1762166856.874650:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166856.874653:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e7eb lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874659:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e7eb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.874688:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e7dd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91776 expref: 45 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.874700:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e7f2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91776 expref: 44 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.874706:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166856.874709:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166856.874711:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2200, rc 0) 00000100:00100000:2.0:1762166856.874809:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49248:x1847765444469504:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 660us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.874817:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 291 00000100:00100000:3.0:1762166856.876534:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.876583:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444469632 00000100:00100000:2.0:1762166856.876590:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444469632 00000100:00100000:2.0:1762166856.876635:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1147 00000100:00100000:2.0:1762166856.876642:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444469632:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166856.876654:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.876678:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e7f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9177d expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.876737:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451982208:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166856.876838:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34aab0480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.877982:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451982208:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166856.878016:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e7f9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9177d expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.878035:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e7f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9177d expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.878049:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2c00, rc 0) 00000100:00100000:2.0:1762166856.878092:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444469632:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 1449us (1563us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166856.878101:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1147 00000100:00100000:3.0:1762166856.895109:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.895182:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444469760 00000100:00100000:2.0:1762166856.895197:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444469760 00000100:00100000:2.0:1762166856.895256:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 292 00000100:00100000:2.0:1762166856.895266:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49252:x1847765444469760:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166856.895335:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e800 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895349:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e800 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895358:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e800 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895368:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e807 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895372:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e807 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895389:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e807 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895494:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e80e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895501:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e80e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895509:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e80e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.895537:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166856.895541:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166856.895550:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e80e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895561:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e800 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895565:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e800 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895569:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e800 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895572:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.895575:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e800 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895580:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e800 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895587:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166856.895594:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166856.895597:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e800 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895601:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e800 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895613:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e807 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895618:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e807 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895623:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e807 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895627:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.895630:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e807 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895635:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e807 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895642:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01500) 00010000:00010000:2.0:1762166856.895644:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166856.895647:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e807 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895652:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e807 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895668:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e80e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895673:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e80e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895685:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e80e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895689:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.895692:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e80e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895697:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e80e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895705:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166856.895707:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166856.895710:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e80e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.895715:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e80e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166856.895810:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49252:x1847765444469760:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 545us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.895818:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 292 00000100:00100000:3.0:1762166856.905725:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.905803:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444470016 00000100:00100000:2.0:1762166856.905813:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444470016 00000100:00100000:2.0:1762166856.905894:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 293 00000100:00100000:2.0:1762166856.905906:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49254:x1847765444470016:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.905926:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.905946:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e815 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91784 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.906045:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e81c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.906070:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e81c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.906081:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e81c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.906092:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166856.906205:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e815 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91784 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.906224:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e81c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91784 expref: 46 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.906232:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166856.906235:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166856.906239:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3e00, rc 0) 00000100:00100000:2.0:1762166856.906300:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49254:x1847765444470016:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 397us (584us total) trans 8589934892 rc 0/0 00000100:00100000:2.0:1762166856.906306:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 293 00000100:00100000:3.0:1762166856.908412:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.908508:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444470144 00000100:00100000:2.0:1762166856.908516:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444470144 00000100:00100000:2.0:1762166856.908567:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1148 00000100:00100000:2.0:1762166856.908576:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444470144:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.908591:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.908607:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e82a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9178b expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.908658:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451982336:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166856.908741:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.909877:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451982336:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166856.909908:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e82a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9178b expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.909929:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e82a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9178b expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.909940:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2c00, rc 0) 00000100:00100000:2.0:1762166856.909991:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444470144:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1416us (1614us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166856.909999:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1148 00000100:00100000:3.0:1762166856.911751:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.911820:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444470400 00000100:00100000:2.0:1762166856.911829:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444470400 00000100:00100000:2.0:1762166856.911870:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 294 00000100:00100000:2.0:1762166856.911876:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49254:x1847765444470400:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.911895:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.911914:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e831 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91792 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.912020:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e838 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.912032:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e7f2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91776 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.912038:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e838 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.912073:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e7f2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91776 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.912082:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e7f2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91776 expref: 47 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.912092:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451982464:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.912148:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.913031:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451982464:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.913054:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e838 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166856.913258:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.913321:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444470528 00000100:00100000:1.0:1762166856.913327:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444470528 00010000:00010000:1.0:1762166856.913369:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e7f2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91776 expref: 48 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.913405:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 761 00000100:00100000:1.0:1762166856.913416:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2361:x1847765444470528:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166856.913440:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.913447:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e7f2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91776 expref: 48 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.913457:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e7f2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91776 expref: 48 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.913489:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e7f2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91776 expref: 48 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.913504:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:1.0:1762166856.913509:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e838 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.913517:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e838 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.913524:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e838 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.913549:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.913573:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e838 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.913582:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e838 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166856.913594:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:2361:x1847765444470528:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 180us (336us total) trans 0 rc 0/0 00000004:00200000:2.0:1762166856.913597:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000100:00100000:1.0:1762166856.913613:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 761 00010000:00010000:2.0:1762166856.913743:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e831 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91792 expref: 48 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.913757:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e838 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91792 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.913790:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166856.913793:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166856.913796:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3c00, rc 0) 00000100:00100000:2.0:1762166856.913833:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49254:x1847765444470400:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1957us (2088us total) trans 8589934893 rc 0/0 00000100:00100000:2.0:1762166856.913841:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 294 00000100:00100000:3.0:1762166856.915519:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.915584:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444470784 00000100:00100000:2.0:1762166856.915592:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444470784 00000100:00100000:2.0:1762166856.915645:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 295 00000100:00100000:2.0:1762166856.915654:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49254:x1847765444470784:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.915674:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.915691:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e846 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91799 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.916229:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e84d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.916243:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e84d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.916253:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e84d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.916265:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 0 00010000:00010000:2.0:1762166856.916309:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e846 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91799 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.916327:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e84d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91799 expref: 49 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.916334:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff9ee359d01500) 00010000:00010000:2.0:1762166856.916337:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166856.916341:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2000, rc 0) 00000100:00100000:2.0:1762166856.916414:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49254:x1847765444470784:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 760us (901us total) trans 8589934894 rc 0/0 00000100:00100000:2.0:1762166856.916432:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 295 00000100:00100000:3.0:1762166856.918295:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.918350:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444471040 00000100:00100000:2.0:1762166856.918359:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444471040 00000100:00100000:2.0:1762166856.918410:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 296 00000100:00100000:2.0:1762166856.918418:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49254:x1847765444471040:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.918451:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.918467:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e85b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f917a0 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.918552:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e862 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.918564:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e84d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91799 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.918570:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e862 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.918597:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e84d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91799 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.918609:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e84d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91799 expref: 50 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.918622:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451982592:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.918700:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.919890:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451982592:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.919931:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e862 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166856.919980:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.920024:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444471168 00000100:00100000:1.0:1762166856.920030:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444471168 00010000:00010000:1.0:1762166856.920055:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e84d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91799 expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.920087:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 762 00000100:00100000:1.0:1762166856.920096:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444471168:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166856.920106:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.920110:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e84d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91799 expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.920126:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e84d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91799 expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.920140:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e84d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91799 expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.920151:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff9ee359d01500) 00010000:00010000:1.0:1762166856.920154:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e862 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.920162:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e862 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.920169:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e862 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.920193:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.920216:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e862 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.920226:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e862 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.920240:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 0 00000100:00100000:1.0:1762166856.920242:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2361:x1847765444471168:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 140us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.920256:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 762 00000004:00080000:2.0:1762166856.920540:0:30817:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x89:0x0], index 0: 0 00010000:00010000:2.0:1762166856.920671:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e862 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.920679:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e862 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.920685:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e862 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.920691:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166856.920694:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e862 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.920701:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e862 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.920710:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff9ee359d01500) 00010000:00010000:2.0:1762166856.920713:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166856.920716:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e862 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.920722:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e862 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.920809:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e85b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917a0 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.920819:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166856.920822:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166856.920826:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e85b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917a0 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.920836:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2c00, rc 0) 00000100:00100000:2.0:1762166856.920874:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49254:x1847765444471040:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2456us (2585us total) trans 8589934895 rc 301/301 00000100:00100000:2.0:1762166856.920881:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 296 00000100:00100000:3.0:1762166856.922000:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166856.922063:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444471424 00000100:00100000:0.0:1762166856.922070:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444471424 00000100:00100000:0.0:1762166856.922109:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 119 00000100:00100000:0.0:1762166856.922120:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49254:x1847765444471424:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166856.922337:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49254:x1847765444471424:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 220us (339us total) trans 8589934896 rc 0/0 00000100:00100000:0.0:1762166856.922342:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 119 00000100:00100000:3.0:1762166856.923219:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.923266:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444471552 00000100:00100000:2.0:1762166856.923273:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444471552 00000100:00100000:2.0:1762166856.923321:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 297 00000100:00100000:2.0:1762166856.923329:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49254:x1847765444471552:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.923343:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.923358:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e870 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f917a7 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.923448:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e877 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.923462:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e838 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91792 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.923469:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e877 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.923505:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e838 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91792 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.923516:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e838 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91792 expref: 51 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.923529:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451982720:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.923597:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee248001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.925083:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451982720:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.925103:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e877 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166856.925286:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.925329:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444471680 00000100:00100000:1.0:1762166856.925334:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444471680 00010000:00010000:1.0:1762166856.925356:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e838 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91792 expref: 52 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.925382:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 763 00000100:00100000:1.0:1762166856.925388:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2361:x1847765444471680:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166856.925397:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.925411:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e838 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91792 expref: 52 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.925419:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e838 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91792 expref: 52 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.925450:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9e838 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91792 expref: 52 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.925466:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:1.0:1762166856.925471:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e877 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.925479:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e877 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.925485:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e877 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166856.925507:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.925527:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e877 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.925536:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e877 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166856.925545:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444471680:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 156us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.925551:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 763 00000004:00200000:2.0:1762166856.925571:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166856.925576:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166856.925593:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e877 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.925619:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e870 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917a7 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.925633:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e877 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917a7 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.925653:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166856.925656:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166856.925659:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3400, rc 0) 00000100:00100000:2.0:1762166856.925690:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49254:x1847765444471552:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2361us (2472us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.925697:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 297 00000100:00100000:3.0:1762166856.926795:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.926831:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444471808 00000100:00100000:2.0:1762166856.926838:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444471808 00000100:00100000:2.0:1762166856.926878:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1149 00000100:00100000:2.0:1762166856.926888:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444471808:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.926901:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.926915:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e87e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f917ae expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.926960:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451982848:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166856.927026:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee248001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.928004:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451982848:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166856.928036:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e87e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917ae expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.928052:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e87e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917ae expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.928062:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2600, rc 0) 00000100:00100000:2.0:1762166856.928116:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444471808:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1229us (1322us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166856.928124:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1149 00000100:00100000:3.0:1762166856.929075:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.929133:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444471936 00000100:00100000:2.0:1762166856.929140:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444471936 00000100:00100000:2.0:1762166856.929185:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 298 00000100:00100000:2.0:1762166856.929196:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49254:x1847765444471936:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.929211:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.929242:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e885 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f917b5 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.929303:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9e88c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.929315:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9e88c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.929326:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9e88c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.929358:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 0 00000004:00200000:2.0:1762166856.929362:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166856.929377:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9e88c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.929398:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e885 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917b5 expref: 52 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.929415:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9e88c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917b5 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.929450:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166856.929454:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166856.929456:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2800, rc 0) 00000100:00100000:2.0:1762166856.929496:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49254:x1847765444471936:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 303us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.929503:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 298 00000100:00100000:3.0:1762166856.930561:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.930626:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444472064 00000100:00100000:2.0:1762166856.930631:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444472064 00000100:00100000:2.0:1762166856.930667:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1150 00000100:00100000:2.0:1762166856.930675:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765444472064:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.930687:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.930701:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e893 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f917bc expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166856.930720:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166856.930732:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.930734:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.930740:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e893 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917bc expref: 19 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.930750:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e893 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917bc expref: 19 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.930757:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2e00, rc 0) 00000100:00100000:2.0:1762166856.930808:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765444472064:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 135us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.930827:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1150 00000100:00100000:3.0:1762166856.932043:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.932087:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444472320 00000100:00100000:2.0:1762166856.932094:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444472320 00000100:00100000:2.0:1762166856.932136:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 299 00000100:00100000:2.0:1762166856.932145:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49254:x1847765444472320:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.932161:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.932177:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e89a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f917c3 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.932256:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e8a1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.932275:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e8a1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166856.932284:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e8a1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166856.932299:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166856.932407:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e89a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917c3 expref: 54 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.932419:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e8a1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917c3 expref: 53 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.932438:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166856.932440:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166856.932442:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3000, rc 0) 00000100:00100000:2.0:1762166856.932481:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49254:x1847765444472320:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 338us (443us total) trans 8589934897 rc 0/0 00000100:00100000:2.0:1762166856.932500:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 299 00000100:00100000:3.0:1762166856.935381:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.935443:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444472448 00000100:00100000:2.0:1762166856.935452:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444472448 00000100:00100000:2.0:1762166856.935511:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1151 00000100:00100000:2.0:1762166856.935523:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444472448:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.935540:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.935559:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e8af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f917ca expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.935650:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451982976:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166856.935740:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee248001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.937093:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451982976:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166856.937125:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e8af lrc: 1/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917ca expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.937144:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e8af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917ca expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.937157:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2000, rc 0) 00000100:00100000:2.0:1762166856.937206:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444472448:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1684us (1831us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166856.937216:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1151 00000100:00100000:3.0:1762166856.938661:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.938721:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444472576 00000100:00100000:2.0:1762166856.938728:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444472576 00000100:00100000:2.0:1762166856.938795:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1152 00000100:00100000:2.0:1762166856.938818:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444472576:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.938834:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.938851:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e8b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f917d1 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.938901:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451983104:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166856.938987:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee248001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.940158:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451983104:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166856.940186:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e8b6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917d1 expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.940205:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e8b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917d1 expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.940217:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2600, rc 0) 00000100:00100000:2.0:1762166856.940267:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444472576:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1455us (1611us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166856.940275:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1152 00000100:00100000:3.0:1762166856.941457:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.941506:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444472704 00000100:00100000:2.0:1762166856.941513:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444472704 00000100:00100000:2.0:1762166856.941556:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1153 00000100:00100000:2.0:1762166856.941570:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765444472704:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166856.941604:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8bd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.941618:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e6e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91729 expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.941635:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166856.941637:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166856.941640:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8bd lrc: 4/1,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.941672:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e6e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91729 expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.941686:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e6e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91729 expref: 17 pid: 26444 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166856.941699:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451983232:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166856.941784:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee248001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166856.943145:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451983232:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166856.943170:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8bd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166856.943283:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166856.943339:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444472832 00000100:00100000:1.0:1762166856.943350:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444472832 00010000:00010000:1.0:1762166856.943398:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e6e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91729 expref: 18 pid: 26444 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166856.943453:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 764 00000100:00100000:1.0:1762166856.943467:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444472832:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166856.943498:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166856.943524:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e6e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91729 expref: 18 pid: 26444 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.943539:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e6e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91729 expref: 18 pid: 26444 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.943568:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e6e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91729 expref: 18 pid: 26444 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1762166856.943584:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166856.943587:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166856.943592:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.943602:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8bd lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166856.943634:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166856.943652:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.943664:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.943704:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166856.943706:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444472832:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 241us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166856.943737:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 764 00010000:00010000:2.0:1762166856.943755:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.943818:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.943826:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166856.943832:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.943841:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.943858:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166856.943865:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166856.943956:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765444472704:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2386us (2500us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.943970:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1153 00000100:00100000:3.0:1762166856.945678:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.945727:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444472960 00000100:00100000:2.0:1762166856.945745:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444472960 00000100:00100000:2.0:1762166856.945809:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1154 00000100:00100000:2.0:1762166856.945818:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2358:x1847765444472960:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166856.945844:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166856.945859:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e8c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f917d8 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166856.945878:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x88:0x0] initial LVB size: 0, mtime: 0x69088847, atime: 0x69088847, ctime: 0x69088849, blocks: 0x1 00010000:00010000:2.0:1762166856.945892:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.945893:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166856.945899:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e8c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917d8 expref: 17 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.945910:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e8c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917d8 expref: 17 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166856.945918:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2c00, rc 0) 00000100:00100000:2.0:1762166856.945955:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765444472960:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 138us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.945961:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1154 00000100:00100000:1.0:1762166856.983715:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.983807:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444473088 00000100:00100000:2.0:1762166856.983817:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444473088 00000100:00100000:2.0:1762166856.983875:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 300 00000100:00100000:2.0:1762166856.983887:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49254:x1847765444473088:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:0.0:1762166856.995892:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934896 is committed 00000020:00080000:0.0:1762166856.995927:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee3606c9b40 refcount 2 committed 0 result 0 batchid 4294969120 00000020:00080000:0.0:1762166856.995931:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee34368f100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3606c9600 00000020:00080000:0.0:1762166856.995934:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee34368f700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee246eb8c00 00000020:00080000:0.0:1762166856.995950:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969119 batchid updated 00000001:00080000:0.0:1762166856.995957:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934897 is committed 00000020:00080000:2.0:1762166856.995974:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969120 committed batchid 4294969119 00000100:00100000:3.0:1762166856.996067:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49254:x1847765444473088:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 12178us (12353us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166856.996080:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 300 00000020:00080000:2.0:1762166856.996147:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969119 00000100:00100000:3.0:1762166856.997456:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166856.997517:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444473216 00000100:00100000:2.0:1762166856.997525:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444473216 00000100:00100000:2.0:1762166856.997575:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1155 00000100:00100000:2.0:1762166856.997584:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765444473216:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:2.0:1762166856.997688:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765444473216:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 105us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166856.997694:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1155 00000100:00100000:0.0:1762166857.004913:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.004966:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444473344 00000100:00100000:2.0:1762166857.004975:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444473344 00000100:00100000:2.0:1762166857.005018:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1156 00000100:00100000:2.0:1762166857.005029:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444473344:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166857.005071:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8cb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.005084:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.005085:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.005089:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8cb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.005099:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8cb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.005122:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8cb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.005127:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.005133:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.005137:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166857.005150:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.005156:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.005166:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.005170:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.005242:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444473344:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 208us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.005254:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1156 00000100:00100000:1.0:1762166857.006394:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.006591:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444473600 00000100:00100000:3.0:1762166857.006597:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444473600 00000100:00100000:3.0:1762166857.006640:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 301 00000100:00100000:3.0:1762166857.006650:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49254:x1847765444473600:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166857.006693:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.006720:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9e88c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917b5 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.006733:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:3.0:1762166857.006743:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166857.006799:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e8d2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.006811:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e8d2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.006820:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e8d2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:3.0:1762166857.006965:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000544bdf55 reply state 000000001db4a37c transno 8589934898 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e8d2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166857.006974:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166857.007051:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49254:x1847765444473600:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 403us (660us total) trans 8589934898 rc 0/0 00000100:00100000:3.0:1762166857.007056:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 301 00010000:00010000:0.0:1762166857.007673:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e8d2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.007682:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e8d2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.007688:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e8d2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.007700:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.007704:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e8d2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.007711:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e8d2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.007720:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff9ee363960700) 00010000:00010000:0.0:1762166857.007723:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166857.007726:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e8d2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.007732:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e8d2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166857.007879:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.007914:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444473728 00000100:00100000:3.0:1762166857.007918:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444473728 00000100:00100000:3.0:1762166857.007977:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 302 00000100:00100000:3.0:1762166857.007985:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49254:x1847765444473728:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166857.007998:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.008010:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e8d9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f917df expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.008053:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e8d9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917df expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.008062:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e8d9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917df expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.008072:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:3.0:1762166857.008074:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166857.008076:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216cc00, rc 0) 00000100:00100000:3.0:1762166857.008100:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49254:x1847765444473728:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 117us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.008104:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 302 00000100:00100000:3.0:1762166857.009127:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.009159:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444473856 00000100:00100000:2.0:1762166857.009164:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444473856 00000100:00100000:2.0:1762166857.009195:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1157 00000100:00100000:2.0:1762166857.009201:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:49254:x1847765444473856:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.009210:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.009220:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e8e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f917e6 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.009236:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e893 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917bc expref: 20 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.009242:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.009251:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.009254:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e8e0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917e6 expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.009276:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e893 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917bc expref: 20 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.009285:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e893 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917bc expref: 20 pid: 26444 timeout: 577 lvb_type: 1 00000100:00100000:2.0:1762166857.009295:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451983360:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.009347:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee248001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.010162:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451983360:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.010184:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e8e0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917e6 expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.010195:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2600, rc 0) 00000100:00100000:2.0:1762166857.010228:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:49254:x1847765444473856:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1026us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.010235:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1157 00000100:00100000:3.0:1762166857.010299:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.010353:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444473984 00000100:00100000:2.0:1762166857.010358:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444473984 00010000:00010000:2.0:1762166857.010376:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e893 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917bc expref: 20 pid: 26444 timeout: 577 lvb_type: 1 00000100:00100000:2.0:1762166857.010411:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 765 00000100:00100000:2.0:1762166857.010419:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444473984:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.010452:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.010472:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e893 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917bc expref: 20 pid: 26444 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166857.010483:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e893 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917bc expref: 20 pid: 26444 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166857.010500:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e893 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917bc expref: 20 pid: 26444 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166857.010511:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.010513:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.010518:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e8e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917e6 expref: 19 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.010527:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e8e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917e6 expref: 19 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.010551:0:5742:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e8e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917e6 expref: 19 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.010562:0:5742:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765451983488:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762166857.010609:0:5742:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee248001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.011391:0:5742:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765451983488:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762166857.011405:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166857.011451:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765444473984:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1032us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.011468:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 765 00000100:00100000:3.0:1762166857.011507:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.011553:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444474112 00000100:00100000:2.0:1762166857.011559:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444474112 00000100:00100000:2.0:1762166857.011601:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1158 00000100:00100000:2.0:1762166857.011610:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765444474112:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166857.011860:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x89:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166857.011864:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x89:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:2.0:1762166857.011867:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x89:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:2.0:1762166857.011869:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x89:0x0] updating lvb ctime from disk: 0 -> 1762166857 00002000:00010000:2.0:1762166857.011871:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x89:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166857.011906:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444474112:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 297us (401us total) trans 21474836784 rc 0/0 00000100:00100000:2.0:1762166857.011914:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1158 00000100:00100000:0.0:1762166857.012900:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.012947:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444474368 00000100:00100000:3.0:1762166857.012953:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444474368 00000100:00100000:3.0:1762166857.013005:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 303 00000100:00100000:3.0:1762166857.013016:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49254:x1847765444474368:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166857.013052:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.013067:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9e877 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917a7 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.013079:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:3.0:1762166857.013082:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166857.013107:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e8e7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.013117:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e8e7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.013122:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e8e7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:3.0:1762166857.013196:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000026aa6c29 reply state 000000003e18c74e transno 8589934899 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e8e7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166857.013202:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166857.013261:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49254:x1847765444474368:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 249us (364us total) trans 8589934899 rc 0/0 00000100:00100000:3.0:1762166857.013266:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 303 00010000:00010000:2.0:1762166857.013867:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e8e7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.013874:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e8e7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.013878:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e8e7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.013882:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.013885:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e8e7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.013889:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e8e7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.013904:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166857.013906:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.013909:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e8e7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.013913:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e8e7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166857.014035:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.014076:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444474496 00000100:00100000:2.0:1762166857.014082:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444474496 00000100:00100000:2.0:1762166857.014118:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1159 00000100:00100000:2.0:1762166857.014128:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:49254:x1847765444474496:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.014136:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.014146:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8ee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f917ed expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.014162:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e8c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917d8 expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.014167:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.014169:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.014171:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8ee lrc: 4/0,0 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917ed expref: 18 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.014192:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e8c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917d8 expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.014200:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e8c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917d8 expref: 18 pid: 26444 timeout: 577 lvb_type: 1 00000100:00100000:2.0:1762166857.014215:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451983616:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.014271:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee248001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.015024:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451983616:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.015040:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8ee lrc: 3/0,0 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917ed expref: 18 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.015049:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3200, rc 0) 00000100:00100000:2.0:1762166857.015078:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:49254:x1847765444474496:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 952us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.015088:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1159 00000100:00100000:1.0:1762166857.015288:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.015323:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444474624 00000100:00100000:2.0:1762166857.015327:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444474624 00010000:00010000:2.0:1762166857.015342:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e8c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917d8 expref: 18 pid: 26444 timeout: 577 lvb_type: 1 00000100:00100000:2.0:1762166857.015367:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 766 00000100:00100000:2.0:1762166857.015374:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444474624:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.015383:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.015401:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e8c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917d8 expref: 18 pid: 26444 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166857.015411:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e8c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917d8 expref: 18 pid: 26444 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166857.015444:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e8c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917d8 expref: 18 pid: 26444 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166857.015451:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.015452:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.015455:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917ed expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.015462:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917ed expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.015478:0:5742:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917ed expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.015485:0:5742:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5742:1847765451983744:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762166857.015518:0:5742:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee248001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.016182:0:5742:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5742:1847765451983744:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762166857.016192:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166857.016224:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444474624:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 850us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.016231:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 766 00000100:00100000:3.0:1762166857.016339:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.016367:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444474752 00000100:00100000:2.0:1762166857.016370:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444474752 00000100:00100000:2.0:1762166857.016396:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1160 00000100:00100000:2.0:1762166857.016403:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444474752:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166857.016533:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x88:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166857.016536:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x88:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:2.0:1762166857.016537:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x88:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:2.0:1762166857.016539:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x88:0x0] updating lvb ctime from disk: 1762166857 -> 1762166857 00002000:00010000:2.0:1762166857.016540:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x88:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166857.016567:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444474752:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 164us (228us total) trans 17179869455 rc 0/0 00000100:00100000:2.0:1762166857.016573:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1160 00000100:00100000:1.0:1762166857.017362:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.017417:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444475008 00000100:00100000:0.0:1762166857.017433:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444475008 00000100:00100000:0.0:1762166857.017464:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 120 00000100:00100000:0.0:1762166857.017471:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f4edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49254:x1847765444475008:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166857.017521:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e8a1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917c3 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.017548:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e8f5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.017557:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e7cf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9176f expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.017570:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e81c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91784 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.017575:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e8f5 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.017591:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e81c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91784 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.017599:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e81c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91784 expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166857.017608:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc32a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451983872:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.017657:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e7cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9176f expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.017666:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e7cf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9176f expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166857.017675:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451984000:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.017696:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eefd80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166857.018374:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc32a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451983872:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166857.018573:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.018592:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451984000:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166857.018601:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444475264 00000100:00100000:3.0:1762166857.018606:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444475264 00010000:00010000:0.0:1762166857.018613:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e8f5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166857.018656:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 121 00000100:00100000:2.0:1762166857.018665:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49238:x1847765444475264:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1762166857.018722:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.018787:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444475392 00000100:00100000:3.0:1762166857.018791:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444475392 00010000:00010000:3.0:1762166857.018811:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e7cf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9176f expref: 30 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166857.018829:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49238:x1847765444475264:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 163us (258us total) trans 8589934900 rc 0/0 00000100:00100000:2.0:1762166857.018837:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 121 00000100:00100000:3.0:1762166857.018844:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 767 00000100:00100000:3.0:1762166857.018856:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444475392:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166857.018867:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.018871:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e7cf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9176f expref: 29 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166857.018877:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e7cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9176f expref: 29 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166857.018892:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9e7cf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9176f expref: 29 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166857.018903:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:3.0:1762166857.018906:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e8f5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166857.018911:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e8f5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166857.018915:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166857.018930:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444475392:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 80us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.018935:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 767 00000100:00100000:1.0:1762166857.019600:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.019624:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444475520 00000100:00100000:3.0:1762166857.019629:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444475520 00010000:00010000:3.0:1762166857.019645:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e81c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91784 expref: 28 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:3.0:1762166857.019685:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 768 00000100:00100000:3.0:1762166857.019693:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444475520:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166857.019701:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.019706:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e81c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91784 expref: 28 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166857.019716:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e81c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91784 expref: 28 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166857.019730:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9e81c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91784 expref: 28 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166857.019740:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:3.0:1762166857.019744:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e8f5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166857.019750:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e8f5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166857.019756:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e8f5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166857.019805:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166857.019838:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444475520:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 144us (238us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166857.019839:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e8f5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166857.019851:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 768 00010000:00010000:0.0:1762166857.019862:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e8f5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.019876:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e8fc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.019887:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e8d9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917df expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.019893:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e8fc lrc: 4/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.019913:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e8d9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917df expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.019925:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e8d9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917df expref: 26 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166857.019934:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451984128:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.019977:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eefd80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.020725:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451984128:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.020736:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e8fc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166857.020917:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.020956:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444475648 00000100:00100000:3.0:1762166857.020961:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444475648 00010000:00010000:3.0:1762166857.021023:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e8d9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917df expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:3.0:1762166857.021050:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 769 00000100:00100000:3.0:1762166857.021055:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444475648:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166857.021061:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.021065:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e8d9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917df expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166857.021073:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e8d9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917df expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166857.021084:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e8d9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917df expref: 27 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166857.021092:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:3.0:1762166857.021094:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e8fc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166857.021099:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e8fc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166857.021103:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e8fc lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166857.021115:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166857.021140:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e8fc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166857.021141:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444475648:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 83us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.021156:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 769 00010000:00010000:0.0:1762166857.021156:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e8fc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166857.021492:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451984256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166857.021523:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166857.021545:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eef240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.021555:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451984256 00000100:00100000:3.0:1762166857.021564:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451984256 00000100:00080000:2.0:1762166857.021602:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166857.021606:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1762166857.021614:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30821:x1847765451984256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166857.021665:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30821:x1847765451984256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 54us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.021672:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1762166857.021692:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451984256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166857.021724:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451984384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166857.021746:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166857.021786:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451984384 00000100:00100000:0.0:1762166857.021790:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eef240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.021791:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451984384 00000100:00080000:2.0:1762166857.021826:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166857.021831:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1762166857.021837:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30821:x1847765451984384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166857.021882:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30821:x1847765451984384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 46us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.021887:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1762166857.021896:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451984384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1762166857.022021:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934901 00000100:00100000:0.0:1762166857.022060:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451984512:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166857.022079:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166857.022097:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.022107:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451984512 00000100:00100000:3.0:1762166857.022111:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451984512 00000100:00100000:3.0:1762166857.022130:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1762166857.022135:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30821:x1847765451984512:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166857.022231:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30821:x1847765451984512:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 96us (151us total) trans 21474836785 rc 0/0 00000100:00100000:3.0:1762166857.022236:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1762166857.022259:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451984512:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1762166857.022308:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934902 00010000:00010000:0.0:1762166857.022327:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e8fc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.022335:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e8fc lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.022341:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e8fc lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.022346:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.022349:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e8fc lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.022365:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e8fc lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.022374:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:0.0:1762166857.022376:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166857.022380:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e8fc lrc: 2/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.022385:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e8fc lrc: 0/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.022399:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e8f5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.022404:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e8f5 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.022409:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e8f5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.022413:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.022416:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e8f5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.022432:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e8f5 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.022438:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:0.0:1762166857.022440:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166857.022443:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e8f5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.022448:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e8f5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.022462:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:0.0:1762166857.022464:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166857.022468:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e8a1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917c3 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.022530:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f4edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49254:x1847765444475008:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 5059us (5168us total) trans 8589934903 rc 0/0 00000100:00100000:0.0:1762166857.022538:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 120 00000020:00080000:0.0:1762166857.022541:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166857.023261:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.023294:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444475776 00000100:00100000:3.0:1762166857.023299:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444475776 00000100:00100000:3.0:1762166857.023323:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 304 00000100:00100000:3.0:1762166857.023329:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49254:x1847765444475776:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166857.023340:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.023350:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9e903 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f917f4 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.023396:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9e903 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917f4 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.023408:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9e903 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917f4 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.023434:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960800) 00010000:00010000:3.0:1762166857.023438:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166857.023440:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216c600, rc 0) 00000100:00100000:3.0:1762166857.023471:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49254:x1847765444475776:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 142us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.023478:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 304 00000100:00100000:1.0:1762166857.024398:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.024445:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444476032 00000100:00100000:0.0:1762166857.024449:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444476032 00000100:00100000:0.0:1762166857.024480:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 122 00000100:00100000:0.0:1762166857.024485:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49254:x1847765444476032:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166857.024606:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49254:x1847765444476032:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 119us (206us total) trans 8589934904 rc 0/0 00000100:00100000:0.0:1762166857.024613:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 122 00000100:00100000:1.0:1762166857.025239:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.025278:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444476288 00000100:00100000:0.0:1762166857.025283:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444476288 00000100:00100000:0.0:1762166857.025311:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 123 00000100:00100000:0.0:1762166857.025318:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49254:x1847765444476288:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:0.0:1762166857.025485:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x31:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166857.025562:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e90a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.025573:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e90a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.025593:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e90a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.025600:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e90a lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.025606:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e90a lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.025611:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e90a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.025629:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166857.025666:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166857.025674:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e90a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166857.025682:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166857.025686:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e90a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166857.025693:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49254:x1847765444476288:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 374us (454us total) trans 8589934905 rc 0/0 00010000:00010000:2.0:1762166857.025697:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e90a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166857.025704:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 123 00010000:00010000:2.0:1762166857.025715:0:32135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166857.025720:0:32135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166857.025742:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e90a lrc: 1/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166857.025749:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9e90a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166857.025793:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166857.025796:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166857.025800:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166857.033148:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.033198:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444476416 00000100:00100000:3.0:1762166857.033208:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444476416 00000100:00100000:3.0:1762166857.033262:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 305 00000100:00100000:3.0:1762166857.033273:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49256:x1847765444476416:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:3.0:1762166857.033296:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.033312:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e911 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f917fb expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.033357:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e918 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033367:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e918 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033374:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e918 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033399:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e91f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033403:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e91f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033407:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e91f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033504:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e926 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033509:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e926 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033513:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e926 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166857.033535:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:3.0:1762166857.033538:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166857.033554:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e926 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033561:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e926 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033566:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e918 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033570:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e918 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033573:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e918 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033584:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166857.033586:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e918 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033591:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e918 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033599:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:3.0:1762166857.033601:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166857.033604:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e918 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033608:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e918 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033615:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e91f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033618:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e91f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033621:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e91f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033624:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166857.033626:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e91f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033629:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e91f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033632:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee363960d00) 00010000:00010000:3.0:1762166857.033636:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166857.033638:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e91f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033641:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e91f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.033661:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e911 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917fb expref: 32 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.033669:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e926 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917fb expref: 31 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.033673:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960800) 00010000:00010000:3.0:1762166857.033675:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166857.033676:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216c400, rc 0) 00000100:00100000:3.0:1762166857.033720:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49256:x1847765444476416:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 451us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.033724:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 305 00000100:00100000:1.0:1762166857.047037:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.047093:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444476544 00000100:00100000:3.0:1762166857.047103:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444476544 00000100:00100000:3.0:1762166857.047161:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 306 00000100:00100000:3.0:1762166857.047172:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49260:x1847765444476544:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:3.0:1762166857.047250:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e92d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047271:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e92d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047283:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e92d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047306:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e934 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047323:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e934 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047331:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e934 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047453:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e93b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047461:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e93b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047468:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e93b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166857.047499:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:3.0:1762166857.047503:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166857.047514:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e93b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047524:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e92d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047530:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e92d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047537:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e92d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047542:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166857.047546:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e92d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047560:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e92d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047571:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:3.0:1762166857.047574:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166857.047578:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e92d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047584:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e92d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047599:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e934 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047605:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e934 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047611:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e934 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047615:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166857.047618:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e934 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047624:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e934 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047630:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee363960d00) 00010000:00010000:3.0:1762166857.047632:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166857.047635:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e934 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047640:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e934 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047660:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e93b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047665:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e93b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047668:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e93b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047671:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166857.047673:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e93b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047676:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e93b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047681:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960800) 00010000:00010000:3.0:1762166857.047682:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166857.047683:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e93b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.047686:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e93b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166857.047743:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49260:x1847765444476544:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 574us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.047749:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 306 00000100:00100000:1.0:1762166857.056530:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.056591:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444476800 00000100:00100000:3.0:1762166857.056603:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444476800 00000100:00100000:3.0:1762166857.056670:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 307 00000100:00100000:3.0:1762166857.056683:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49262:x1847765444476800:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166857.056727:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.056748:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e942 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91802 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.056865:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e949 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.056878:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e949 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.056888:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e949 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166857.056897:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:3.0:1762166857.057007:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9e942 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91802 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.057022:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e949 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91802 expref: 33 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.057028:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960800) 00010000:00010000:3.0:1762166857.057030:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166857.057032:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216d400, rc 0) 00000100:00100000:3.0:1762166857.057077:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49262:x1847765444476800:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 399us (558us total) trans 8589934906 rc 0/0 00000100:00100000:3.0:1762166857.057082:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 307 00000100:00100000:1.0:1762166857.058927:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.058995:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444477056 00000100:00100000:3.0:1762166857.059003:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444477056 00000100:00100000:3.0:1762166857.059052:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 308 00000100:00100000:3.0:1762166857.059062:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49262:x1847765444477056:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166857.059091:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.059106:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e957 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91809 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.059180:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9e95e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.059194:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e926 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917fb expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.059203:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9e95e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.059236:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e926 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917fb expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.059250:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e926 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917fb expref: 34 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:3.0:1762166857.059265:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f278e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451984640:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166857.059338:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.060134:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f278e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451984640:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166857.060153:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9e95e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166857.060295:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.060319:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444477184 00000100:00100000:3.0:1762166857.060323:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444477184 00010000:00010000:3.0:1762166857.060383:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e926 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917fb expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:3.0:1762166857.060434:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 770 00000100:00100000:3.0:1762166857.060440:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444477184:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166857.060449:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.060454:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e926 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917fb expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166857.060463:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e926 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917fb expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166857.060481:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9e926 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917fb expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166857.060495:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960800) 00010000:00010000:3.0:1762166857.060499:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9e95e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.060507:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9e95e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.060513:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9e95e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.060541:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166857.060593:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765444477184:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 148us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.060601:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 770 00010000:00010000:2.0:1762166857.060618:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9e95e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.060633:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9e95e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166857.060655:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166857.060890:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9e957 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91809 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.060916:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9e95e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91809 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.060927:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960800) 00010000:00010000:2.0:1762166857.060929:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166857.060933:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216d000, rc 0) 00000100:00100000:2.0:1762166857.061009:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49262:x1847765444477056:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1948us (2086us total) trans 8589934907 rc 0/0 00000100:00100000:2.0:1762166857.061017:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 308 00000100:00100000:1.0:1762166857.062329:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.062390:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444477312 00000100:00100000:0.0:1762166857.062398:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444477312 00000100:00100000:0.0:1762166857.062450:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 124 00000100:00100000:0.0:1762166857.062460:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49262:x1847765444477312:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:0.0:1762166857.062576:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49262:x1847765444477312:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 118us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.062584:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 124 00000100:00100000:1.0:1762166857.063652:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.063743:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444477568 00000100:00100000:0.0:1762166857.063748:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444477568 00000100:00100000:0.0:1762166857.063805:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 125 00000100:00100000:0.0:1762166857.063815:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49262:x1847765444477568:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166857.064000:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49262:x1847765444477568:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 186us (352us total) trans 8589934908 rc 0/0 00000100:00100000:0.0:1762166857.064020:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 125 00000100:00100000:1.0:1762166857.065230:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.065295:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444477824 00000100:00100000:2.0:1762166857.065307:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444477824 00000100:00100000:2.0:1762166857.065365:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 309 00000100:00100000:2.0:1762166857.065376:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49262:x1847765444477824:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.065416:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.065429:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762166857.065462:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9e95e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91809 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.065494:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9e949 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91802 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.065509:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960800) 00010000:00010000:2.0:1762166857.065514:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.065530:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e96c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91810 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.065628:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e973 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.065642:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e973 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.065651:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e973 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166857.065662:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166857.065831:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e96c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91810 expref: 36 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.065847:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e973 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91810 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.065854:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960800) 00010000:00010000:2.0:1762166857.065862:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166857.065865:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2e00, rc 0) 00000100:00100000:2.0:1762166857.065922:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49262:x1847765444477824:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 548us (700us total) trans 8589934909 rc 0/0 00000100:00100000:2.0:1762166857.065929:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 309 00000100:00100000:1.0:1762166857.067094:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.067176:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444478080 00000100:00100000:0.0:1762166857.067184:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444478080 00000100:00100000:0.0:1762166857.067234:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 126 00000100:00100000:0.0:1762166857.067246:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f4ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49262:x1847765444478080:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166857.067299:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e973 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91810 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.067327:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e981 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.067339:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9e903 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917f4 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.067347:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e981 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.067389:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9e903 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917f4 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.067404:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9e903 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917f4 expref: 35 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166857.067419:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451984768:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.067506:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3471576c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.068456:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451984768:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.068476:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e981 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166857.068742:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.068873:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444478208 00000100:00100000:3.0:1762166857.068887:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444478208 00010000:00010000:3.0:1762166857.068950:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9e903 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917f4 expref: 36 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:3.0:1762166857.068990:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 771 00000100:00100000:3.0:1762166857.069000:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765444478208:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166857.069012:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.069017:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9e903 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917f4 expref: 36 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166857.069026:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9e903 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917f4 expref: 36 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166857.069043:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9e903 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917f4 expref: 36 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:3.0:1762166857.069056:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960800) 00010000:00010000:3.0:1762166857.069059:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e981 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166857.069066:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e981 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166857.069070:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e981 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166857.069093:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166857.069114:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e981 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.069125:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e981 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166857.069139:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444478208:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 141us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.069145:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 771 00010000:00010000:0.0:1762166857.069418:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e981 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.069443:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e981 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.069450:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e981 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.069456:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.069461:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e981 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.069469:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e981 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.069481:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960800) 00010000:00010000:0.0:1762166857.069484:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166857.069488:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e981 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.069494:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e981 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.069506:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960800) 00010000:00010000:0.0:1762166857.069508:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166857.069521:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e973 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91810 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.069667:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f4ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49262:x1847765444478080:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2423us (2577us total) trans 8589934910 rc -22/-22 00000100:00100000:0.0:1762166857.069676:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 126 00000100:00100000:1.0:1762166857.070588:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.070640:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444478336 00000100:00100000:2.0:1762166857.070649:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444478336 00000100:00100000:2.0:1762166857.070705:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 310 00000100:00100000:2.0:1762166857.070717:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49262:x1847765444478336:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.070741:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.070798:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e988 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91817 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.070851:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e988 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91817 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.070860:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e988 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91817 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.070873:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01700) 00010000:00010000:2.0:1762166857.070875:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166857.070877:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2000, rc 0) 00000100:00100000:2.0:1762166857.070914:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49262:x1847765444478336:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 200us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.070919:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 310 00000100:00100000:1.0:1762166857.072376:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.072429:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444478592 00000100:00100000:2.0:1762166857.072435:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444478592 00000100:00100000:2.0:1762166857.072467:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 311 00000100:00100000:2.0:1762166857.072491:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49262:x1847765444478592:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.072505:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.072517:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e98f lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9181e expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.073062:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e996 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.073072:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e996 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.073079:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e996 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166857.073089:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x32:0x0]: returning size 0 00010000:00010000:2.0:1762166857.073127:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e98f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9181e expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.073145:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e996 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9181e expref: 37 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.073153:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x32:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166857.073157:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166857.073159:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2200, rc 0) 00000100:00100000:2.0:1762166857.073212:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49262:x1847765444478592:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 724us (837us total) trans 8589934911 rc 0/0 00000100:00100000:2.0:1762166857.073220:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 311 00000100:00100000:1.0:1762166857.074679:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.074727:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444478848 00000100:00100000:2.0:1762166857.074738:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444478848 00000100:00100000:1.0:1762166857.074809:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 312 00000100:00100000:1.0:1762166857.074824:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49262:x1847765444478848:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.074846:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.074862:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e9a4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91825 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.074970:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9e9ab lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.074983:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9e9ab lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.074993:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9e9ab lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.075005:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166857.075110:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9e9a4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91825 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.075127:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9e9ab lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91825 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.075135:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01700) 00010000:00010000:1.0:1762166857.075138:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166857.075141:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158000, rc 0) 00000100:00100000:1.0:1762166857.075190:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49262:x1847765444478848:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 373us (517us total) trans 8589934912 rc 0/0 00000100:00100000:1.0:1762166857.075195:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 312 00000100:00100000:1.0:1762166857.076446:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.076541:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444479104 00000100:00100000:0.0:1762166857.076548:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444479104 00000100:00100000:0.0:1762166857.076595:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 127 00000100:00100000:0.0:1762166857.076605:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49262:x1847765444479104:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166857.076669:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9e9ab lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91825 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.076695:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e9b9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.076703:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e988 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91817 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.076710:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e9b9 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.076740:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e988 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91817 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.076749:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e988 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91817 expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166857.076806:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451984896:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.076886:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3471576c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.077973:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451984896:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.078003:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e9b9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166857.078005:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.078067:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444479232 00000100:00100000:2.0:1762166857.078082:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444479232 00010000:00010000:2.0:1762166857.078118:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e988 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91817 expref: 40 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166857.078159:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 772 00000100:00100000:2.0:1762166857.078166:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f278e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2360:x1847765444479232:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.078183:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.078189:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e988 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91817 expref: 40 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166857.078203:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e988 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91817 expref: 40 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166857.078221:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e988 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91817 expref: 40 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166857.078232:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01700) 00010000:00010000:2.0:1762166857.078236:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e9b9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166857.078243:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e9b9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166857.078248:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e9b9 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166857.078268:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166857.078299:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e9b9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.078311:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e9b9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166857.078318:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f278e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444479232:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 149us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.078342:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 772 00010000:00010000:0.0:1762166857.078353:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e9c0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.078366:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e996 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9181e expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.078374:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e9c0 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.078403:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e996 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9181e expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.078417:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e996 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9181e expref: 38 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1762166857.078444:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451985024:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.078501:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3471576c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.079675:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451985024:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.079690:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e9c0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166857.079841:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.079887:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444479360 00000100:00100000:2.0:1762166857.079897:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444479360 00010000:00010000:2.0:1762166857.079924:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e996 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9181e expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166857.079956:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 773 00000100:00100000:2.0:1762166857.079965:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444479360:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.079977:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.079983:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e996 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9181e expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166857.079995:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e996 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9181e expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166857.080010:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e996 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9181e expref: 39 pid: 30817 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166857.080024:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x32:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166857.080028:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e9c0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166857.080035:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e9c0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166857.080039:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e9c0 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166857.080057:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166857.080096:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e9c0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x32:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166857.080098:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2361:x1847765444479360:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 134us (258us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166857.080120:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e9c0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x32:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166857.080134:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 773 00000100:00100000:0.0:1762166857.080639:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451985152:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166857.080704:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166857.080743:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee35011da80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.080798:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451985152 00000100:00100000:3.0:1762166857.080808:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451985152 00000100:00100000:3.0:1762166857.080854:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1762166857.080864:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30821:x1847765451985152:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166857.080938:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30821:x1847765451985152:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 77us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.080946:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1762166857.080953:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451985152:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1762166857.080996:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934913 00000001:00080000:0.0:1762166857.081044:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934914 00010000:00010000:0.0:1762166857.081059:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e9c0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x32:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.081065:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e9c0 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x32:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.081070:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e9c0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x32:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.081074:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.081078:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e9c0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x32:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.081085:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e9c0 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x32:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.081096:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x32:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:0.0:1762166857.081098:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166857.081109:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e9c0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x32:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.081115:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9e9c0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x32:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.081138:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e9b9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.081144:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e9b9 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.081150:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e9b9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.081155:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.081157:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e9b9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.081163:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e9b9 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.081171:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01700) 00010000:00010000:0.0:1762166857.081173:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166857.081176:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e9b9 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.081182:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9e9b9 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.081194:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01700) 00010000:00010000:0.0:1762166857.081196:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166857.081202:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9e9ab lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91825 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.081299:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49262:x1847765444479104:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 4696us (4856us total) trans 8589934915 rc 0/0 00000100:00100000:0.0:1762166857.081308:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 127 00000020:00080000:0.0:1762166857.081313:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166857.082218:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.082278:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444479488 00000100:00100000:2.0:1762166857.082286:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444479488 00000100:00100000:2.0:1762166857.082328:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 313 00000100:00100000:2.0:1762166857.082336:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49262:x1847765444479488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.082356:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.082375:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e9c7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9182c expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.082418:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e9c7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9182c expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.082440:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e9c7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9182c expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.082453:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:2.0:1762166857.082455:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166857.082457:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2c00, rc 0) 00000100:00100000:2.0:1762166857.082503:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49262:x1847765444479488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 169us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.082507:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 313 00000100:00100000:3.0:1762166857.083869:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.083923:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444479744 00000100:00100000:0.0:1762166857.083934:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444479744 00000100:00100000:0.0:1762166857.083996:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 128 00000100:00100000:0.0:1762166857.084007:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49262:x1847765444479744:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:0.0:1762166857.084496:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x32:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1762166857.084607:0:30821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].14, 64 off9280 00000001:00080000:0.0:1762166857.084619:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934916 00010000:00010000:0.0:1762166857.084661:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e9ce lrc: 3/0,1 mode: --/PW res: [0x200000404:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.084675:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e9ce lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.084684:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e9ce lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.084691:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e9ce lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.084695:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e9ce lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.084699:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e9ce lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.084722:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166857.084812:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166857.084820:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e9ce lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166857.084828:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166857.084832:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e9ce lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166857.084839:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e9ce lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166857.084854:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x32:0x0].0x0 (ffff9ee34bdb4400) 00010000:00010000:3.0:1762166857.084857:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166857.084861:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e9ce lrc: 1/0,0 mode: --/PW res: [0x200000404:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166857.084866:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9e9ce lrc: 0/0,0 mode: --/PW res: [0x200000404:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166857.084881:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166857.084883:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166857.084885:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166857.084897:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49262:x1847765444479744:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 891us (1032us total) trans 8589934917 rc 0/0 00000100:00100000:0.0:1762166857.084907:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 128 00000020:00080000:0.0:1762166857.084913:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166857.085890:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.085923:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444480000 00000100:00100000:0.0:1762166857.085931:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444480000 00000100:00100000:0.0:1762166857.085974:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 129 00000100:00100000:0.0:1762166857.085983:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49262:x1847765444480000:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166857.086198:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49262:x1847765444480000:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 216us (309us total) trans 8589934918 rc 0/0 00000100:00100000:0.0:1762166857.086207:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 129 00000100:00100000:1.0:1762166857.096294:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.096451:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444480128 00000100:00100000:2.0:1762166857.096462:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444480128 00000100:00100000:2.0:1762166857.096523:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 314 00000100:00100000:2.0:1762166857.096532:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49264:x1847765444480128:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166857.096574:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.096622:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e9d5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91833 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.096693:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e9dc lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.096707:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e9dc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.096717:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e9dc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.096727:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e9e3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.096732:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.096736:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.096899:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e9ea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.096907:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e9ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.096913:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e9ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.096950:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166857.096954:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166857.096975:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e9ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.096988:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e9ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.097003:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e9dc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.097009:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e9dc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.097015:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e9dc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.097021:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.097025:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e9dc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.097034:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e9dc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.097046:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166857.097050:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.097054:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e9dc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.097059:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9e9dc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.097071:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.097075:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e9e3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.097081:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e9e3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.097086:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.097096:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e9e3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.097102:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e9e3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.097110:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01400) 00010000:00010000:2.0:1762166857.097113:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.097116:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e9e3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.097121:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9e9e3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.097158:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e9d5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91833 expref: 45 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.097173:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e9ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91833 expref: 44 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.097180:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:2.0:1762166857.097182:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166857.097185:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2e00, rc 0) 00000100:00100000:2.0:1762166857.097264:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49264:x1847765444480128:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 728us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.097273:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 314 00000100:00100000:3.0:1762166857.099031:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.099091:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444480256 00000100:00100000:2.0:1762166857.099101:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444480256 00000100:00100000:2.0:1762166857.099169:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1161 00000100:00100000:2.0:1762166857.099180:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444480256:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166857.099207:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.099222:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e9f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9183a expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.099279:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451985280:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166857.099365:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee248001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.100451:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451985280:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166857.100486:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e9f1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9183a expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.100508:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e9f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9183a expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.100522:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3000, rc 0) 00000100:00100000:2.0:1762166857.100575:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444480256:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 1397us (1550us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166857.100585:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1161 00000100:00100000:1.0:1762166857.113884:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.113975:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444480384 00000100:00100000:2.0:1762166857.113990:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444480384 00000100:00100000:2.0:1762166857.114050:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 315 00000100:00100000:2.0:1762166857.114062:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49268:x1847765444480384:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166857.114132:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e9f8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114148:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e9f8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114171:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e9f8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114193:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e9ff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114201:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e9ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114208:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e9ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114306:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ea06 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114315:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ea06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114322:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ea06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.114353:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166857.114357:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166857.114368:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ea06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114380:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e9f8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114386:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e9f8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114394:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e9f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114411:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.114415:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e9f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114435:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e9f8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114447:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166857.114450:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.114455:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e9f8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114462:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9e9f8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114475:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e9ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114481:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e9ff lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114486:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e9ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114491:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.114494:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e9ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114499:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e9ff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114506:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01400) 00010000:00010000:2.0:1762166857.114514:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.114518:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e9ff lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114523:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9e9ff lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114539:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ea06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114545:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ea06 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114550:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ea06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114555:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.114558:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ea06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114563:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ea06 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114570:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:2.0:1762166857.114573:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.114576:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ea06 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.114581:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ea06 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166857.114651:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49268:x1847765444480384:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 592us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.114659:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 315 00000100:00100000:3.0:1762166857.124036:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.124106:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444480640 00000100:00100000:2.0:1762166857.124117:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444480640 00000100:00100000:2.0:1762166857.124170:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 316 00000100:00100000:2.0:1762166857.124180:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606ea450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49270:x1847765444480640:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.124200:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.124216:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ea0d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91841 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.124311:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ea14 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.124324:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ea14 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.124335:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ea14 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.124349:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166857.124489:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ea0d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91841 expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.124506:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ea14 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91841 expref: 46 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.124515:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:2.0:1762166857.124518:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166857.124521:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2200, rc 0) 00000100:00100000:2.0:1762166857.124578:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606ea450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49270:x1847765444480640:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 400us (550us total) trans 8589934919 rc 0/0 00000100:00100000:2.0:1762166857.124586:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 316 00000100:00100000:1.0:1762166857.126153:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.126206:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444480768 00000100:00100000:2.0:1762166857.126218:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444480768 00000100:00100000:2.0:1762166857.126260:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1162 00000100:00100000:2.0:1762166857.126269:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444480768:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.126282:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.126296:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ea22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91848 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.126351:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451985408:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166857.126431:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee248001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.127473:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451985408:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166857.127501:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ea22 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91848 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.127520:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ea22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91848 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.127531:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3000, rc 0) 00000100:00100000:2.0:1762166857.127577:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444480768:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1309us (1432us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166857.127585:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1162 00010000:00010000:3.0:1762166857.127837:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166857.129007:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.129054:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444481024 00000100:00100000:2.0:1762166857.129063:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444481024 00000100:00100000:2.0:1762166857.129110:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 317 00000100:00100000:2.0:1762166857.129121:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49270:x1847765444481024:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.129140:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.129166:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ea29 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9184f expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.129252:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ea30 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.129266:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e9ea lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91833 expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.129274:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ea30 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.129305:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e9ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91833 expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.129317:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e9ea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91833 expref: 47 pid: 30818 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166857.129329:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451985536:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.129400:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee248001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.130589:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451985536:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.130611:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ea30 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166857.130728:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.130787:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444481152 00000100:00100000:2.0:1762166857.130793:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444481152 00010000:00010000:2.0:1762166857.130829:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e9ea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91833 expref: 48 pid: 30818 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166857.130860:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 774 00000100:00100000:2.0:1762166857.130869:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f278a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2360:x1847765444481152:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.130893:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.130901:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e9ea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91833 expref: 48 pid: 30818 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166857.130912:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e9ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91833 expref: 48 pid: 30818 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166857.130930:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9e9ea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91833 expref: 48 pid: 30818 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166857.130945:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:2.0:1762166857.130949:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ea30 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.130957:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ea30 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.130962:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ea30 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.130982:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166857.131015:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ea30 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166857.131024:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f278a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:2360:x1847765444481152:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 153us (294us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166857.131028:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ea30 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166857.131036:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 774 00000004:00200000:1.0:1762166857.131042:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166857.131158:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ea29 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9184f expref: 48 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.131173:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ea30 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9184f expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.131179:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:1.0:1762166857.131182:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166857.131183:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3e00, rc 0) 00000100:00100000:1.0:1762166857.131213:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49270:x1847765444481024:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2096us (2211us total) trans 8589934920 rc 0/0 00000100:00100000:1.0:1762166857.131217:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 317 00000100:00100000:3.0:1762166857.132892:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.132963:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444481408 00000100:00100000:1.0:1762166857.132975:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444481408 00000100:00100000:1.0:1762166857.133028:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 318 00000100:00100000:1.0:1762166857.133039:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49270:x1847765444481408:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.133060:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.133077:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ea3e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91856 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.133491:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ea45 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.133513:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ea45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.133520:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ea45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.133527:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x33:0x0]: returning size 0 00010000:00010000:1.0:1762166857.133555:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ea3e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91856 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.133567:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ea45 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91856 expref: 49 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.133574:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x33:0x0].0x0 (ffff9ee34ada3600) 00010000:00010000:1.0:1762166857.133577:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166857.133580:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159a00, rc 0) 00000100:00100000:1.0:1762166857.133637:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49270:x1847765444481408:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 600us (757us total) trans 8589934921 rc 0/0 00000100:00100000:1.0:1762166857.133645:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 318 00000100:00100000:0.0:1762166857.135092:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.135138:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444481664 00000100:00100000:1.0:1762166857.135146:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444481664 00000100:00100000:1.0:1762166857.135187:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 319 00000100:00100000:1.0:1762166857.135196:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49270:x1847765444481664:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.135216:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.135230:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ea53 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9185d expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.135293:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea5a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.135315:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ea45 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91856 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.135322:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea5a lrc: 4/0,1 mode: --/EX res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.135356:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ea45 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91856 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.135368:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ea45 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91856 expref: 50 pid: 30818 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166857.135381:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451985664:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166857.135449:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166857.136401:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451985664:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166857.136434:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea5a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166857.136550:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.136584:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444481792 00000100:00100000:2.0:1762166857.136589:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444481792 00010000:00010000:2.0:1762166857.136608:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ea45 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91856 expref: 51 pid: 30818 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166857.136630:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 775 00000100:00100000:2.0:1762166857.136644:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444481792:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.136653:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.136658:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ea45 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91856 expref: 51 pid: 30818 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166857.136665:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ea45 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91856 expref: 51 pid: 30818 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166857.136677:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ea45 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91856 expref: 51 pid: 30818 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166857.136686:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x33:0x0].0x0 (ffff9ee34ada3600) 00010000:00010000:2.0:1762166857.136689:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea5a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.136694:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea5a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.136698:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea5a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.136714:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166857.136731:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea5a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.136738:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea5a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166857.136744:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2361:x1847765444481792:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 100us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.136748:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 775 00000004:00200000:1.0:1762166857.136750:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x33:0x0]: returning size 0 00000004:00080000:1.0:1762166857.137042:0:30818:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x89:0x0], index 1: 0 00010000:00010000:1.0:1762166857.137146:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea5a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.137154:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea5a lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.137166:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea5a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.137172:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166857.137176:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea5a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.137183:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea5a lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.137191:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x33:0x0].0x0 (ffff9ee34ada3600) 00010000:00010000:1.0:1762166857.137194:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166857.137197:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea5a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.137203:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea5a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.137243:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ea53 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9185d expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.137251:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166857.137253:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166857.137255:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ea53 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9185d expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.137261:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159600, rc 0) 00000100:00100000:1.0:1762166857.137289:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49270:x1847765444481664:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2097us (2202us total) trans 8589934922 rc 301/301 00000100:00100000:1.0:1762166857.137294:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 319 00000100:00100000:0.0:1762166857.138139:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.138182:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444482048 00000100:00100000:1.0:1762166857.138187:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444482048 00000100:00100000:1.0:1762166857.138216:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 130 00000100:00100000:1.0:1762166857.138222:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49270:x1847765444482048:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166857.138373:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49270:x1847765444482048:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 151us (237us total) trans 8589934923 rc 0/0 00000100:00100000:1.0:1762166857.138380:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 130 00000100:00100000:3.0:1762166857.139101:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.139137:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444482176 00000100:00100000:1.0:1762166857.139141:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444482176 00000100:00100000:1.0:1762166857.139171:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 320 00000100:00100000:1.0:1762166857.139179:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49270:x1847765444482176:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.139192:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.139206:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ea68 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91864 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.139251:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9ea6f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.139261:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ea30 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9184f expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.139266:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9ea6f lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.139287:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ea30 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9184f expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.139295:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ea30 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9184f expref: 51 pid: 30818 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1762166857.139314:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451985792:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166857.139365:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3514283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166857.140045:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451985792:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166857.140064:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9ea6f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166857.140372:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.140432:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444482304 00000100:00100000:2.0:1762166857.140437:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444482304 00010000:00010000:2.0:1762166857.140460:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ea30 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9184f expref: 52 pid: 30818 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166857.140506:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 776 00000100:00100000:2.0:1762166857.140515:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2360:x1847765444482304:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.140525:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.140532:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ea30 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9184f expref: 52 pid: 30818 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166857.140543:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ea30 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9184f expref: 52 pid: 30818 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166857.140558:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ea30 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9184f expref: 52 pid: 30818 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166857.140575:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:2.0:1762166857.140580:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9ea6f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.140587:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9ea6f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.140593:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9ea6f lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.140615:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166857.140642:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9ea6f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166857.140651:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2360:x1847765444482304:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 135us (277us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166857.140654:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9ea6f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166857.140665:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 776 00000004:00200000:1.0:1762166857.140682:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166857.140687:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166857.140698:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9ea6f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.140718:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ea68 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91864 expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.140730:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9ea6f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91864 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.140735:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:1.0:1762166857.140737:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166857.140739:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159800, rc 0) 00000100:00100000:1.0:1762166857.140800:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49270:x1847765444482176:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1622us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.140822:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 320 00000100:00100000:3.0:1762166857.142111:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.142152:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444482432 00000100:00100000:2.0:1762166857.142159:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444482432 00000100:00100000:2.0:1762166857.142207:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1163 00000100:00100000:2.0:1762166857.142215:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444482432:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.142229:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.142241:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ea76 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9186b expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.142287:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451985920:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166857.142346:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee248001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.143132:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451985920:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166857.143152:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ea76 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9186b expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.143168:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ea76 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9186b expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.143178:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2e00, rc 0) 00000100:00100000:2.0:1762166857.143213:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444482432:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 998us (1106us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166857.143220:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1163 00000100:00100000:0.0:1762166857.144203:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.144245:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444482560 00000100:00100000:1.0:1762166857.144252:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444482560 00000100:00100000:1.0:1762166857.144296:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 321 00000100:00100000:1.0:1762166857.144306:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49270:x1847765444482560:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.144316:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.144329:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ea7d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91872 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.144370:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ea84 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.144390:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ea84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x33:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.144399:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ea84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x33:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.144438:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x33:0x0]: returning size 0 00000004:00200000:1.0:1762166857.144442:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166857.144459:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ea84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x33:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.144476:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ea7d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91872 expref: 52 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.144485:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ea84 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x33:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91872 expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.144490:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x33:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:1.0:1762166857.144501:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1762166857.144504:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158000, rc 0) 00000100:00100000:1.0:1762166857.144532:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49270:x1847765444482560:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 230us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.144536:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 321 00000100:00100000:3.0:1762166857.145447:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.145494:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444482688 00000100:00100000:2.0:1762166857.145500:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444482688 00000100:00100000:2.0:1762166857.145540:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1164 00000100:00100000:2.0:1762166857.145550:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765444482688:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.145561:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.145575:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ea8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91879 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166857.145609:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166857.145622:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.145625:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.145631:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ea8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91879 expref: 19 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.145644:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ea8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91879 expref: 19 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.145654:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3000, rc 0) 00000100:00100000:2.0:1762166857.145689:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765444482688:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 141us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.145697:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1164 00000100:00100000:3.0:1762166857.146704:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.146746:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444482944 00000100:00100000:1.0:1762166857.146753:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444482944 00000100:00100000:1.0:1762166857.146814:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 322 00000100:00100000:1.0:1762166857.146825:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49270:x1847765444482944:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.146836:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.146848:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ea92 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91880 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.146920:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea99 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.146944:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea99 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.146954:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea99 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.146966:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166857.147074:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ea92 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91880 expref: 54 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.147088:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea99 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91880 expref: 53 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.147096:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:1.0:1762166857.147108:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166857.147111:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159200, rc 0) 00000100:00100000:1.0:1762166857.147150:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49270:x1847765444482944:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 328us (448us total) trans 8589934924 rc 0/0 00000100:00100000:1.0:1762166857.147156:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 322 00000100:00100000:0.0:1762166857.148173:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.148215:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444483072 00000100:00100000:2.0:1762166857.148220:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444483072 00000100:00100000:2.0:1762166857.148254:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1165 00000100:00100000:2.0:1762166857.148263:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444483072:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.148272:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.148283:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9eaa7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91887 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.148324:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451986048:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166857.148387:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee248001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.149209:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451986048:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166857.149232:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9eaa7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91887 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.149259:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9eaa7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91887 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.149270:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2400, rc 0) 00000100:00100000:2.0:1762166857.149306:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444483072:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1045us (1135us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166857.149313:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1165 00000100:00100000:3.0:1762166857.150416:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.150466:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444483200 00000100:00100000:2.0:1762166857.150473:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444483200 00000100:00100000:2.0:1762166857.150509:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1166 00000100:00100000:2.0:1762166857.150518:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444483200:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.150528:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.150540:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9eaae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9188e expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.150577:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451986176:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166857.150632:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee248001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.151458:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451986176:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166857.151480:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9eaae lrc: 1/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9188e expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.151496:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9eaae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9188e expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.151522:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3a00, rc 0) 00000100:00100000:2.0:1762166857.151553:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444483200:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1037us (1141us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166857.151558:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1166 00000100:00100000:3.0:1762166857.152602:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.152643:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444483328 00000100:00100000:2.0:1762166857.152650:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444483328 00000100:00100000:2.0:1762166857.152690:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1167 00000100:00100000:2.0:1762166857.152698:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444483328:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166857.152724:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eab5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.152735:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e8e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917e6 expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.152743:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166857.152745:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166857.152748:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eab5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.152797:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e8e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917e6 expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.152810:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e8e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917e6 expref: 20 pid: 26444 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166857.152824:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451986304:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.152888:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee248001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.153796:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451986304:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.153813:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eab5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166857.153891:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.153934:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444483456 00000100:00100000:2.0:1762166857.153941:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444483456 00010000:00010000:2.0:1762166857.153963:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e8e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917e6 expref: 21 pid: 26444 timeout: 577 lvb_type: 0 00000100:00100000:2.0:1762166857.154008:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 777 00000100:00100000:2.0:1762166857.154017:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765444483456:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.154031:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.154055:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e8e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917e6 expref: 21 pid: 26444 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166857.154067:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e8e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917e6 expref: 21 pid: 26444 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166857.154088:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9e8e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917e6 expref: 21 pid: 26444 timeout: 577 lvb_type: 0 00010000:00010000:2.0:1762166857.154100:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.154102:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.154106:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eab5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.154129:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eab5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.154155:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166857.154180:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eab5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.154190:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eab5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.154199:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444483456:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 181us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.154208:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 777 00010000:00010000:1.0:1762166857.154215:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eab5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.154222:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eab5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.154228:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eab5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.154232:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166857.154236:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eab5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.154244:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eab5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.154258:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eab5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.154272:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eab5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166857.154333:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765444483328:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 1635us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.154342:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1167 00000100:00100000:3.0:1762166857.155478:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.155639:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444483584 00000100:00100000:1.0:1762166857.155645:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444483584 00000100:00100000:1.0:1762166857.155679:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1168 00000100:00100000:1.0:1762166857.155686:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765444483584:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.155700:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.155716:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eabc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91895 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166857.155748:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x89:0x0] initial LVB size: 0, mtime: 0x69088847, atime: 0x69088847, ctime: 0x69088849, blocks: 0x1 00010000:00010000:1.0:1762166857.155792:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166857.155795:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166857.155801:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eabc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91895 expref: 20 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166857.155817:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eabc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91895 expref: 20 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166857.155825:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158200, rc 0) 00000100:00100000:1.0:1762166857.155858:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444483584:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 173us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.155872:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1168 00000100:00100000:3.0:1762166857.180102:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.180176:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444483712 00000100:00100000:1.0:1762166857.180186:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444483712 00000100:00100000:1.0:1762166857.180246:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 323 00000100:00100000:1.0:1762166857.180258:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49270:x1847765444483712:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:0.0:1762166857.189391:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934918 is committed 00000020:00080000:0.0:1762166857.189444:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee246eef240 refcount 2 committed 0 result 0 batchid 4294969121 00000020:00080000:0.0:1762166857.189451:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee34368fd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee246eef900 00000020:00080000:0.0:1762166857.189455:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee34368f800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee24558c000 00000001:00080000:0.0:1762166857.189474:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934924 is committed 00000020:00080000:0.0:1762166857.189503:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969120 batchid updated 00000020:00080000:2.0:1762166857.189508:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969121 committed batchid 4294969119 00000100:00100000:3.0:1762166857.189519:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49270:x1847765444483712:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 9258us (9416us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.189537:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 323 00000020:00080000:2.0:1762166857.189695:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969120 00000100:00100000:0.0:1762166857.191014:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.191071:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444483840 00000100:00100000:1.0:1762166857.191080:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444483840 00000100:00100000:1.0:1762166857.191131:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1169 00000100:00100000:1.0:1762166857.191142:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765444483840:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:1.0:1762166857.191239:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765444483840:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 100us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.191247:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1169 00000100:00100000:1.0:1762166857.198307:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.198381:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444483968 00000100:00100000:2.0:1762166857.198390:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444483968 00000100:00100000:2.0:1762166857.198457:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1170 00000100:00100000:2.0:1762166857.198467:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444483968:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166857.198512:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eac3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.198526:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.198528:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.198533:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eac3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.198546:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eac3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.198579:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eac3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.198602:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eac3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.198609:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.198615:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166857.198619:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.198627:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.198640:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eac3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.198647:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eac3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.198724:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444483968:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 258us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.198731:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1170 00000100:00100000:3.0:1762166857.199779:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.199834:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444484224 00000100:00100000:1.0:1762166857.199840:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444484224 00000100:00100000:1.0:1762166857.199881:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 324 00000100:00100000:1.0:1762166857.199889:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49270:x1847765444484224:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762166857.199943:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166857.199961:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ea84 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x33:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91872 expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.199971:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x33:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:1.0:1762166857.199978:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166857.200002:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eaca lrc: 3/0,1 mode: --/PW res: [0x200000404:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.200017:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eaca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.200023:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eaca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:1.0:1762166857.200154:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008e7669f5 reply state 000000008eb17398 transno 8589934925 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eaca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166857.200161:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166857.200230:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49270:x1847765444484224:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 341us (469us total) trans 8589934925 rc 0/0 00000100:00100000:1.0:1762166857.200237:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 324 00010000:00010000:3.0:1762166857.200835:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eaca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.200844:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eaca lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.200850:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eaca lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.200856:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166857.200859:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eaca lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.200881:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eaca lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.200892:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x33:0x0].0x0 (ffff9ee34ada3400) 00010000:00010000:3.0:1762166857.200895:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166857.200898:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eaca lrc: 2/0,0 mode: --/PW res: [0x200000404:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.200904:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eaca lrc: 0/0,0 mode: --/PW res: [0x200000404:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166857.201086:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.201133:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444484352 00000100:00100000:1.0:1762166857.201139:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444484352 00000100:00100000:1.0:1762166857.201171:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 325 00000100:00100000:1.0:1762166857.201180:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49270:x1847765444484352:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.201193:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.201206:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ead1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9189c expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.201240:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ead1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9189c expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.201251:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ead1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9189c expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.201265:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x33:0x0].0x0 (ffff9ee34ada3500) 00010000:00010000:1.0:1762166857.201268:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166857.201276:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159e00, rc 0) 00000100:00100000:1.0:1762166857.201322:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49270:x1847765444484352:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 141us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.201330:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 325 00000100:00100000:0.0:1762166857.202296:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.202332:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444484480 00000100:00100000:2.0:1762166857.202337:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444484480 00000100:00100000:2.0:1762166857.202365:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1171 00000100:00100000:2.0:1762166857.202370:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:49270:x1847765444484480:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.202389:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.202400:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ead8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f918a3 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.202417:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ea8b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91879 expref: 20 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.202437:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.202438:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.202441:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ead8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918a3 expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.202466:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ea8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91879 expref: 20 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.202475:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ea8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91879 expref: 20 pid: 26444 timeout: 577 lvb_type: 1 00000100:00100000:2.0:1762166857.202485:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451986432:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.202538:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.203314:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451986432:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.203332:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ead8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918a3 expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.203341:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3a00, rc 0) 00000100:00100000:2.0:1762166857.203376:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:49270:x1847765444484480:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1004us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.203390:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1171 00000100:00100000:3.0:1762166857.203491:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.203587:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444484608 00000100:00100000:2.0:1762166857.203601:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444484608 00010000:00010000:2.0:1762166857.203642:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ea8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91879 expref: 20 pid: 26444 timeout: 577 lvb_type: 1 00000100:00100000:2.0:1762166857.203683:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 778 00000100:00100000:2.0:1762166857.203690:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444484608:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.203705:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.203726:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ea8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91879 expref: 20 pid: 26444 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166857.203736:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ea8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91879 expref: 20 pid: 26444 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166857.203755:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ea8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91879 expref: 20 pid: 26444 timeout: 577 lvb_type: 1 00010000:00010000:2.0:1762166857.203807:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.203810:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.203816:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ead8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918a3 expref: 19 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.203827:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ead8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918a3 expref: 19 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.203887:0:5742:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ead8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918a3 expref: 19 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.203902:0:5742:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5742:1847765451986560:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762166857.203992:0:5742:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166857.205297:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.205326:0:5742:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5742:1847765451986560:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762166857.205347:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166857.205392:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444484736 00000100:00100000:2.0:1762166857.205394:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765444484608:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1703us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.205406:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444484736 00000100:00100000:2.0:1762166857.205412:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 778 00000100:00100000:3.0:1762166857.205478:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1172 00000100:00100000:3.0:1762166857.205490:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765444484736:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:3.0:1762166857.205795:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x89:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166857.205799:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x89:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:3.0:1762166857.205802:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x89:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:3.0:1762166857.205805:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x89:0x0] updating lvb ctime from disk: 0 -> 1762166857 00002000:00010000:3.0:1762166857.205808:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x89:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762166857.205864:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444484736:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 377us (571us total) trans 17179869456 rc 0/0 00000100:00100000:3.0:1762166857.205873:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1172 00000100:00100000:1.0:1762166857.206891:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.206945:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444484992 00000100:00100000:3.0:1762166857.206954:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444484992 00000100:00100000:3.0:1762166857.206999:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 326 00000100:00100000:3.0:1762166857.207008:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49270:x1847765444484992:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166857.207061:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.207086:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9ea6f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91864 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.207104:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:3.0:1762166857.207109:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166857.207141:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9eadf lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.207155:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9eadf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.207165:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9eadf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:3.0:1762166857.207266:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000752a72be reply state 00000000f5e23f3d transno 8589934926 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9eadf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166857.207275:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166857.207344:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49270:x1847765444484992:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 337us (456us total) trans 8589934926 rc 0/0 00000100:00100000:3.0:1762166857.207352:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 326 00010000:00010000:2.0:1762166857.208029:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9eadf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.208042:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9eadf lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.208050:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9eadf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.208056:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.208062:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9eadf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.208070:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9eadf lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.208086:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:2.0:1762166857.208089:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.208107:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9eadf lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.208114:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9eadf lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166857.208587:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.208683:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444485120 00000100:00100000:3.0:1762166857.208692:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444485120 00000100:00100000:3.0:1762166857.208729:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1173 00000100:00100000:3.0:1762166857.208735:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:49270:x1847765444485120:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166857.208745:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.208755:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9eae6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f918aa expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.208818:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eabc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91895 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166857.208823:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166857.208825:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166857.208827:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9eae6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918aa expref: 21 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.208852:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eabc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91895 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166857.208861:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eabc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91895 expref: 21 pid: 26444 timeout: 578 lvb_type: 1 00000100:00100000:3.0:1762166857.208871:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451986688:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166857.208930:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.209845:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451986688:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166857.209942:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9eae6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918aa expref: 21 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166857.209964:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166857.209998:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216c600, rc 0) 00000100:00100000:2.0:1762166857.210003:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444485248 00000100:00100000:2.0:1762166857.210012:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444485248 00010000:00010000:2.0:1762166857.210046:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eabc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91895 expref: 22 pid: 26444 timeout: 578 lvb_type: 1 00000100:00100000:3.0:1762166857.210057:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:49270:x1847765444485120:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1316us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.210066:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1173 00000100:00100000:2.0:1762166857.210090:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 779 00000100:00100000:2.0:1762166857.210103:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765444485248:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.210119:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.210142:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eabc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91895 expref: 21 pid: 26444 timeout: 578 lvb_type: 1 00010000:00010000:2.0:1762166857.210153:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eabc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91895 expref: 21 pid: 26444 timeout: 578 lvb_type: 1 00010000:00010000:2.0:1762166857.210172:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eabc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91895 expref: 21 pid: 26444 timeout: 578 lvb_type: 1 00010000:00010000:2.0:1762166857.210183:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.210185:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.210189:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9eae6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918aa expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.210196:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9eae6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918aa expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.210233:0:5742:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9eae6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918aa expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.210243:0:5742:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765451986816:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762166857.210312:0:5742:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.211235:0:5742:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765451986816:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762166857.211254:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166857.211298:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444485248:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1197us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.211307:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 779 00000100:00100000:1.0:1762166857.211406:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.211485:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444485376 00000100:00100000:3.0:1762166857.211503:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444485376 00000100:00100000:3.0:1762166857.211546:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1174 00000100:00100000:3.0:1762166857.211553:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444485376:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:3.0:1762166857.211706:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x89:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166857.211710:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x89:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:3.0:1762166857.211712:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x89:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:3.0:1762166857.211714:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x89:0x0] updating lvb ctime from disk: 1762166857 -> 1762166857 00002000:00010000:3.0:1762166857.211716:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x89:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762166857.211805:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765444485376:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 251us (397us total) trans 21474836786 rc 0/0 00000100:00100000:3.0:1762166857.211815:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1174 00000100:00100000:3.0:1762166857.212801:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.212855:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444485632 00000100:00100000:1.0:1762166857.212862:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444485632 00000100:00100000:1.0:1762166857.212906:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 131 00000100:00100000:1.0:1762166857.212913:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f4ee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49270:x1847765444485632:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166857.213006:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea99 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91880 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.213054:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eaed lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.213068:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e9c7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9182c expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.213076:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ea14 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91841 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.213084:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eaed lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.213115:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ea14 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91841 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.213151:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ea14 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91841 expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1762166857.213166:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcce300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451986944:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166857.213242:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e9c7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9182c expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.213249:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e9c7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9182c expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1762166857.213257:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451987072:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166857.213276:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.214344:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcce300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451986944:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.214361:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451987072:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.214399:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eaed lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166857.214513:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.214604:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444485888 00000100:00100000:2.0:1762166857.214611:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444485888 00000100:00100000:2.0:1762166857.214661:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 132 00000100:00100000:2.0:1762166857.214671:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:43349:x1847765444485888:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1762166857.214882:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.214931:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444486016 00000100:00100000:0.0:1762166857.214936:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444486016 00010000:00010000:0.0:1762166857.214956:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e9c7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9182c expref: 30 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.214957:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:43349:x1847765444485888:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 284us (444us total) trans 8589934927 rc 0/0 00000100:00100000:2.0:1762166857.214976:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 132 00000100:00100000:0.0:1762166857.214994:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 780 00000100:00100000:0.0:1762166857.215002:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444486016:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.215010:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.215023:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e9c7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9182c expref: 29 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.215037:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e9c7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9182c expref: 29 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.215058:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9e9c7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9182c expref: 29 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.215074:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:0.0:1762166857.215079:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eaed lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.215086:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eaed lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.215093:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166857.215126:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444486016:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 124us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.215146:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 780 00000100:00100000:3.0:1762166857.215945:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.215975:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444486144 00000100:00100000:0.0:1762166857.215979:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444486144 00010000:00010000:0.0:1762166857.215992:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ea14 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91841 expref: 28 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.216013:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 781 00000100:00100000:0.0:1762166857.216021:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444486144:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.216030:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.216035:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ea14 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91841 expref: 28 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.216045:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ea14 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91841 expref: 28 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.216059:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ea14 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91841 expref: 28 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.216070:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:0.0:1762166857.216074:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eaed lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.216083:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eaed lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.216089:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eaed lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.216117:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166857.216142:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eaed lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.216151:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eaed lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166857.216167:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444486144:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 145us (219us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166857.216168:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eaf4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.216185:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ead1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9189c expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.216186:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 781 00010000:00010000:1.0:1762166857.216197:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eaf4 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x33:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.216227:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ead1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9189c expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.216250:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ead1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9189c expref: 26 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1762166857.216264:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451987200:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166857.216320:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a840 going to sleep for 11 seconds 00000100:00100000:1.0:1762166857.217316:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765451987200:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166857.217344:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eaf4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x33:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166857.217665:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.217741:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444486272 00000100:00100000:0.0:1762166857.217752:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444486272 00010000:00010000:0.0:1762166857.217820:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ead1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9189c expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.217865:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 782 00000100:00100000:0.0:1762166857.217875:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444486272:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.217888:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.217895:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ead1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9189c expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.217907:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ead1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9189c expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.217925:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ead1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x33:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9189c expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.217940:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x33:0x0].0x0 (ffff9ee34ada3500) 00010000:00010000:0.0:1762166857.217944:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eaf4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x33:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.217952:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eaf4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x33:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.217959:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eaf4 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x33:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166857.218002:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166857.218048:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444486272:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 174us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.218059:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 782 00010000:00010000:1.0:1762166857.218067:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eaf4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.218076:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eaf4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166857.218561:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451987328:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166857.218620:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166857.218652:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.218676:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451987328 00000100:00100000:3.0:1762166857.218684:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451987328 00000100:00100000:3.0:1762166857.218727:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1762166857.218736:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30821:x1847765451987328:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166857.218858:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30821:x1847765451987328:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 123us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.218869:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1762166857.218910:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451987328:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166857.218963:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451987456:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166857.218993:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166857.219017:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e1173c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.219039:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451987456 00000100:00100000:3.0:1762166857.219044:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451987456 00000100:00100000:3.0:1762166857.219067:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1762166857.219072:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30821:x1847765451987456:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166857.219157:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30821:x1847765451987456:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 84us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.219163:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1762166857.219243:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451987456:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1762166857.219478:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934928 00000100:00100000:1.0:1762166857.219556:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451987584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166857.219602:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166857.219632:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.219639:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451987584 00000100:00100000:3.0:1762166857.219643:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451987584 00000100:00100000:3.0:1762166857.219667:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1762166857.219671:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30821:x1847765451987584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166857.219839:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30821:x1847765451987584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 164us (235us total) trans 17179869457 rc 0/0 00000100:00100000:3.0:1762166857.219846:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1762166857.219859:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765451987584:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1762166857.219941:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934929 00010000:00010000:1.0:1762166857.219968:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eaf4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.219978:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eaf4 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.219985:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eaf4 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.219991:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166857.219995:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eaf4 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.220003:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eaf4 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.220017:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x33:0x0].0x0 (ffff9ee34ada3500) 00010000:00010000:1.0:1762166857.220020:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166857.220023:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eaf4 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.220029:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eaf4 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.220048:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eaed lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.220054:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eaed lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.220070:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eaed lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.220075:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166857.220078:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eaed lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.220083:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eaed lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.220092:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:1.0:1762166857.220094:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166857.220097:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eaed lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.220102:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eaed lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.220113:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:1.0:1762166857.220115:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166857.220119:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ea99 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91880 expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166857.220185:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f4ee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49270:x1847765444485632:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 7273us (7428us total) trans 8589934930 rc 0/0 00000100:00100000:1.0:1762166857.220190:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 131 00000020:00080000:1.0:1762166857.220193:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166857.221137:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.221181:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444486400 00000100:00100000:1.0:1762166857.221187:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444486400 00000100:00100000:1.0:1762166857.221224:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 327 00000100:00100000:1.0:1762166857.221234:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49270:x1847765444486400:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.221268:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.221286:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9eafb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f918b1 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.221329:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9eafb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918b1 expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.221342:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9eafb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918b1 expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.221357:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:1.0:1762166857.221360:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166857.221363:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159600, rc 0) 00000100:00100000:1.0:1762166857.221397:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49270:x1847765444486400:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 165us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.221404:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 327 00000100:00100000:3.0:1762166857.222494:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.222557:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444486656 00000100:00100000:1.0:1762166857.222564:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444486656 00000100:00100000:1.0:1762166857.222604:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 133 00000100:00100000:1.0:1762166857.222614:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49270:x1847765444486656:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166857.222799:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49270:x1847765444486656:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 185us (305us total) trans 8589934931 rc 0/0 00000100:00100000:1.0:1762166857.222807:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 133 00000100:00100000:2.0:1762166857.223635:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.223677:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444486912 00000100:00100000:1.0:1762166857.223683:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444486912 00000100:00100000:1.0:1762166857.223719:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 134 00000100:00100000:1.0:1762166857.223727:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49270:x1847765444486912:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:1.0:1762166857.223972:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x33:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1762166857.224074:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9eb02 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.224088:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9eb02 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.224099:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9eb02 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.224107:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9eb02 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.224113:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9eb02 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.224119:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9eb02 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166857.224139:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166857.224163:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166857.224171:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9eb02 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166857.224179:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166857.224183:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9eb02 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166857.224198:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9eb02 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166857.224211:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x33:0x0].0x0 (ffff9ee34ada3a00) 00010000:00010000:2.0:1762166857.224214:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166857.224218:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9eb02 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166857.224224:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49270:x1847765444486912:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 496us (588us total) trans 8589934932 rc 0/0 00010000:00010000:2.0:1762166857.224226:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9eb02 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166857.224240:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 134 00010000:00010000:2.0:1762166857.224262:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166857.224265:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166857.224267:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166857.232855:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.232916:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444487040 00000100:00100000:1.0:1762166857.232930:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444487040 00000100:00100000:1.0:1762166857.233005:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 328 00000100:00100000:1.0:1762166857.233017:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49272:x1847765444487040:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:1.0:1762166857.233049:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.233074:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9eb09 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f918b8 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.233197:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb10 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233215:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb10 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233226:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb10 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233237:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb17 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233241:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233245:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233376:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eb1e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233384:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eb1e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233389:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eb1e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.233441:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166857.233446:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166857.233467:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eb1e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233480:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eb1e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233496:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb10 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233503:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb10 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233509:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb10 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233515:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166857.233519:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb10 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233526:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb10 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233540:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166857.233543:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166857.233548:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb10 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233554:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb10 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233568:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233574:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb17 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233580:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb17 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233585:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166857.233593:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb17 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233598:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb17 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233605:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3500) 00010000:00010000:1.0:1762166857.233607:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166857.233610:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb17 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233615:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb17 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.233648:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9eb09 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918b8 expref: 32 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.233661:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eb1e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918b8 expref: 31 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.233667:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:1.0:1762166857.233670:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166857.233673:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158200, rc 0) 00000100:00100000:1.0:1762166857.233746:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49272:x1847765444487040:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 731us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.233756:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 328 00000100:00100000:3.0:1762166857.246630:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.246700:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444487168 00000100:00100000:1.0:1762166857.246715:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444487168 00000100:00100000:1.0:1762166857.246820:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 329 00000100:00100000:1.0:1762166857.246831:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49276:x1847765444487168:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:1.0:1762166857.246932:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9eb25 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.246948:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9eb25 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.246958:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9eb25 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.246968:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb2c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.246973:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.246977:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247097:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb33 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247105:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb33 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247111:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb33 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.247149:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166857.247153:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166857.247165:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb33 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247177:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9eb25 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247188:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9eb25 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247193:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9eb25 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247197:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166857.247200:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9eb25 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247205:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9eb25 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247215:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166857.247217:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166857.247221:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9eb25 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247225:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9eb25 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247235:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247238:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb2c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247241:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb2c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247244:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166857.247250:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb2c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247260:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb2c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247265:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3500) 00010000:00010000:1.0:1762166857.247266:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166857.247268:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb2c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247271:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb2c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247282:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb33 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247285:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb33 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247288:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb33 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247291:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166857.247292:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb33 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247295:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb33 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247298:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:1.0:1762166857.247300:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166857.247301:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb33 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.247304:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb33 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166857.247385:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49276:x1847765444487168:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 556us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.247399:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 329 00000100:00100000:2.0:1762166857.256726:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.256809:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444487424 00000100:00100000:1.0:1762166857.256820:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444487424 00000100:00100000:1.0:1762166857.256878:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 330 00000100:00100000:1.0:1762166857.256889:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49278:x1847765444487424:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.256908:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.256926:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb3a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f918bf expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.257020:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb41 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.257030:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb41 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.257038:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb41 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.257045:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166857.257152:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb3a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918bf expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.257165:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb41 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918bf expref: 33 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.257170:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:1.0:1762166857.257172:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166857.257185:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158000, rc 0) 00000100:00100000:1.0:1762166857.257236:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49278:x1847765444487424:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 349us (538us total) trans 8589934933 rc 0/0 00000100:00100000:1.0:1762166857.257244:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 330 00000100:00100000:3.0:1762166857.259363:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.259413:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444487680 00000100:00100000:1.0:1762166857.259432:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444487680 00000100:00100000:1.0:1762166857.259486:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 331 00000100:00100000:1.0:1762166857.259497:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49278:x1847765444487680:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.259520:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.259536:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9eb4f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f918c6 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.259630:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eb56 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.259644:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eb1e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918b8 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.259653:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eb56 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.259698:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eb1e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918b8 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.259712:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eb1e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918b8 expref: 34 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1762166857.259725:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451987712:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166857.259824:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166857.260881:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451987712:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166857.260901:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eb56 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166857.261243:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.261292:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444487808 00000100:00100000:0.0:1762166857.261297:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444487808 00010000:00010000:0.0:1762166857.261329:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eb1e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918b8 expref: 35 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.261358:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 783 00000100:00100000:0.0:1762166857.261369:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444487808:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.261383:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.261394:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eb1e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918b8 expref: 35 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.261406:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eb1e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918b8 expref: 35 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.261435:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eb1e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918b8 expref: 35 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.261450:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:0.0:1762166857.261454:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eb56 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.261463:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eb56 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.261482:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eb56 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.261504:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166857.261537:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eb56 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166857.261539:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765444487808:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 173us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.261553:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 783 00010000:00010000:1.0:1762166857.261562:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eb56 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.261578:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166857.261752:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9eb4f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918c6 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.261807:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eb56 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918c6 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.261823:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:1.0:1762166857.261826:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166857.261829:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158a00, rc 0) 00000100:00100000:1.0:1762166857.261879:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49278:x1847765444487680:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2384us (2523us total) trans 8589934934 rc 0/0 00000100:00100000:1.0:1762166857.261887:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 331 00000100:00100000:3.0:1762166857.263013:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.263057:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444487936 00000100:00100000:1.0:1762166857.263064:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444487936 00000100:00100000:1.0:1762166857.263107:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 135 00000100:00100000:1.0:1762166857.263114:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49278:x1847765444487936:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:1.0:1762166857.263214:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49278:x1847765444487936:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 99us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.263235:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 135 00000100:00100000:3.0:1762166857.264024:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.264071:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444488192 00000100:00100000:2.0:1762166857.264076:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444488192 00000100:00100000:2.0:1762166857.264113:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 136 00000100:00100000:2.0:1762166857.264126:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49278:x1847765444488192:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166857.264275:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49278:x1847765444488192:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 155us (253us total) trans 8589934935 rc 0/0 00000100:00100000:2.0:1762166857.264280:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 136 00000100:00100000:3.0:1762166857.265328:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.265471:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444488448 00000100:00100000:1.0:1762166857.265478:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444488448 00000100:00100000:1.0:1762166857.265525:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 332 00000100:00100000:1.0:1762166857.265535:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49278:x1847765444488448:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.265552:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.265555:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1762166857.265578:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9eb56 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918c6 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.265598:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9eb41 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918bf expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.265608:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:1.0:1762166857.265612:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166857.265624:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb64 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f918cd expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.265693:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9eb6b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.265705:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9eb6b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.265713:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9eb6b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.265725:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166857.265844:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9eb64 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918cd expref: 36 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.265870:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9eb6b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918cd expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.265878:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:1.0:1762166857.265881:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166857.265883:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159800, rc 0) 00000100:00100000:1.0:1762166857.265938:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49278:x1847765444488448:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 404us (625us total) trans 8589934936 rc 0/0 00000100:00100000:1.0:1762166857.265945:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 332 00000100:00100000:3.0:1762166857.267412:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.267493:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444488704 00000100:00100000:2.0:1762166857.267499:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444488704 00000100:00100000:2.0:1762166857.267539:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 137 00000100:00100000:2.0:1762166857.267548:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f4ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49278:x1847765444488704:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166857.267599:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9eb6b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918cd expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.267648:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9eb79 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.267659:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9eafb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918b1 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.267666:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9eb79 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.267697:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9eafb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918b1 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.267709:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9eafb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918b1 expref: 35 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.267723:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451987840:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.267805:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a180 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.268948:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.268955:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451987840:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.268980:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9eb79 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.269058:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444488832 00000100:00100000:0.0:1762166857.269074:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444488832 00010000:00010000:0.0:1762166857.269134:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9eafb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918b1 expref: 36 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.269181:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 784 00000100:00100000:0.0:1762166857.269193:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765444488832:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.269211:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.269218:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9eafb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918b1 expref: 36 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.269232:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9eafb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918b1 expref: 36 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.269254:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9eafb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918b1 expref: 36 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.269275:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:0.0:1762166857.269281:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9eb79 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.269306:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9eb79 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.269327:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9eb79 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.269362:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.269395:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9eb79 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.269406:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9eb79 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.269453:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444488832:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 260us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.269464:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 784 00010000:00010000:2.0:1762166857.269688:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9eb79 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.269712:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9eb79 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.269719:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9eb79 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.269725:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.269729:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9eb79 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.269737:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9eb79 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.269749:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:2.0:1762166857.269752:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166857.269757:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9eb79 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.269789:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9eb79 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.269806:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3000) 00010000:00010000:2.0:1762166857.269809:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166857.269816:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9eb6b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918cd expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.269959:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f4ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49278:x1847765444488704:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2411us (2550us total) trans 8589934937 rc -22/-22 00000100:00100000:2.0:1762166857.269970:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 137 00000100:00100000:3.0:1762166857.271033:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.271092:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444488960 00000100:00100000:1.0:1762166857.271100:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444488960 00000100:00100000:1.0:1762166857.271148:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 333 00000100:00100000:1.0:1762166857.271159:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49278:x1847765444488960:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.271185:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.271207:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9eb80 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f918d4 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.271274:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9eb80 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918d4 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.271288:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9eb80 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918d4 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.271311:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3500) 00010000:00010000:1.0:1762166857.271317:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166857.271320:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159e00, rc 0) 00000100:00100000:1.0:1762166857.271390:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49278:x1847765444488960:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 233us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.271398:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 333 00000100:00100000:3.0:1762166857.272954:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.273006:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444489216 00000100:00100000:1.0:1762166857.273015:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444489216 00000100:00100000:1.0:1762166857.273062:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 334 00000100:00100000:1.0:1762166857.273073:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49278:x1847765444489216:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.273091:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.273109:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eb87 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f918db expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.273701:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9eb8e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.273715:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9eb8e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.273726:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9eb8e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.273738:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x34:0x0]: returning size 0 00010000:00010000:1.0:1762166857.273824:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eb87 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918db expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.273844:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9eb8e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918db expref: 37 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.273852:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:1.0:1762166857.273855:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166857.273859:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a26400, rc 0) 00000100:00100000:1.0:1762166857.273930:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49278:x1847765444489216:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 858us (981us total) trans 8589934938 rc 0/0 00000100:00100000:1.0:1762166857.273938:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 334 00000100:00100000:3.0:1762166857.275580:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.275653:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444489472 00000100:00100000:1.0:1762166857.275663:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444489472 00000100:00100000:1.0:1762166857.275718:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 335 00000100:00100000:1.0:1762166857.275728:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49278:x1847765444489472:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.275751:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.275793:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9eb9c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f918e2 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.275879:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26e00/0xf915a5bdf3c9eba3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.275893:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26e00/0xf915a5bdf3c9eba3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.275903:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26e00/0xf915a5bdf3c9eba3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.275913:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166857.276041:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9eb9c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918e2 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.276058:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26e00/0xf915a5bdf3c9eba3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918e2 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.276065:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3500) 00010000:00010000:1.0:1762166857.276068:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166857.276071:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a26e00, rc 0) 00000100:00100000:1.0:1762166857.276153:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49278:x1847765444489472:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 426us (578us total) trans 8589934939 rc 0/0 00000100:00100000:1.0:1762166857.276161:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 335 00000100:00100000:3.0:1762166857.277444:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.277523:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444489728 00000100:00100000:2.0:1762166857.277529:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444489728 00000100:00100000:2.0:1762166857.277575:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 138 00000100:00100000:2.0:1762166857.277585:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49278:x1847765444489728:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166857.277639:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26e00/0xf915a5bdf3c9eba3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918e2 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.277666:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ebb1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.277677:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9eb80 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918d4 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.277682:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ebb1 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.277707:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9eb80 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918d4 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.277715:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9eb80 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918d4 expref: 39 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.277725:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451987968:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.277814:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.278590:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451987968:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.278607:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ebb1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166857.278895:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.278958:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444489856 00000100:00100000:0.0:1762166857.278973:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444489856 00010000:00010000:0.0:1762166857.279023:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9eb80 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918d4 expref: 40 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.279071:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 785 00000100:00100000:0.0:1762166857.279082:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2361:x1847765444489856:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.279101:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.279108:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9eb80 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918d4 expref: 40 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.279122:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9eb80 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918d4 expref: 40 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.279143:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9eb80 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918d4 expref: 40 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.279160:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3500) 00010000:00010000:0.0:1762166857.279178:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ebb1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.279188:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ebb1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.279195:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ebb1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.279231:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.279274:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ebb1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.279284:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ebb1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.279288:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444489856:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 209us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.279298:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 785 00010000:00010000:2.0:1762166857.279322:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ebb8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.279336:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9eb8e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918db expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.279344:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ebb8 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.279376:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9eb8e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918db expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.279390:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9eb8e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918db expref: 38 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.279404:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451988096:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.279482:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.280214:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451988096:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.280229:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ebb8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166857.280428:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.280485:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444489984 00000100:00100000:0.0:1762166857.280494:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444489984 00010000:00010000:0.0:1762166857.280524:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9eb8e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918db expref: 39 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.280562:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 786 00000100:00100000:0.0:1762166857.280575:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444489984:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.280589:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.280595:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9eb8e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918db expref: 39 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.280607:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9eb8e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918db expref: 39 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.280625:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9eb8e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918db expref: 39 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.280654:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:0.0:1762166857.280658:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ebb8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.280667:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ebb8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.280674:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ebb8 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.280712:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.280755:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ebb8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.280796:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2361:x1847765444489984:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 187us (339us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166857.280806:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ebb8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.280817:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 786 00000100:00100000:2.0:1762166857.281161:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451988224:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166857.281195:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166857.281222:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.281243:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451988224 00000100:00100000:3.0:1762166857.281251:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451988224 00000100:00100000:3.0:1762166857.281293:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1762166857.281305:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:31351:x1847765451988224:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166857.281366:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:31351:x1847765451988224:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 64us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.281374:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1762166857.281387:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451988224:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166857.281435:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934940 00000001:00080000:2.0:1762166857.281500:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934941 00010000:00010000:2.0:1762166857.281522:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ebb8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.281530:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ebb8 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x34:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.281537:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ebb8 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x34:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.281541:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.281543:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ebb8 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x34:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.281548:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ebb8 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x34:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.281558:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34:0x0].0x0 (ffff9ee34ada3d00) 00010000:00010000:2.0:1762166857.281560:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166857.281563:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ebb8 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.281567:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ebb8 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.281581:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ebb1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.281584:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ebb1 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.281595:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ebb1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.281598:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.281600:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ebb1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.281603:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ebb1 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.281607:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3500) 00010000:00010000:2.0:1762166857.281608:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166857.281610:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ebb1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.281613:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ebb1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.281620:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3500) 00010000:00010000:2.0:1762166857.281621:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166857.281625:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26e00/0xf915a5bdf3c9eba3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918e2 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.281685:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49278:x1847765444489728:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 4103us (4245us total) trans 8589934942 rc 0/0 00000100:00100000:2.0:1762166857.281691:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 138 00000020:00080000:2.0:1762166857.281694:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166857.282655:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.282695:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444490112 00000100:00100000:1.0:1762166857.282699:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444490112 00000100:00100000:1.0:1762166857.282732:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 336 00000100:00100000:1.0:1762166857.282738:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49278:x1847765444490112:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.282750:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.282791:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9ebbf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f918e9 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.282834:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9ebbf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918e9 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.282847:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9ebbf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918e9 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.282858:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:1.0:1762166857.282860:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166857.282862:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a27600, rc 0) 00000100:00100000:1.0:1762166857.282893:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49278:x1847765444490112:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 154us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.282899:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 336 00000100:00100000:3.0:1762166857.284144:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.284192:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444490368 00000100:00100000:2.0:1762166857.284199:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444490368 00000100:00100000:2.0:1762166857.284242:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 139 00000100:00100000:2.0:1762166857.284252:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49278:x1847765444490368:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762166857.284663:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x34:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166857.284808:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].16, 64 off9408 00000001:00080000:2.0:1762166857.284823:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934943 00010000:00010000:2.0:1762166857.284875:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ebc6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.284888:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ebc6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.284898:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ebc6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.284905:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ebc6 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.284911:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ebc6 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.284918:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ebc6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.284950:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166857.285001:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166857.285023:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ebc6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.285039:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166857.285046:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ebc6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.285057:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ebc6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166857.285071:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49278:x1847765444490368:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 817us (924us total) trans 8589934944 rc 0/0 00010000:00010000:0.0:1762166857.285078:0:32135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34:0x0].0x0 (ffff9ee359d01b00) 00000100:00100000:2.0:1762166857.285086:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 139 00010000:00010000:0.0:1762166857.285089:0:32135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000020:00080000:2.0:1762166857.285096:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762166857.285098:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ebc6 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.285109:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ebc6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.285160:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166857.285163:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166857.285168:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166857.286047:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.286087:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444490624 00000100:00100000:2.0:1762166857.286094:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444490624 00000100:00100000:2.0:1762166857.286140:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 140 00000100:00100000:2.0:1762166857.286150:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49278:x1847765444490624:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166857.286361:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49278:x1847765444490624:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 213us (316us total) trans 8589934945 rc 0/0 00000100:00100000:2.0:1762166857.286385:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 140 00000100:00100000:3.0:1762166857.294880:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.294939:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444490752 00000100:00100000:1.0:1762166857.294948:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444490752 00000100:00100000:1.0:1762166857.294996:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 337 00000100:00100000:1.0:1762166857.295007:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49280:x1847765444490752:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:1.0:1762166857.295046:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.295067:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9ebcd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f918f0 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.295143:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebd4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295157:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebd4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295167:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebd4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295181:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebdb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295187:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebdb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295194:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebdb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295304:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9ebe2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295311:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9ebe2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295318:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9ebe2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.295348:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166857.295352:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166857.295368:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9ebe2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295384:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9ebe2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295392:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebd4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295399:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebd4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295405:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebd4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295410:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166857.295414:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebd4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295436:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebd4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295448:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166857.295451:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166857.295455:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebd4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295461:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebd4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295481:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebdb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295487:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebdb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295493:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebdb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295504:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166857.295507:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebdb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295513:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebdb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295521:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3c00) 00010000:00010000:1.0:1762166857.295523:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166857.295525:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebdb lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295530:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebdb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.295558:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9ebcd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918f0 expref: 45 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.295568:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9ebe2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918f0 expref: 44 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.295574:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:1.0:1762166857.295577:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166857.295579:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a27000, rc 0) 00000100:00100000:1.0:1762166857.295636:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49280:x1847765444490752:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 631us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.295642:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 337 00000100:00100000:3.0:1762166857.297126:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.297189:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444490880 00000100:00100000:2.0:1762166857.297196:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444490880 00000100:00100000:2.0:1762166857.297240:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1175 00000100:00100000:2.0:1762166857.297248:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444490880:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166857.297261:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.297275:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ebe9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f918f7 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.297324:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451988352:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166857.297391:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.298235:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451988352:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166857.298259:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ebe9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918f7 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.298275:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ebe9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918f7 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.298286:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3c00, rc 0) 00000100:00100000:2.0:1762166857.298323:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444490880:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 1076us (1201us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166857.298329:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1175 00000100:00100000:3.0:1762166857.309541:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.309606:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444491008 00000100:00100000:1.0:1762166857.309615:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444491008 00000100:00100000:1.0:1762166857.309670:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 338 00000100:00100000:1.0:1762166857.309678:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49284:x1847765444491008:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:1.0:1762166857.309749:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9ebf0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.309785:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9ebf0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.309795:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9ebf0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.309808:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebf7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.309815:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebf7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.309821:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebf7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.309920:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebfe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.309928:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebfe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.309935:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebfe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.309966:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166857.309970:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166857.309979:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebfe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.309988:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9ebf0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.309997:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9ebf0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310001:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9ebf0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310005:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a27800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166857.310007:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9ebf0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310011:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9ebf0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310020:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166857.310022:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166857.310025:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9ebf0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310028:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9ebf0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310036:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebf7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310039:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebf7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310042:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebf7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310045:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166857.310047:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebf7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310056:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebf7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310061:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3c00) 00010000:00010000:1.0:1762166857.310062:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166857.310063:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebf7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310066:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ebf7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310075:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebfe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310078:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebfe lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310081:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebfe lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310084:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166857.310085:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebfe lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310089:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebfe lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310093:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:1.0:1762166857.310094:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166857.310095:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebfe lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.310098:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ebfe lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166857.310158:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49284:x1847765444491008:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 482us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.310164:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 338 00000100:00100000:3.0:1762166857.318945:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.319044:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444491264 00000100:00100000:1.0:1762166857.319062:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444491264 00000100:00100000:1.0:1762166857.319145:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 339 00000100:00100000:1.0:1762166857.319159:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49286:x1847765444491264:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.319187:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.319217:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ec05 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f918fe expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.319362:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ec0c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.319390:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ec0c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.319405:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ec0c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.319434:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166857.319613:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ec05 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918fe expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.319637:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ec0c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918fe expref: 46 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.319645:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:1.0:1762166857.319648:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166857.319675:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a26600, rc 0) 00000100:00100000:1.0:1762166857.319846:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49286:x1847765444491264:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 690us (910us total) trans 8589934946 rc 0/0 00000100:00100000:1.0:1762166857.319853:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 339 00000100:00100000:3.0:1762166857.321480:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.321548:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444491392 00000100:00100000:2.0:1762166857.321557:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444491392 00000100:00100000:2.0:1762166857.321613:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1176 00000100:00100000:2.0:1762166857.321639:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444491392:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.321656:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.321672:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ec1a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91905 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.321730:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451988480:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166857.321827:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.322789:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451988480:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166857.322817:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ec1a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91905 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.322832:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ec1a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91905 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.322843:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3c00, rc 0) 00000100:00100000:2.0:1762166857.322877:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444491392:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1242us (1407us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166857.322882:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1176 00000100:00100000:3.0:1762166857.324341:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.324408:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444491648 00000100:00100000:1.0:1762166857.324435:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444491648 00000100:00100000:1.0:1762166857.324523:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 340 00000100:00100000:1.0:1762166857.324536:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49286:x1847765444491648:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.324567:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.324592:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9ec21 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9190c expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.324717:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9ec28 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.324734:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9ebe2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918f0 expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.324742:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9ec28 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.324825:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9ebe2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918f0 expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.324840:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9ebe2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918f0 expref: 47 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1762166857.324856:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451988608:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166857.324973:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166857.325920:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451988608:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166857.325943:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9ec28 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166857.326043:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.326131:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444491776 00000100:00100000:0.0:1762166857.326140:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444491776 00010000:00010000:0.0:1762166857.326177:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9ebe2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918f0 expref: 48 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.326216:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 787 00000100:00100000:0.0:1762166857.326227:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2361:x1847765444491776:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.326242:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.326250:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9ebe2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918f0 expref: 48 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.326262:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9ebe2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918f0 expref: 48 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.326282:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9ebe2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918f0 expref: 48 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.326295:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:0.0:1762166857.326300:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9ec28 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.326308:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9ec28 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.326315:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9ec28 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.326361:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166857.326400:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9ec28 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166857.326409:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:2361:x1847765444491776:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 180us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.326445:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 787 00010000:00010000:1.0:1762166857.326446:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9ec28 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.326473:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166857.326648:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9ec21 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9190c expref: 48 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.326666:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9ec28 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9190c expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.326675:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:1.0:1762166857.326678:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166857.326681:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a26200, rc 0) 00000100:00100000:1.0:1762166857.326733:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49286:x1847765444491648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2200us (2396us total) trans 8589934947 rc 0/0 00000100:00100000:1.0:1762166857.326743:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 340 00000100:00100000:3.0:1762166857.328034:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.328078:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444492032 00000100:00100000:1.0:1762166857.328087:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444492032 00000100:00100000:1.0:1762166857.328135:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 341 00000100:00100000:1.0:1762166857.328145:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49286:x1847765444492032:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.328164:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.328176:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ec36 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91913 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.328683:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9ec3d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.328693:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9ec3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.328701:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9ec3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.328707:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x35:0x0]: returning size 0 00010000:00010000:1.0:1762166857.328732:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ec36 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91913 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.328743:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9ec3d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91913 expref: 49 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.328748:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x35:0x0].0x0 (ffff9ee34ada3c00) 00010000:00010000:1.0:1762166857.328750:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166857.328752:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a27c00, rc 0) 00000100:00100000:1.0:1762166857.328829:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49286:x1847765444492032:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 685us (798us total) trans 8589934948 rc 0/0 00000100:00100000:1.0:1762166857.328836:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 341 00000100:00100000:3.0:1762166857.330135:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.330186:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444492288 00000100:00100000:1.0:1762166857.330193:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444492288 00000100:00100000:1.0:1762166857.330241:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 342 00000100:00100000:1.0:1762166857.330263:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49286:x1847765444492288:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.330284:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.330297:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9ec4b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9191a expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.330378:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec52 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.330403:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9ec3d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91913 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.330412:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec52 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.330462:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9ec3d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91913 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.330476:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9ec3d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91913 expref: 50 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1762166857.330491:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451988736:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166857.330569:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166857.331546:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451988736:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166857.331570:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec52 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166857.331846:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.331886:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444492416 00000100:00100000:0.0:1762166857.331897:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444492416 00010000:00010000:0.0:1762166857.331934:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9ec3d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91913 expref: 51 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.331968:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 788 00000100:00100000:0.0:1762166857.331978:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2360:x1847765444492416:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.331994:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.331999:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9ec3d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91913 expref: 51 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.332009:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9ec3d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91913 expref: 51 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.332025:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9ec3d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91913 expref: 51 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.332037:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x35:0x0].0x0 (ffff9ee34ada3c00) 00010000:00010000:0.0:1762166857.332040:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec52 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.332046:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec52 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.332064:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec52 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.332088:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166857.332131:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec52 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166857.332138:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2360:x1847765444492416:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 160us (291us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166857.332144:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec52 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166857.332151:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 788 00000004:00200000:1.0:1762166857.332168:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x35:0x0]: returning size 0 00000004:00080000:1.0:1762166857.332455:0:30818:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x8a:0x0], index 0: 0 00010000:00010000:1.0:1762166857.332566:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec52 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.332573:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec52 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.332577:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec52 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.332581:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166857.332584:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec52 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.332588:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec52 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.332595:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x35:0x0].0x0 (ffff9ee34ada3c00) 00010000:00010000:1.0:1762166857.332597:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166857.332599:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec52 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.332603:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec52 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.332638:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9ec4b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9191a expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.332644:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166857.332645:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166857.332648:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9ec4b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9191a expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.332653:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a27200, rc 0) 00000100:00100000:1.0:1762166857.332696:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49286:x1847765444492288:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2448us (2564us total) trans 8589934949 rc 301/301 00000100:00100000:1.0:1762166857.332704:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 342 00000100:00100000:3.0:1762166857.333657:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.333718:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444492672 00000100:00100000:2.0:1762166857.333727:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444492672 00000100:00100000:2.0:1762166857.333798:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 141 00000100:00100000:2.0:1762166857.333809:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49286:x1847765444492672:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166857.334116:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49286:x1847765444492672:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 308us (464us total) trans 8589934950 rc 0/0 00000100:00100000:2.0:1762166857.334125:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 141 00000100:00100000:3.0:1762166857.335089:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.335134:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444492800 00000100:00100000:1.0:1762166857.335142:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444492800 00000100:00100000:1.0:1762166857.335185:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 343 00000100:00100000:1.0:1762166857.335193:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49286:x1847765444492800:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.335205:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.335222:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9ec60 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91921 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.335283:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ec67 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.335300:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9ec28 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9190c expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.335310:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ec67 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.335346:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9ec28 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9190c expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.335361:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9ec28 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9190c expref: 51 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1762166857.335376:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451988864:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166857.335460:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a240 going to sleep for 11 seconds 00000100:00100000:1.0:1762166857.336415:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451988864:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166857.336461:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ec67 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166857.336663:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.336704:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444492928 00000100:00100000:0.0:1762166857.336713:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444492928 00010000:00010000:0.0:1762166857.336746:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9ec28 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9190c expref: 52 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:3.0:1762166857.336808:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 789 00000100:00100000:3.0:1762166857.336820:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f623100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2361:x1847765444492928:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166857.336833:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.336840:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9ec28 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9190c expref: 52 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166857.336872:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9ec28 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9190c expref: 52 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166857.336893:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9ec28 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9190c expref: 52 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166857.336909:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:3.0:1762166857.336914:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ec67 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.336923:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ec67 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.336930:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ec67 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.336961:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166857.337008:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f623100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444492928:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 191us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.337016:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 789 00010000:00010000:1.0:1762166857.337035:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ec67 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.337044:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ec67 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.337078:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166857.337082:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166857.337098:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ec67 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.337144:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9ec60 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91921 expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.337161:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ec67 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91921 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.337168:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:1.0:1762166857.337170:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166857.337172:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a26000, rc 0) 00000100:00100000:1.0:1762166857.337209:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49286:x1847765444492800:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2017us (2126us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.337216:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 343 00000100:00100000:3.0:1762166857.338151:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.338211:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444493056 00000100:00100000:2.0:1762166857.338233:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444493056 00000100:00100000:2.0:1762166857.338287:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1177 00000100:00100000:2.0:1762166857.338297:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444493056:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.338313:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.338329:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ec6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91928 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.338382:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451988992:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166857.338470:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.339245:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451988992:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166857.339272:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ec6e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91928 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.339292:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ec6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91928 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.339303:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2800, rc 0) 00000100:00100000:2.0:1762166857.339353:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444493056:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1057us (1205us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166857.339362:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1177 00000100:00100000:3.0:1762166857.340511:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.340559:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444493184 00000100:00100000:1.0:1762166857.340566:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444493184 00000100:00100000:1.0:1762166857.340604:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 344 00000100:00100000:1.0:1762166857.340614:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49286:x1847765444493184:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.340644:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.340666:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ec75 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9192f expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.340742:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27e00/0xf915a5bdf3c9ec7c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.340753:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27e00/0xf915a5bdf3c9ec7c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x35:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.340784:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27e00/0xf915a5bdf3c9ec7c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x35:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.340819:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x35:0x0]: returning size 0 00000004:00200000:1.0:1762166857.340822:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166857.340835:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27e00/0xf915a5bdf3c9ec7c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x35:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.340853:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9ec75 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9192f expref: 52 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.340865:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27e00/0xf915a5bdf3c9ec7c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x35:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9192f expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.340870:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x35:0x0].0x0 (ffff9ee34ada3800) 00010000:00010000:1.0:1762166857.340872:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1762166857.340874:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a27e00, rc 0) 00000100:00100000:1.0:1762166857.340907:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49286:x1847765444493184:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 296us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.340911:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 344 00000100:00100000:3.0:1762166857.342097:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.342138:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444493312 00000100:00100000:2.0:1762166857.342144:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444493312 00000100:00100000:2.0:1762166857.342180:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1178 00000100:00100000:2.0:1762166857.342186:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765444493312:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.342196:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.342220:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ec83 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91936 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166857.342240:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166857.342256:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.342258:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.342264:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ec83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91936 expref: 22 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.342275:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ec83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91936 expref: 22 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.342283:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2e00, rc 0) 00000100:00100000:2.0:1762166857.342313:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444493312:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 128us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.342318:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1178 00000100:00100000:3.0:1762166857.343547:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.343593:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444493568 00000100:00100000:1.0:1762166857.343607:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444493568 00000100:00100000:1.0:1762166857.343643:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 345 00000100:00100000:1.0:1762166857.343649:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49286:x1847765444493568:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.343660:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.343673:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9ec8a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9193d expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.343818:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec91 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.343832:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec91 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.343847:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec91 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.343863:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166857.344013:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9ec8a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9193d expref: 54 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.344031:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec91 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9193d expref: 53 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.344039:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:1.0:1762166857.344042:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166857.344044:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a26800, rc 0) 00000100:00100000:1.0:1762166857.344093:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49286:x1847765444493568:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 443us (554us total) trans 8589934951 rc 0/0 00000100:00100000:1.0:1762166857.344100:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 345 00000100:00100000:3.0:1762166857.345464:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.345510:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444493696 00000100:00100000:2.0:1762166857.345516:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444493696 00000100:00100000:2.0:1762166857.345563:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1179 00000100:00100000:2.0:1762166857.345571:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444493696:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.345583:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.345598:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ec9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91944 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.345653:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451989120:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166857.345735:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.346723:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451989120:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166857.346788:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ec9f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91944 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.346812:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ec9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91944 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.346825:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2200, rc 0) 00000100:00100000:2.0:1762166857.346867:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444493696:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1296us (1406us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166857.346876:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1179 00000100:00100000:3.0:1762166857.348166:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.348209:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444493824 00000100:00100000:2.0:1762166857.348223:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444493824 00000100:00100000:2.0:1762166857.348268:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1180 00000100:00100000:2.0:1762166857.348277:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444493824:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.348292:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.348307:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9eca6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9194b expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.348349:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451989248:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166857.348414:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.349228:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451989248:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166857.349252:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9eca6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9194b expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.349268:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9eca6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9194b expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.349290:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2c00, rc 0) 00000100:00100000:2.0:1762166857.349325:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444493824:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1049us (1161us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166857.349332:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1180 00000100:00100000:3.0:1762166857.350298:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.350342:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444493952 00000100:00100000:2.0:1762166857.350347:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444493952 00000100:00100000:2.0:1762166857.350379:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1181 00000100:00100000:2.0:1762166857.350387:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444493952:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166857.350434:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecad lrc: 3/1,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.350450:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ead8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918a3 expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.350458:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166857.350461:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166857.350471:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecad lrc: 4/1,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.350499:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ead8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918a3 expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.350510:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ead8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918a3 expref: 20 pid: 26444 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.350520:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451989376:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.350566:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.351352:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451989376:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.351366:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecad lrc: 3/1,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166857.351726:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.351804:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444494080 00000100:00100000:0.0:1762166857.351810:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444494080 00010000:00010000:0.0:1762166857.351841:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ead8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918a3 expref: 21 pid: 26444 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.351872:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 790 00000100:00100000:0.0:1762166857.351880:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765444494080:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.351889:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.351910:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ead8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918a3 expref: 21 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.351922:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ead8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918a3 expref: 21 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.351949:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ead8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918a3 expref: 21 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.351979:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.351981:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.351986:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.351996:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecad lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.352020:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.352041:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.352052:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.352053:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444494080:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 173us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.352072:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 790 00010000:00010000:2.0:1762166857.352091:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.352101:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.352107:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.352112:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166857.352116:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.352123:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.352143:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.352148:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.352191:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765444493952:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 1805us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.352196:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1181 00000100:00100000:3.0:1762166857.353382:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.353437:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444494208 00000100:00100000:2.0:1762166857.353443:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444494208 00000100:00100000:2.0:1762166857.353476:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1182 00000100:00100000:2.0:1762166857.353482:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765444494208:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.353493:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.353507:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ecb4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91952 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166857.353521:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x89:0x0] initial LVB size: 0, mtime: 0x69088847, atime: 0x69088847, ctime: 0x69088849, blocks: 0x1 00010000:00010000:2.0:1762166857.353535:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.353537:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.353541:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ecb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91952 expref: 20 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.353555:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ecb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91952 expref: 20 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.353573:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2800, rc 0) 00000100:00100000:2.0:1762166857.353600:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765444494208:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 119us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.353606:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1182 00000100:00100000:2.0:1762166857.389236:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.389327:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444494336 00000100:00100000:0.0:1762166857.389339:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444494336 00000100:00100000:0.0:1762166857.389405:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 346 00000100:00100000:0.0:1762166857.389432:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49286:x1847765444494336:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:1.0:1762166857.399551:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836782 is committed 00000001:00080000:1.0:1762166857.399576:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836781 is committed 00000001:00080000:1.0:1762166857.399629:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836784 is committed 00000001:00080000:1.0:1762166857.399650:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836786 is committed 00000001:00080000:1.0:1762166857.399655:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836785 is committed 00000001:00080000:1.0:1762166857.403833:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934951 is committed 00000020:00080000:1.0:1762166857.403879:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee349c6a840 refcount 2 committed 0 result 0 batchid 4294969122 00000020:00080000:1.0:1762166857.403885:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee3436b7a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee349c6a000 00000020:00080000:1.0:1762166857.403888:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee3436b7100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee24558b400 00000020:00080000:0.0:1762166857.403916:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969122 committed batchid 4294969120 00000020:00080000:1.0:1762166857.403925:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969121 batchid updated 00000100:00100000:2.0:1762166857.403942:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49286:x1847765444494336:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 14521us (14711us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.403954:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 346 00000020:00080000:0.0:1762166857.404076:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969121 00000100:00100000:3.0:1762166857.405243:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.405297:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444494464 00000100:00100000:2.0:1762166857.405306:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444494464 00000100:00100000:2.0:1762166857.405353:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1183 00000100:00100000:2.0:1762166857.405364:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444494464:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:2.0:1762166857.405460:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444494464:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 97us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.405468:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1183 00000100:00100000:3.0:1762166857.411830:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.411897:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444494592 00000100:00100000:2.0:1762166857.411907:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444494592 00000100:00100000:2.0:1762166857.411967:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1184 00000100:00100000:2.0:1762166857.411978:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444494592:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166857.412024:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecbb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.412038:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.412040:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.412045:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecbb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.412073:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecbb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.412103:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecbb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.412111:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecbb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.412119:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.412126:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166857.412130:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.412138:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.412154:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecbb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.412161:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecbb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.412235:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444494592:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 258us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.412250:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1184 00000100:00100000:3.0:1762166857.413267:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.413312:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444494848 00000100:00100000:2.0:1762166857.413318:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444494848 00000100:00100000:2.0:1762166857.413365:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 347 00000100:00100000:2.0:1762166857.413373:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49286:x1847765444494848:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762166857.413435:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.413459:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27e00/0xf915a5bdf3c9ec7c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x35:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9192f expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.413476:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x35:0x0].0x0 (ffff9ee34ada3800) 00010000:00010000:2.0:1762166857.413487:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.413520:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ecc2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.413531:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ecc2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.413540:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ecc2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:2.0:1762166857.413712:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000edeabb56 reply state 00000000c2b6b3d5 transno 8589934952 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ecc2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166857.413721:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166857.413824:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49286:x1847765444494848:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 451us (559us total) trans 8589934952 rc 0/0 00000100:00100000:2.0:1762166857.413831:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 347 00010000:00010000:0.0:1762166857.414453:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ecc2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.414463:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ecc2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.414469:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ecc2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.414475:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.414491:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ecc2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.414498:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ecc2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.414508:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x35:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:0.0:1762166857.414511:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166857.414514:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ecc2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.414520:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ecc2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166857.414710:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.414759:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444494976 00000100:00100000:2.0:1762166857.414786:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444494976 00000100:00100000:2.0:1762166857.414831:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 348 00000100:00100000:2.0:1762166857.414841:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49286:x1847765444494976:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.414857:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.414871:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ecc9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91959 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.414909:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ecc9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91959 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.414922:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ecc9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91959 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.414935:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x35:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166857.414938:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166857.414940:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2200, rc 0) 00000100:00100000:2.0:1762166857.414980:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49286:x1847765444494976:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 141us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.414987:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 348 00000100:00100000:3.0:1762166857.416073:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.416118:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444495104 00000100:00100000:2.0:1762166857.416125:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444495104 00000100:00100000:2.0:1762166857.416166:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1185 00000100:00100000:2.0:1762166857.416174:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:49286:x1847765444495104:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.416186:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.416199:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ecd0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91960 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.416226:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ec83 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91936 expref: 12 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.416251:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.416252:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.416256:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ecd0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91960 expref: 12 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.416283:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ec83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91936 expref: 12 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.416293:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ec83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91936 expref: 12 pid: 26444 timeout: 578 lvb_type: 1 00000100:00100000:2.0:1762166857.416306:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451989504:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.416380:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c360c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.417256:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451989504:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.417280:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ecd0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91960 expref: 12 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.417290:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2600, rc 0) 00000100:00100000:2.0:1762166857.417327:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:49286:x1847765444495104:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1154us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.417335:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1185 00000100:00100000:3.0:1762166857.417882:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.417918:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444495232 00000100:00100000:0.0:1762166857.417925:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444495232 00010000:00010000:0.0:1762166857.417951:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ec83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91936 expref: 12 pid: 26444 timeout: 578 lvb_type: 1 00000100:00100000:0.0:1762166857.417983:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 791 00000100:00100000:0.0:1762166857.417992:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444495232:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.418004:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.418022:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ec83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91936 expref: 12 pid: 26444 timeout: 578 lvb_type: 1 00010000:00010000:0.0:1762166857.418034:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ec83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91936 expref: 12 pid: 26444 timeout: 578 lvb_type: 1 00010000:00010000:0.0:1762166857.418053:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ec83 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91936 expref: 12 pid: 26444 timeout: 578 lvb_type: 1 00010000:00010000:0.0:1762166857.418085:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.418086:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.418090:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ecd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91960 expref: 11 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.418097:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ecd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91960 expref: 11 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.418117:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ecd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91960 expref: 11 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.418125:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e629180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765451989632:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762166857.418170:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.419013:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e629180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765451989632:192.168.203.35@tcp:105: 00010000:00010000:0.0:1762166857.419026:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166857.419072:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444495232:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1080us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.419081:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 791 00000100:00100000:3.0:1762166857.419223:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.419262:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444495360 00000100:00100000:2.0:1762166857.419267:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444495360 00000100:00100000:2.0:1762166857.419298:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1186 00000100:00100000:2.0:1762166857.419304:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765444495360:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166857.419563:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x8a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166857.419565:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x8a:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:2.0:1762166857.419567:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x8a:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:2.0:1762166857.419568:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x8a:0x0] updating lvb ctime from disk: 0 -> 1762166857 00002000:00010000:2.0:1762166857.419570:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x8a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166857.419604:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444495360:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 299us (381us total) trans 21474836787 rc 0/0 00000100:00100000:2.0:1762166857.419613:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1186 00000100:00100000:1.0:1762166857.420728:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.420814:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444495616 00000100:00100000:2.0:1762166857.420822:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444495616 00000100:00100000:2.0:1762166857.420873:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 349 00000100:00100000:2.0:1762166857.420882:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49286:x1847765444495616:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762166857.420928:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.420949:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ec67 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91921 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.420962:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:2.0:1762166857.420965:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.421011:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecd7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.421024:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecd7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.421033:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecd7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:2.0:1762166857.421137:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000085407c76 reply state 00000000e81c31b1 transno 8589934953 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecd7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166857.421159:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166857.421225:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49286:x1847765444495616:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 344us (500us total) trans 8589934953 rc 0/0 00000100:00100000:2.0:1762166857.421232:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 349 00010000:00010000:2.0:1762166857.421834:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecd7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.421845:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecd7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.421851:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecd7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.421857:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.421861:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecd7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.421868:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecd7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.421878:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:2.0:1762166857.421882:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.421886:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecd7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.421891:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecd7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166857.422151:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.422193:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444495744 00000100:00100000:2.0:1762166857.422199:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444495744 00000100:00100000:2.0:1762166857.422242:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1187 00000100:00100000:2.0:1762166857.422251:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:49286:x1847765444495744:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.422268:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.422281:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ecde lrc: 2/0,0 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91967 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.422303:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ecb4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91952 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.422310:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.422312:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.422315:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ecde lrc: 4/0,0 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91967 expref: 21 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.422344:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ecb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91952 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.422357:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ecb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91952 expref: 21 pid: 26444 timeout: 578 lvb_type: 1 00000100:00100000:2.0:1762166857.422370:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451989760:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.422442:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c360c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.423345:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451989760:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.423372:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ecde lrc: 3/0,0 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91967 expref: 21 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.423388:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3000, rc 0) 00000100:00100000:2.0:1762166857.423446:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:49286:x1847765444495744:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1195us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.423463:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1187 00000100:00100000:1.0:1762166857.423597:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.423644:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444495872 00000100:00100000:0.0:1762166857.423652:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444495872 00010000:00010000:0.0:1762166857.423678:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ecb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91952 expref: 21 pid: 26444 timeout: 578 lvb_type: 1 00000100:00100000:0.0:1762166857.423729:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 792 00000100:00100000:0.0:1762166857.423740:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765444495872:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.423782:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.423818:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ecb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91952 expref: 21 pid: 26444 timeout: 578 lvb_type: 1 00010000:00010000:0.0:1762166857.423832:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ecb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91952 expref: 21 pid: 26444 timeout: 578 lvb_type: 1 00010000:00010000:0.0:1762166857.423854:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ecb4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91952 expref: 21 pid: 26444 timeout: 578 lvb_type: 1 00010000:00010000:0.0:1762166857.423872:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.423874:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.423879:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ecde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91967 expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.423890:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ecde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91967 expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.423920:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ecde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91967 expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.423933:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e629180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765451989888:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762166857.423991:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.424859:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e629180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765451989888:192.168.203.35@tcp:105: 00010000:00010000:0.0:1762166857.424872:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166857.424908:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444495872:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1167us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.424920:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 792 00000100:00100000:3.0:1762166857.425123:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.425170:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444496000 00000100:00100000:2.0:1762166857.425175:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444496000 00000100:00100000:2.0:1762166857.425213:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1188 00000100:00100000:2.0:1762166857.425220:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444496000:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166857.425372:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x89:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166857.425375:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x89:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:2.0:1762166857.425378:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x89:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:2.0:1762166857.425380:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x89:0x0] updating lvb ctime from disk: 1762166857 -> 1762166857 00002000:00010000:2.0:1762166857.425382:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x89:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166857.425414:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765444496000:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 194us (291us total) trans 17179869458 rc 0/0 00000100:00100000:2.0:1762166857.425434:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1188 00000100:00100000:1.0:1762166857.426620:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.426676:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444496256 00000100:00100000:2.0:1762166857.426682:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444496256 00000100:00100000:2.0:1762166857.426720:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 142 00000100:00100000:2.0:1762166857.426728:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348210850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49286:x1847765444496256:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166857.426836:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec91 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9193d expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.426869:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ece5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.426882:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9ebbf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918e9 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.426907:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ec0c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918fe expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.426921:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ece5 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.426953:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ec0c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918fe expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.426966:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ec0c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918fe expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.426979:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451990016:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.427050:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9ebbf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918e9 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.427060:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9ebbf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918e9 expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.427070:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451990144:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.427096:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.428333:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451990016:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.428353:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451990144:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.428384:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ece5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166857.428505:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.428554:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.428636:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444496512 00000100:00100000:0.0:1762166857.428644:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444496512 00000100:00100000:3.0:1762166857.428670:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444496640 00000100:00100000:3.0:1762166857.428681:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444496640 00000100:00100000:0.0:1762166857.428702:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 143 00000100:00100000:0.0:1762166857.428719:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:37763:x1847765444496512:12345-192.168.203.35@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1762166857.428731:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9ebbf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918e9 expref: 29 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:3.0:1762166857.428814:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 793 00000100:00100000:3.0:1762166857.428829:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765444496640:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166857.428847:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.428855:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9ebbf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918e9 expref: 29 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166857.428868:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9ebbf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918e9 expref: 29 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166857.428896:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9ebbf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918e9 expref: 30 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166857.428918:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:3.0:1762166857.428924:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ece5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166857.428948:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ece5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166857.428954:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166857.428992:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:37763:x1847765444496512:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 275us (485us total) trans 8589934954 rc 0/0 00000100:00100000:3.0:1762166857.429005:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765444496640:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 174us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.429018:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 143 00000100:00100000:3.0:1762166857.429030:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 793 00000100:00100000:3.0:1762166857.430203:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.430250:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444496768 00000100:00100000:0.0:1762166857.430258:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444496768 00010000:00010000:0.0:1762166857.430281:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ec0c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918fe expref: 28 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.430309:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 794 00000100:00100000:0.0:1762166857.430315:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444496768:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.430325:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.430329:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ec0c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918fe expref: 28 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.430338:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ec0c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918fe expref: 28 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.430353:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9ec0c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918fe expref: 28 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.430365:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:0.0:1762166857.430378:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ece5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.430385:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ece5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.430390:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ece5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.430410:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.430452:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ece5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.430452:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444496768:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 136us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.430466:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 794 00010000:00010000:2.0:1762166857.430469:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ece5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.430490:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ecec lrc: 3/0,1 mode: --/EX res: [0x200000404:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.430502:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ecc9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91959 expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.430511:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ecec lrc: 4/0,1 mode: --/EX res: [0x200000404:0x35:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.430538:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ecc9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91959 expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.430551:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ecc9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91959 expref: 26 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.430564:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451990272:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.430623:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.431606:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451990272:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.431625:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ecec lrc: 3/0,1 mode: --/EX res: [0x200000404:0x35:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166857.431979:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.432100:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444496896 00000100:00100000:0.0:1762166857.432108:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444496896 00010000:00010000:0.0:1762166857.432134:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ecc9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91959 expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.432165:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 795 00000100:00100000:0.0:1762166857.432173:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444496896:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.432184:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.432189:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ecc9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91959 expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.432200:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ecc9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91959 expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.432215:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ecc9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91959 expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.432240:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x35:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:0.0:1762166857.432244:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ecec lrc: 3/0,1 mode: --/EX res: [0x200000404:0x35:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.432252:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ecec lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x35:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.432258:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ecec lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x35:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.432286:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166857.432335:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444496896:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 162us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.432343:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 795 00010000:00010000:2.0:1762166857.432356:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ecec lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.432376:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ecec lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166857.432839:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451990400:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166857.432898:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166857.432943:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36f00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.433003:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451990400 00000100:00100000:3.0:1762166857.433008:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451990400 00000100:00100000:3.0:1762166857.433042:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1762166857.433051:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:31351:x1847765451990400:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166857.433123:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:31351:x1847765451990400:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 73us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.433130:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1762166857.433158:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451990400:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166857.433199:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451990528:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166857.433223:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166857.433245:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f48e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.433257:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451990528 00000100:00100000:3.0:1762166857.433262:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451990528 00000100:00100000:3.0:1762166857.433289:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1762166857.433296:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:31351:x1847765451990528:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166857.433348:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:31351:x1847765451990528:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 52us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.433355:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1762166857.433375:0:31351:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836785 gen 2 00000004:00080000:2.0:1762166857.433381:0:31351:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836767 committed transno 21474836785 00000004:00080000:2.0:1762166857.433407:0:31351:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de00380, transno 21474836768 00000004:00080000:2.0:1762166857.433431:0:31351:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836770 committed transno 21474836785 00000004:00080000:2.0:1762166857.433440:0:31351:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836773 committed transno 21474836785 00000004:00080000:2.0:1762166857.433450:0:31351:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836776 committed transno 21474836785 00000004:00080000:2.0:1762166857.433473:0:31351:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b1180, transno 21474836778 00000004:00080000:2.0:1762166857.433477:0:31351:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee3819b9500, transno 21474836779 00000004:00080000:2.0:1762166857.433480:0:31351:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee3819bb100, transno 21474836780 00000004:00080000:2.0:1762166857.433484:0:31351:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836782 committed transno 21474836785 00000004:00080000:2.0:1762166857.433493:0:31351:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836785 committed transno 21474836785 00000100:00100000:2.0:1762166857.433504:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451990528:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166857.433661:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934955 00000100:00100000:2.0:1762166857.433718:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451990656:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166857.433744:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166857.433802:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee35011d780 going to sleep for 11 seconds 00000004:00080000:1.0:1762166857.433804:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:3.0:1762166857.433934:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451990656 00000100:00100000:3.0:1762166857.433939:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451990656 00000100:00100000:3.0:1762166857.433972:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1762166857.433979:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:31351:x1847765451990656:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166857.434104:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:31351:x1847765451990656:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 126us (359us total) trans 21474836788 rc 0/0 00000100:00100000:3.0:1762166857.434112:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1762166857.434135:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451990656:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166857.434197:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934956 00010000:00010000:2.0:1762166857.434219:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ecec lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.434228:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ecec lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.434234:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ecec lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.434239:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.434243:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ecec lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.434250:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ecec lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.434261:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x35:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166857.434264:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166857.434268:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ecec lrc: 2/0,0 mode: --/EX res: [0x200000404:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.434274:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ecec lrc: 0/0,0 mode: --/EX res: [0x200000404:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.434289:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ece5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.434295:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ece5 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.434300:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ece5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.434313:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.434316:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ece5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.434321:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ece5 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.434328:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:2.0:1762166857.434331:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166857.434334:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ece5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.434339:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ece5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.434348:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3f00) 00010000:00010000:2.0:1762166857.434350:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166857.434355:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9ec91 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9193d expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.434434:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348210850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49286:x1847765444496256:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 7706us (7815us total) trans 8589934957 rc 0/0 00000100:00100000:2.0:1762166857.434443:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 142 00000020:00080000:2.0:1762166857.434447:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166857.435612:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.435668:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444497024 00000100:00100000:2.0:1762166857.435677:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444497024 00000100:00100000:2.0:1762166857.435727:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 350 00000100:00100000:2.0:1762166857.435735:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49286:x1847765444497024:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.435751:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.435801:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecf3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9196e expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.435848:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecf3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9196e expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.435861:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecf3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9196e expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.435876:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:2.0:1762166857.435879:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166857.435882:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2400, rc 0) 00000100:00100000:2.0:1762166857.435922:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49286:x1847765444497024:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 187us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.435938:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 350 00000100:00100000:3.0:1762166857.437278:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.437320:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444497280 00000100:00100000:2.0:1762166857.437327:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444497280 00000100:00100000:2.0:1762166857.437367:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 144 00000100:00100000:2.0:1762166857.437378:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49286:x1847765444497280:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166857.437576:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49286:x1847765444497280:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 200us (300us total) trans 8589934958 rc 0/0 00000100:00100000:2.0:1762166857.437584:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 144 00000100:00100000:3.0:1762166857.438595:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.438639:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444497536 00000100:00100000:2.0:1762166857.438644:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444497536 00000100:00100000:2.0:1762166857.438681:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 145 00000100:00100000:2.0:1762166857.438690:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49286:x1847765444497536:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762166857.438951:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x35:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1762166857.439070:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ecfa lrc: 3/0,1 mode: --/PW res: [0x200000404:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.439085:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ecfa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.439096:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ecfa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.439109:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ecfa lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.439116:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ecfa lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.439122:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ecfa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.439141:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166857.439172:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166857.439181:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ecfa lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166857.439189:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166857.439194:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ecfa lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166857.439202:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ecfa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166857.439215:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x35:0x0].0x0 (ffff9ee359d01700) 00010000:00010000:3.0:1762166857.439218:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166857.439223:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ecfa lrc: 1/0,0 mode: --/PW res: [0x200000404:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166857.439226:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49286:x1847765444497536:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 535us (630us total) trans 8589934959 rc 0/0 00010000:00010000:3.0:1762166857.439232:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ecfa lrc: 0/0,0 mode: --/PW res: [0x200000404:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166857.439239:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 145 00010000:00010000:3.0:1762166857.439259:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166857.439262:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166857.439265:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166857.447386:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.447475:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444497664 00000100:00100000:2.0:1762166857.447484:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444497664 00000100:00100000:2.0:1762166857.447542:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 351 00000100:00100000:2.0:1762166857.447549:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49288:x1847765444497664:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166857.447568:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.447584:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ed01 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91975 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.447652:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed08 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447689:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed08 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447698:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed08 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447708:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed0f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447712:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447716:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447840:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed16 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447848:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed16 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447854:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed16 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.447885:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166857.447889:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166857.447904:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed16 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447912:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed16 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447918:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed08 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447929:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed08 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447933:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed08 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447937:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.447939:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed08 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447944:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed08 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447953:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166857.447956:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.447961:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed08 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447966:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed08 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447979:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447985:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed0f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447990:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed0f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.447995:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.447998:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed0f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.448008:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed0f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.448013:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01800) 00010000:00010000:2.0:1762166857.448015:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.448017:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed0f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.448020:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed0f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.448041:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ed01 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91975 expref: 32 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.448049:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed16 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91975 expref: 31 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.448053:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:2.0:1762166857.448055:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166857.448056:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3a00, rc 0) 00000100:00100000:2.0:1762166857.448115:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49288:x1847765444497664:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 566us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.448120:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 351 00000100:00100000:0.0:1762166857.461322:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.461390:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444497792 00000100:00100000:2.0:1762166857.461400:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444497792 00000100:00100000:2.0:1762166857.461470:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 352 00000100:00100000:2.0:1762166857.461480:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49292:x1847765444497792:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166857.461550:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ed1d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461575:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ed1d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461587:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ed1d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461601:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed24 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461608:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461614:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461707:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed2b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461714:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed2b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461721:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed2b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.461749:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166857.461752:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166857.461790:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed2b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461802:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ed1d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461808:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ed1d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461823:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ed1d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461829:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.461834:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ed1d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461842:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ed1d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461863:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166857.461870:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.461875:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ed1d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461881:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ed1d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461897:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461902:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed24 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461908:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed24 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461912:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.461915:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed24 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461920:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed24 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461932:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01800) 00010000:00010000:2.0:1762166857.461935:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.461937:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed24 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461943:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed24 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461956:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed2b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461962:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed2b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461967:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed2b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461972:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.461974:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed2b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461979:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed2b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461985:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:2.0:1762166857.461987:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.461990:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed2b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.461995:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed2b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166857.462067:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49292:x1847765444497792:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 588us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.462079:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 352 00000100:00100000:3.0:1762166857.472613:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.472675:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444498048 00000100:00100000:2.0:1762166857.472689:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444498048 00000100:00100000:2.0:1762166857.472749:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 353 00000100:00100000:2.0:1762166857.472759:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49294:x1847765444498048:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.472802:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.472821:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed32 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9197c expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.472911:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed39 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.472925:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed39 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.472936:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed39 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.472947:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166857.473056:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed32 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9197c expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.473074:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed39 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9197c expref: 33 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.473083:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:2.0:1762166857.473086:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166857.473090:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2c00, rc 0) 00000100:00100000:2.0:1762166857.473148:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49294:x1847765444498048:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 391us (544us total) trans 8589934960 rc 0/0 00000100:00100000:2.0:1762166857.473168:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 353 00000100:00100000:1.0:1762166857.475917:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.475991:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444498304 00000100:00100000:2.0:1762166857.476003:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444498304 00000100:00100000:2.0:1762166857.476053:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 354 00000100:00100000:2.0:1762166857.476063:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49294:x1847765444498304:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.476083:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.476099:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ed47 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91983 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.476169:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed4e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.476184:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed16 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91975 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.476192:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed4e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.476223:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed16 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91975 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.476235:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed16 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91975 expref: 34 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.476249:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451990784:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.476326:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.477371:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451990784:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.477390:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed4e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166857.478101:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.478187:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444498432 00000100:00100000:0.0:1762166857.478195:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444498432 00010000:00010000:0.0:1762166857.478225:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed16 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91975 expref: 35 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.478265:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 796 00000100:00100000:0.0:1762166857.478274:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444498432:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.478288:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.478295:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed16 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91975 expref: 35 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.478306:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed16 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91975 expref: 35 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.478338:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed16 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91975 expref: 35 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.478353:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:0.0:1762166857.478357:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed4e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.478365:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed4e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.478372:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed4e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.478400:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166857.478458:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed4e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166857.478470:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765444498432:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 193us (371us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166857.478477:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed4e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166857.478487:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 796 00000004:00200000:1.0:1762166857.478514:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166857.478702:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ed47 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91983 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.478739:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed4e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91983 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.478748:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:1.0:1762166857.478752:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166857.478756:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3c00, rc 0) 00000100:00100000:1.0:1762166857.478874:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49294:x1847765444498304:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2812us (2969us total) trans 8589934961 rc 0/0 00000100:00100000:1.0:1762166857.478885:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 354 00000100:00100000:1.0:1762166857.480431:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.480596:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444498560 00000100:00100000:2.0:1762166857.480605:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444498560 00000100:00100000:2.0:1762166857.480656:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 146 00000100:00100000:2.0:1762166857.480666:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49294:x1847765444498560:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:2.0:1762166857.480844:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49294:x1847765444498560:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 175us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.480854:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 146 00000100:00100000:0.0:1762166857.482019:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.482079:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444498816 00000100:00100000:2.0:1762166857.482087:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444498816 00000100:00100000:2.0:1762166857.482131:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 147 00000100:00100000:2.0:1762166857.482140:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49294:x1847765444498816:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166857.482333:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49294:x1847765444498816:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 193us (322us total) trans 8589934962 rc 0/0 00000100:00100000:2.0:1762166857.482342:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 147 00000100:00100000:3.0:1762166857.483527:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.483589:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444499072 00000100:00100000:1.0:1762166857.483599:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444499072 00000100:00100000:1.0:1762166857.483653:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 355 00000100:00100000:1.0:1762166857.483663:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49294:x1847765444499072:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166857.483684:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166857.483687:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1762166857.483715:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed4e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91983 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.483736:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed39 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9197c expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.483744:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:1.0:1762166857.483747:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166857.483759:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9ed5c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9198a expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.483888:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9ed63 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.483899:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9ed63 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166857.483907:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9ed63 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166857.483916:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166857.484031:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9ed5c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9198a expref: 36 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.484045:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9ed63 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9198a expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.484052:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:1.0:1762166857.484055:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166857.484058:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a27400, rc 0) 00000100:00100000:1.0:1762166857.484103:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49294:x1847765444499072:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 443us (582us total) trans 8589934963 rc 0/0 00000100:00100000:1.0:1762166857.484109:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 355 00000100:00100000:1.0:1762166857.485348:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.485452:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444499328 00000100:00100000:2.0:1762166857.485461:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444499328 00000100:00100000:2.0:1762166857.485508:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 148 00000100:00100000:2.0:1762166857.485517:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348210450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49294:x1847765444499328:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166857.485575:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9ed63 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9198a expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.485612:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed71 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.485624:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecf3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9196e expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.485648:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed71 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.485682:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecf3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9196e expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.485696:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecf3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9196e expref: 35 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.485709:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451990912:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.485839:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.486817:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451990912:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.486841:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed71 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166857.487147:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.487283:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444499456 00000100:00100000:0.0:1762166857.487291:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444499456 00010000:00010000:0.0:1762166857.487323:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecf3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9196e expref: 36 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.487365:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 797 00000100:00100000:0.0:1762166857.487375:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765444499456:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.487392:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.487399:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecf3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9196e expref: 36 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.487444:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecf3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9196e expref: 36 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.487463:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ecf3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9196e expref: 36 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.487479:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:0.0:1762166857.487484:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed71 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.487493:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed71 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.487501:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed71 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.487526:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.487553:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed71 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.487563:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed71 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.487575:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444499456:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 201us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.487585:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 797 00010000:00010000:2.0:1762166857.487936:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed71 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.487945:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed71 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.487951:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed71 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.487969:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.487973:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed71 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.487981:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed71 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.487990:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:2.0:1762166857.487993:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166857.487997:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed71 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.488002:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed71 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.488013:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:2.0:1762166857.488015:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166857.488020:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9ed63 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9198a expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.488143:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348210450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49294:x1847765444499328:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2626us (2802us total) trans 8589934964 rc -22/-22 00000100:00100000:2.0:1762166857.488152:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 148 00000100:00100000:1.0:1762166857.489304:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.489379:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444499584 00000100:00100000:2.0:1762166857.489390:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444499584 00000100:00100000:2.0:1762166857.489467:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 356 00000100:00100000:2.0:1762166857.489479:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49294:x1847765444499584:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.489507:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.489533:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ed78 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91991 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.489627:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ed78 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91991 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.489644:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ed78 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91991 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.489664:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166857.489668:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166857.489672:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3400, rc 0) 00000100:00100000:2.0:1762166857.489738:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49294:x1847765444499584:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 262us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.489746:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 356 00000100:00100000:0.0:1762166857.492048:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.492137:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444499840 00000100:00100000:2.0:1762166857.492147:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444499840 00000100:00100000:2.0:1762166857.492201:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 357 00000100:00100000:2.0:1762166857.492212:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49294:x1847765444499840:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.492230:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.492256:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed7f lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91998 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.492796:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed86 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.492811:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed86 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.492822:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed86 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.492852:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x36:0x0]: returning size 0 00010000:00010000:2.0:1762166857.492894:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ed7f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91998 expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.492913:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed86 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91998 expref: 37 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.492921:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x36:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166857.492923:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166857.492926:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3c00, rc 0) 00000100:00100000:2.0:1762166857.492984:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49294:x1847765444499840:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 775us (944us total) trans 8589934965 rc 0/0 00000100:00100000:2.0:1762166857.492990:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 357 00000100:00100000:3.0:1762166857.494723:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.494875:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444500096 00000100:00100000:2.0:1762166857.494883:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444500096 00000100:00100000:2.0:1762166857.494933:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 358 00000100:00100000:2.0:1762166857.494943:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49294:x1847765444500096:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.494961:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.494975:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed94 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9199f expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.495047:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed9b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.495058:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed9b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.495067:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed9b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.495086:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166857.495176:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ed94 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9199f expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.495191:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed9b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9199f expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.495199:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166857.495202:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166857.495205:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3a00, rc 0) 00000100:00100000:2.0:1762166857.495246:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49294:x1847765444500096:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 306us (527us total) trans 8589934966 rc 0/0 00000100:00100000:2.0:1762166857.495253:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 358 00000100:00100000:1.0:1762166857.496476:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.496543:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444500352 00000100:00100000:2.0:1762166857.496554:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444500352 00000100:00100000:2.0:1762166857.496610:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 149 00000100:00100000:2.0:1762166857.496621:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49294:x1847765444500352:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166857.496704:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed9b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9199f expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.496747:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eda9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.496759:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ed78 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91991 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.496799:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eda9 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.496857:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ed78 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91991 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.496871:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ed78 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91991 expref: 39 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.496886:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451991040:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.496980:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3469ca900 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.498148:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451991040:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.498175:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eda9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166857.498461:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.498553:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444500480 00000100:00100000:0.0:1762166857.498560:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444500480 00010000:00010000:0.0:1762166857.498592:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ed78 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91991 expref: 40 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.498630:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 798 00000100:00100000:0.0:1762166857.498640:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2360:x1847765444500480:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.498665:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.498673:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ed78 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91991 expref: 40 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.498685:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ed78 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91991 expref: 40 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.498703:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ed78 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91991 expref: 40 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.498717:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:0.0:1762166857.498721:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eda9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.498727:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eda9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.498732:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eda9 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.498758:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.498811:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eda9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.498819:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eda9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.498835:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9edb0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.498843:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444500480:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 203us (385us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166857.498846:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed86 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91998 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.498857:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9edb0 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.498861:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 798 00010000:00010000:2.0:1762166857.498885:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed86 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91998 expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.498909:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed86 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91998 expref: 38 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.498922:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451991168:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.498971:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3469ca900 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.499798:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451991168:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.499818:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9edb0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166857.500284:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.500342:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444500608 00000100:00100000:0.0:1762166857.500354:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444500608 00010000:00010000:0.0:1762166857.500375:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed86 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91998 expref: 39 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.500397:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 799 00000100:00100000:0.0:1762166857.500414:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444500608:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.500435:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.500440:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed86 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91998 expref: 39 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.500448:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed86 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91998 expref: 39 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.500460:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ed86 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91998 expref: 39 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.500479:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x36:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:0.0:1762166857.500482:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9edb0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.500488:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9edb0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.500492:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9edb0 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.500507:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.500529:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9edb0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x36:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.500539:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9edb0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x36:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.500540:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2360:x1847765444500608:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 127us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.500554:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 799 00000100:00100000:2.0:1762166857.501113:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451991296:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166857.501161:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166857.501192:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463e600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.501206:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451991296 00000100:00100000:0.0:1762166857.501210:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451991296 00000100:00100000:0.0:1762166857.501241:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1762166857.501246:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:31351:x1847765451991296:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166857.501328:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:31351:x1847765451991296:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 80us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.501344:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1762166857.501361:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451991296:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166857.501406:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934967 00000001:00080000:2.0:1762166857.501480:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934968 00010000:00010000:2.0:1762166857.501501:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9edb0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x36:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.501510:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9edb0 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x36:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.501517:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9edb0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x36:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.501530:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.501535:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9edb0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x36:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.501544:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9edb0 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x36:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.501555:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x36:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166857.501558:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166857.501562:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9edb0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x36:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.501568:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9edb0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x36:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.501589:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eda9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.501594:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eda9 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.501599:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eda9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.501604:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.501607:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eda9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.501613:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eda9 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.501620:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166857.501623:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166857.501631:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eda9 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.501637:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9eda9 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.501649:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166857.501651:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166857.501656:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ed9b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9199f expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.501737:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49294:x1847765444500352:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 5118us (5279us total) trans 8589934969 rc 0/0 00000100:00100000:2.0:1762166857.501747:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 149 00000020:00080000:2.0:1762166857.501751:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166857.502839:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.502895:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444500736 00000100:00100000:3.0:1762166857.502913:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444500736 00000100:00100000:3.0:1762166857.502970:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 359 00000100:00100000:3.0:1762166857.502985:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49294:x1847765444500736:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166857.503005:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.503024:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9edb7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f919a6 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.503077:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9edb7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919a6 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.503091:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9edb7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919a6 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.503108:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960200) 00010000:00010000:3.0:1762166857.503111:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166857.503114:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216ca00, rc 0) 00000100:00100000:3.0:1762166857.503164:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49294:x1847765444500736:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 184us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.503169:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 359 00000100:00100000:0.0:1762166857.504733:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.504833:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444500992 00000100:00100000:2.0:1762166857.504840:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444500992 00000100:00100000:2.0:1762166857.504900:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 150 00000100:00100000:2.0:1762166857.504911:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49294:x1847765444500992:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762166857.505345:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x36:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166857.505459:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].15, 64 off9344 00000001:00080000:2.0:1762166857.505469:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934970 00010000:00010000:2.0:1762166857.505513:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9edbe lrc: 3/0,1 mode: --/PW res: [0x200000404:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.505526:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9edbe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.505538:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9edbe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.505547:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9edbe lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.505565:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9edbe lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.505571:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9edbe lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.505590:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166857.505631:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166857.505641:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9edbe lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166857.505651:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166857.505656:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9edbe lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166857.505665:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9edbe lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166857.505688:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x36:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:3.0:1762166857.505691:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166857.505695:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9edbe lrc: 1/0,0 mode: --/PW res: [0x200000404:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166857.505701:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9edbe lrc: 0/0,0 mode: --/PW res: [0x200000404:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166857.505709:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49294:x1847765444500992:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 799us (979us total) trans 8589934971 rc 0/0 00000100:00100000:2.0:1762166857.505720:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 150 00010000:00010000:3.0:1762166857.505721:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166857.505724:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166857.505726:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1762166857.505727:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166857.506851:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.506902:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444501248 00000100:00100000:0.0:1762166857.506910:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444501248 00000100:00100000:0.0:1762166857.506963:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 151 00000100:00100000:0.0:1762166857.506974:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49294:x1847765444501248:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166857.507192:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49294:x1847765444501248:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 220us (342us total) trans 8589934972 rc 0/0 00000100:00100000:0.0:1762166857.507201:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 151 00000100:00100000:1.0:1762166857.515592:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.515646:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444501376 00000100:00100000:3.0:1762166857.515658:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444501376 00000100:00100000:3.0:1762166857.515709:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 360 00000100:00100000:3.0:1762166857.515719:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49296:x1847765444501376:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:3.0:1762166857.515741:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.515758:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9edc5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f919ad expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.515837:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edcc lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.515850:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edcc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.515860:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edcc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.515872:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edd3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.515894:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edd3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.515901:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edd3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516001:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9edda lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516010:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9edda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516016:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9edda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762166857.516044:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:3.0:1762166857.516048:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166857.516063:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9edda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516073:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9edda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516081:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edcc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516086:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edcc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516093:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edcc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516098:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216d000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166857.516102:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edcc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516115:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edcc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516126:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:3.0:1762166857.516129:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166857.516133:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edcc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516138:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edcc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516149:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edd3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516155:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edd3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516160:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edd3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516164:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166857.516167:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edd3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516172:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edd3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516178:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee363960d00) 00010000:00010000:3.0:1762166857.516180:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166857.516183:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edd3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516188:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edd3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.516221:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9edc5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919ad expref: 45 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.516233:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9edda lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919ad expref: 44 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.516240:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960200) 00010000:00010000:3.0:1762166857.516242:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166857.516244:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216c400, rc 0) 00000100:00100000:3.0:1762166857.516300:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49296:x1847765444501376:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 582us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.516307:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 360 00000100:00100000:0.0:1762166857.517991:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.518033:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444501504 00000100:00100000:2.0:1762166857.518038:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444501504 00000100:00100000:2.0:1762166857.518071:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1189 00000100:00100000:2.0:1762166857.518077:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444501504:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166857.518086:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.518097:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ede1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f919b4 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.518136:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451991424:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166857.518188:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.519078:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451991424:192.168.203.35@tcp:106: 00010000:00010000:3.0:1762166857.519098:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ede1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919b4 expref: 13 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166857.519115:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ede1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919b4 expref: 13 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166857.519126:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3e00, rc 0) 00000100:00100000:3.0:1762166857.519162:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444501504:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 1084us (1180us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166857.519170:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1189 00000100:00100000:1.0:1762166857.531299:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.531351:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444501632 00000100:00100000:3.0:1762166857.531359:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444501632 00000100:00100000:3.0:1762166857.531415:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 361 00000100:00100000:3.0:1762166857.531434:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49300:x1847765444501632:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:3.0:1762166857.531498:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9ede8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531515:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9ede8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531527:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9ede8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531541:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edef lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531547:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531553:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531661:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edf6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531669:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edf6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531675:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edf6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762166857.531705:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:3.0:1762166857.531708:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166857.531719:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edf6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531730:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9ede8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531742:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9ede8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531749:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9ede8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531754:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166857.531758:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9ede8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531787:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9ede8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531796:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:3.0:1762166857.531799:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166857.531803:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9ede8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531807:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9ede8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531819:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531823:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edef lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531828:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531831:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166857.531833:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531844:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edef lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531849:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee363960d00) 00010000:00010000:3.0:1762166857.531850:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166857.531852:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edef lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531855:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9edef lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531866:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edf6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531869:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edf6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531873:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edf6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531876:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216d000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166857.531877:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edf6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531881:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edf6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531886:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960200) 00010000:00010000:3.0:1762166857.531888:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166857.531890:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edf6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.531895:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edf6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166857.531970:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49300:x1847765444501632:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 537us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.531979:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 361 00000100:00100000:0.0:1762166857.541601:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.541648:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444501888 00000100:00100000:3.0:1762166857.541657:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444501888 00000100:00100000:3.0:1762166857.541706:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 362 00000100:00100000:3.0:1762166857.541716:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49302:x1847765444501888:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166857.541735:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.541752:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edfd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f919bb expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.541845:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9ee04 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.541855:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9ee04 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.541861:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9ee04 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762166857.541869:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:3.0:1762166857.541961:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9edfd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919bb expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.541974:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9ee04 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919bb expref: 46 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.541980:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960200) 00010000:00010000:3.0:1762166857.541982:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166857.541996:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216cc00, rc 0) 00000100:00100000:3.0:1762166857.542040:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49302:x1847765444501888:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 327us (447us total) trans 8589934973 rc 0/0 00000100:00100000:3.0:1762166857.542046:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 362 00000100:00100000:2.0:1762166857.543727:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.543803:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444502016 00000100:00100000:3.0:1762166857.543810:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444502016 00000100:00100000:3.0:1762166857.543856:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1190 00000100:00100000:3.0:1762166857.543865:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2359:x1847765444502016:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166857.543879:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.543891:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9ee12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f919c2 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166857.543939:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451991552:192.168.203.35@tcp:106: 00000100:00100000:3.0:1762166857.544013:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.545528:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451991552:192.168.203.35@tcp:106: 00010000:00010000:3.0:1762166857.545557:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9ee12 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919c2 expref: 13 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166857.545575:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9ee12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919c2 expref: 13 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166857.545588:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216d400, rc 0) 00000100:00100000:3.0:1762166857.545635:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2359:x1847765444502016:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1770us (1912us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166857.545643:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1190 00000100:00100000:0.0:1762166857.547411:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.547469:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444502272 00000100:00100000:3.0:1762166857.547490:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444502272 00000100:00100000:3.0:1762166857.547542:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 363 00000100:00100000:3.0:1762166857.547553:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49302:x1847765444502272:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166857.547573:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.547593:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9ee19 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f919c9 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.547679:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9ee20 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.547693:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9edda lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919ad expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.547701:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9ee20 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.547730:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9edda lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919ad expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.547743:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9edda lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919ad expref: 47 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:3.0:1762166857.547757:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247ad5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451991680:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166857.547851:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.549111:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247ad5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451991680:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166857.549132:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9ee20 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166857.549150:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.549181:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444502400 00000100:00100000:3.0:1762166857.549195:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444502400 00010000:00010000:3.0:1762166857.549257:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9edda lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919ad expref: 48 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:3.0:1762166857.549289:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 800 00000100:00100000:3.0:1762166857.549295:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2360:x1847765444502400:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166857.549307:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.549313:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9edda lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919ad expref: 48 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166857.549326:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9edda lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919ad expref: 48 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166857.549343:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9edda lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919ad expref: 48 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166857.549365:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960200) 00010000:00010000:3.0:1762166857.549369:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9ee20 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.549377:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9ee20 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.549384:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9ee20 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.549413:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.549451:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9ee20 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.549461:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9ee20 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166857.549470:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:2360:x1847765444502400:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 173us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.549487:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 800 00000004:00200000:2.0:1762166857.549492:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166857.549617:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9ee19 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919c9 expref: 48 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.549633:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9ee20 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919c9 expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.549639:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960200) 00010000:00010000:2.0:1762166857.549642:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166857.549645:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382045c00, rc 0) 00000100:00100000:2.0:1762166857.549676:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49302:x1847765444502272:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2126us (2271us total) trans 8589934974 rc 0/0 00000100:00100000:2.0:1762166857.549683:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 363 00000100:00100000:0.0:1762166857.551215:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.551293:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444502656 00000100:00100000:2.0:1762166857.551300:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444502656 00000100:00100000:2.0:1762166857.551349:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 364 00000100:00100000:2.0:1762166857.551359:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49302:x1847765444502656:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.551378:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.551394:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ee2e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f919d0 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.551872:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ee35 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.551882:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ee35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.551888:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ee35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.551906:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x37:0x0]: returning size 0 00010000:00010000:2.0:1762166857.551934:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ee2e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919d0 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.551945:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ee35 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919d0 expref: 49 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.551950:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166857.551952:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166857.551954:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2000, rc 0) 00000100:00100000:2.0:1762166857.551991:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49302:x1847765444502656:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 635us (782us total) trans 8589934975 rc 0/0 00000100:00100000:2.0:1762166857.551995:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 364 00000100:00100000:3.0:1762166857.553368:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.553410:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444502912 00000100:00100000:2.0:1762166857.553426:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444502912 00000100:00100000:2.0:1762166857.553463:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 365 00000100:00100000:2.0:1762166857.553469:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49302:x1847765444502912:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.553481:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.553491:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ee43 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f919d7 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.553551:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ee4a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.553562:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ee35 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919d0 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.553570:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ee4a lrc: 4/0,1 mode: --/EX res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.553622:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ee35 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919d0 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.553638:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ee35 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919d0 expref: 50 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.553651:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451991808:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.553716:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463e000 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.554698:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451991808:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.554718:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ee4a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166857.554984:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.555031:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444503040 00000100:00100000:3.0:1762166857.555037:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444503040 00010000:00010000:3.0:1762166857.555066:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ee35 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919d0 expref: 51 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:3.0:1762166857.555100:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 801 00000100:00100000:3.0:1762166857.555109:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2360:x1847765444503040:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166857.555121:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.555128:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ee35 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919d0 expref: 51 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166857.555139:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ee35 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919d0 expref: 51 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166857.555158:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ee35 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919d0 expref: 51 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166857.555172:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:3.0:1762166857.555218:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ee4a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.555227:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ee4a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.555233:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ee4a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.555258:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.555284:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ee4a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.555293:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ee4a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166857.555308:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2360:x1847765444503040:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 199us (323us total) trans 0 rc 0/0 00000004:00200000:2.0:1762166857.555308:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x37:0x0]: returning size 0 00000100:00100000:3.0:1762166857.555334:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 801 00000004:00080000:2.0:1762166857.555593:0:30818:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x8a:0x0], index 1: 0 00010000:00010000:2.0:1762166857.555714:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ee4a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.555722:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ee4a lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.555728:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ee4a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.555743:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.555746:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ee4a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.555753:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ee4a lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.555783:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166857.555787:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166857.555790:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ee4a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.555797:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ee4a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.555839:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ee43 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919d7 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.555849:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166857.555851:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166857.555854:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ee43 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919d7 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.555862:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2e00, rc 0) 00000100:00100000:2.0:1762166857.555901:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49302:x1847765444502912:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2432us (2538us total) trans 8589934976 rc 301/301 00000100:00100000:2.0:1762166857.555908:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 365 00000100:00100000:2.0:1762166857.558193:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.558262:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444503296 00000100:00100000:0.0:1762166857.558270:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444503296 00000100:00100000:0.0:1762166857.558336:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 152 00000100:00100000:0.0:1762166857.558350:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49302:x1847765444503296:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166857.558668:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49302:x1847765444503296:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 320us (482us total) trans 8589934977 rc 0/0 00000100:00100000:0.0:1762166857.558676:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 152 00000100:00100000:1.0:1762166857.559873:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.559991:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444503424 00000100:00100000:2.0:1762166857.560012:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444503424 00000100:00100000:2.0:1762166857.560053:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 366 00000100:00100000:2.0:1762166857.560062:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49302:x1847765444503424:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.560079:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.560097:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ee58 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f919de expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.560166:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ee5f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.560183:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9ee20 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919c9 expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.560191:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ee5f lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.560222:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9ee20 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919c9 expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.560235:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9ee20 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919c9 expref: 51 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.560248:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451991936:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.560323:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.561544:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.561547:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451991936:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.561570:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ee5f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166857.561634:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444503552 00000100:00100000:0.0:1762166857.561639:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444503552 00010000:00010000:0.0:1762166857.561662:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9ee20 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919c9 expref: 52 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.561713:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 802 00000100:00100000:0.0:1762166857.561722:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2360:x1847765444503552:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.561734:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.561739:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9ee20 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919c9 expref: 52 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.561749:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9ee20 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919c9 expref: 52 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.561799:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9ee20 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919c9 expref: 52 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.561814:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960200) 00010000:00010000:0.0:1762166857.561819:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ee5f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.561827:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ee5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.561833:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ee5f lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.561855:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166857.561906:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2360:x1847765444503552:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 185us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.561914:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 802 00010000:00010000:3.0:1762166857.562012:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ee5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.562019:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ee5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762166857.562049:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:3.0:1762166857.562053:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166857.562069:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ee5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.562132:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ee58 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919de expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.562148:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ee5f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919de expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.562155:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960200) 00010000:00010000:3.0:1762166857.562157:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166857.562159:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2200, rc 0) 00000100:00100000:3.0:1762166857.562199:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49302:x1847765444503424:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2137us (2330us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.562205:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 366 00000100:00100000:3.0:1762166857.563493:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.563554:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444503680 00000100:00100000:2.0:1762166857.563569:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444503680 00000100:00100000:2.0:1762166857.563613:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1191 00000100:00100000:2.0:1762166857.563622:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2359:x1847765444503680:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.563636:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.563651:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ee66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f919e5 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.563702:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451992064:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166857.563799:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.564659:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451992064:192.168.203.35@tcp:106: 00010000:00010000:3.0:1762166857.564685:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ee66 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919e5 expref: 13 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166857.564717:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ee66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919e5 expref: 13 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166857.564729:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3400, rc 0) 00000100:00100000:3.0:1762166857.564804:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2359:x1847765444503680:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1182us (1313us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166857.564813:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1191 00000100:00100000:1.0:1762166857.566112:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.566177:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444503808 00000100:00100000:3.0:1762166857.566186:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444503808 00000100:00100000:3.0:1762166857.566245:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 367 00000100:00100000:3.0:1762166857.566255:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49302:x1847765444503808:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166857.566272:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.566296:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9ee6d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f919ec expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.566360:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9ee74 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.566374:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9ee74 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x37:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.566385:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9ee74 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x37:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762166857.566433:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x37:0x0]: returning size 0 00000004:00200000:3.0:1762166857.566437:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166857.566454:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9ee74 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x37:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.566494:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9ee6d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919ec expref: 52 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.566512:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9ee74 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x37:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919ec expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.566520:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:3.0:1762166857.566523:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762166857.566526:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382044600, rc 0) 00000100:00100000:3.0:1762166857.566581:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49302:x1847765444503808:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 328us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.566588:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 367 00000100:00100000:0.0:1762166857.569473:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.569622:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444503936 00000100:00100000:3.0:1762166857.569631:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444503936 00000100:00100000:3.0:1762166857.569685:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1192 00000100:00100000:3.0:1762166857.569695:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765444503936:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166857.569711:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.569729:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9ee7b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f919f3 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166857.569752:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762166857.569803:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166857.569810:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166857.569819:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9ee7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919f3 expref: 22 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166857.569837:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9ee7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919f3 expref: 22 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166857.569865:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382045800, rc 0) 00000100:00100000:3.0:1762166857.569925:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765444503936:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 232us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.569931:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1192 00000100:00100000:2.0:1762166857.571597:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.571646:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444504192 00000100:00100000:3.0:1762166857.571654:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444504192 00000100:00100000:3.0:1762166857.571708:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 368 00000100:00100000:3.0:1762166857.571717:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49302:x1847765444504192:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166857.571734:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.571752:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9ee82 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f919fa expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.571875:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9ee89 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.571890:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9ee89 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.571899:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9ee89 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762166857.571912:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:3.0:1762166857.572047:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9ee82 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919fa expref: 54 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.572067:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9ee89 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919fa expref: 53 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.572097:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960200) 00010000:00010000:3.0:1762166857.572101:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166857.572104:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382044a00, rc 0) 00000100:00100000:3.0:1762166857.572156:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49302:x1847765444504192:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 440us (565us total) trans 8589934978 rc 0/0 00000100:00100000:3.0:1762166857.572164:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 368 00000100:00100000:1.0:1762166857.573921:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.574068:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444504320 00000100:00100000:0.0:1762166857.574097:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444504320 00000100:00100000:0.0:1762166857.574164:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1193 00000100:00100000:0.0:1762166857.574176:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444504320:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.574197:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.574216:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9ee97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a01 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.574276:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e628700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451992192:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166857.574360:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.575637:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e628700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451992192:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166857.575675:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9ee97 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a01 expref: 13 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.575699:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9ee97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a01 expref: 13 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.575714:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199200, rc 0) 00000100:00100000:2.0:1762166857.575796:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444504320:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1618us (1883us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166857.575806:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1193 00000100:00100000:2.0:1762166857.577656:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.577728:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444504448 00000100:00100000:0.0:1762166857.577738:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444504448 00000100:00100000:0.0:1762166857.577826:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1194 00000100:00100000:0.0:1762166857.577837:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444504448:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.577859:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.577880:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9ee9e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a08 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.577942:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e628000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451992320:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166857.578040:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.580245:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e628000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451992320:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166857.580281:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9ee9e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a08 expref: 13 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.580303:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9ee9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a08 expref: 13 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.580335:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199e00, rc 0) 00000100:00100000:0.0:1762166857.580405:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444504448:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2569us (2763us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166857.580414:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1194 00000100:00100000:3.0:1762166857.582500:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.582588:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444504576 00000100:00100000:0.0:1762166857.582599:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444504576 00000100:00100000:0.0:1762166857.582666:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1195 00000100:00100000:0.0:1762166857.582675:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444504576:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762166857.582715:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9eea5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.582731:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ecd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91960 expref: 12 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.582740:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166857.582742:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166857.582745:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9eea5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.582801:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ecd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91960 expref: 12 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.582815:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ecd0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91960 expref: 12 pid: 26444 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.582829:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e628000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451992448:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.582931:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.585719:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e628000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765451992448:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.585749:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9eea5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166857.585870:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.585950:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444504704 00000100:00100000:0.0:1762166857.585961:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444504704 00010000:00010000:0.0:1762166857.586009:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ecd0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91960 expref: 13 pid: 26444 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.586061:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 803 00000100:00100000:0.0:1762166857.586074:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444504704:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.586096:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.586124:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ecd0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91960 expref: 13 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.586139:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ecd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91960 expref: 13 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.586168:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ecd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91960 expref: 13 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.586188:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.586190:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.586196:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9eea5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.586239:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9eea5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.586277:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.586317:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9eea5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.586328:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9eea5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.586347:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444504704:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 274us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.586356:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 803 00010000:00010000:2.0:1762166857.586364:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9eea5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.586375:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9eea5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.586383:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9eea5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.586392:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166857.586397:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9eea5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.586406:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9eea5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.586433:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9eea5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.586441:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9eea5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.586514:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444504576:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3839us (4032us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.586527:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1195 00000100:00100000:3.0:1762166857.588046:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.588100:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444504832 00000100:00100000:2.0:1762166857.588118:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444504832 00000100:00100000:2.0:1762166857.588170:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1196 00000100:00100000:2.0:1762166857.588180:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2358:x1847765444504832:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.588198:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.588222:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9eeac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a0f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166857.588256:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x8a:0x0] initial LVB size: 0, mtime: 0x69088847, atime: 0x69088847, ctime: 0x69088849, blocks: 0x1 00010000:00010000:2.0:1762166857.588277:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.588279:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.588287:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9eeac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a0f expref: 12 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.588303:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9eeac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a0f expref: 12 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.588318:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2c00, rc 0) 00000100:00100000:2.0:1762166857.588378:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2358:x1847765444504832:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 199us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.588386:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1196 00000100:00100000:3.0:1762166857.614086:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.614197:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444504960 00000100:00100000:2.0:1762166857.614213:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444504960 00000100:00100000:2.0:1762166857.614296:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 369 00000100:00100000:2.0:1762166857.614308:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49302:x1847765444504960:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:1.0:1762166857.623843:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934977 is committed 00000020:00080000:1.0:1762166857.623873:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969122 batchid updated 00000020:00080000:2.0:1762166857.623905:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969122 00000020:00080000:2.0:1762166857.623921:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969122 00000020:00080000:1.0:1762166857.623957:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee37f48e3c0 refcount 2 committed 0 result 0 batchid 4294969123 00000020:00080000:1.0:1762166857.623964:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee241fb7000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee37f48ed80 00000020:00080000:1.0:1762166857.623968:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee241fb7500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee2451ebc00 00000020:00080000:2.0:1762166857.623993:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969123 committed batchid 4294969122 00000100:00100000:3.0:1762166857.623997:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49302:x1847765444504960:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 9683us (9913us total) trans 0 rc 0/0 00000001:00080000:1.0:1762166857.623998:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934978 is committed 00000100:00100000:3.0:1762166857.624015:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 369 00000020:00080000:2.0:1762166857.624184:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969122 00000100:00100000:1.0:1762166857.625712:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.625780:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444505088 00000100:00100000:2.0:1762166857.625790:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444505088 00000100:00100000:2.0:1762166857.625835:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1197 00000100:00100000:2.0:1762166857.625843:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444505088:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:2.0:1762166857.625944:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444505088:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 100us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.625951:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1197 00000100:00100000:3.0:1762166857.632564:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.632671:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444505216 00000100:00100000:2.0:1762166857.632689:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444505216 00000100:00100000:3.0:1762166857.632800:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1198 00000100:00100000:3.0:1762166857.632813:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444505216:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762166857.632865:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9eeb3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.632881:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166857.632883:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166857.632890:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9eeb3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.632905:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9eeb3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.632962:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9eeb3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.632970:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9eeb3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.632977:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9eeb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.632984:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166857.632989:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9eeb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.632999:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9eeb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.633011:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9eeb3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.633017:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9eeb3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166857.633113:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444505216:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 302us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.633121:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1198 00000100:00100000:3.0:1762166857.634280:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.634355:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444505472 00000100:00100000:2.0:1762166857.634362:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444505472 00000100:00100000:2.0:1762166857.634414:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 370 00000100:00100000:2.0:1762166857.634440:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49302:x1847765444505472:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762166857.634494:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.634518:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9ee74 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x37:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919ec expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.634536:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:2.0:1762166857.634547:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.634581:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9eeba lrc: 3/0,1 mode: --/PW res: [0x200000404:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.634592:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9eeba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.634600:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9eeba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:2.0:1762166857.634842:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a26c5db6 reply state 000000004a55d0e6 transno 8589934979 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9eeba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166857.634856:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166857.634927:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49302:x1847765444505472:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 490us (653us total) trans 8589934979 rc 0/0 00000100:00100000:2.0:1762166857.634932:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 370 00010000:00010000:0.0:1762166857.635713:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9eeba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.635723:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9eeba lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.635729:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9eeba lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.635734:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.635738:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9eeba lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.635745:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9eeba lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.635755:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37:0x0].0x0 (ffff9ee359d01700) 00010000:00010000:0.0:1762166857.635759:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166857.635794:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9eeba lrc: 2/0,0 mode: --/PW res: [0x200000404:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.635801:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9eeba lrc: 0/0,0 mode: --/PW res: [0x200000404:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166857.635939:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.635999:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444505600 00000100:00100000:2.0:1762166857.636010:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444505600 00000100:00100000:2.0:1762166857.636075:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 371 00000100:00100000:2.0:1762166857.636086:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49302:x1847765444505600:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.636111:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.636133:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eec1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a16 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.636192:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eec1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a16 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.636207:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eec1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a16 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.636225:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37:0x0].0x0 (ffff9ee359d01e00) 00010000:00010000:2.0:1762166857.636228:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166857.636231:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2600, rc 0) 00000100:00100000:2.0:1762166857.636285:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49302:x1847765444505600:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 201us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.636290:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 371 00000100:00100000:1.0:1762166857.637377:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.637473:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444505728 00000100:00100000:3.0:1762166857.637478:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444505728 00000100:00100000:3.0:1762166857.637522:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1199 00000100:00100000:3.0:1762166857.637532:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:49302:x1847765444505728:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166857.637543:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.637555:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee382045200/0xf915a5bdf3c9eec8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a1d expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.637578:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9ee7b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919f3 expref: 23 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166857.637584:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166857.637586:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166857.637588:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee382045200/0xf915a5bdf3c9eec8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a1d expref: 23 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.637614:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9ee7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919f3 expref: 23 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166857.637624:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9ee7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919f3 expref: 23 pid: 26444 timeout: 578 lvb_type: 1 00000100:00100000:3.0:1762166857.637634:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f403800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451992576:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166857.637687:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.638519:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f403800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451992576:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.638537:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee382045200/0xf915a5bdf3c9eec8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a1d expref: 23 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.638564:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382045200, rc 0) 00000100:00100000:2.0:1762166857.638605:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:49302:x1847765444505728:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1075us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.638612:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1199 00000100:00100000:2.0:1762166857.638832:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.638866:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444505856 00000100:00100000:0.0:1762166857.638870:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444505856 00010000:00010000:0.0:1762166857.638889:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9ee7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919f3 expref: 23 pid: 26444 timeout: 578 lvb_type: 1 00000100:00100000:0.0:1762166857.638912:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 804 00000100:00100000:0.0:1762166857.638918:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444505856:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.638926:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.638942:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9ee7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919f3 expref: 23 pid: 26444 timeout: 578 lvb_type: 1 00010000:00010000:0.0:1762166857.638950:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9ee7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919f3 expref: 23 pid: 26444 timeout: 578 lvb_type: 1 00010000:00010000:0.0:1762166857.638964:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee382045800/0xf915a5bdf3c9ee7b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919f3 expref: 23 pid: 26444 timeout: 578 lvb_type: 1 00010000:00010000:0.0:1762166857.638973:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.638974:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.638978:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee382045200/0xf915a5bdf3c9eec8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a1d expref: 22 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.638994:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee382045200/0xf915a5bdf3c9eec8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a1d expref: 22 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.639012:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee382045200/0xf915a5bdf3c9eec8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a1d expref: 22 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.639026:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e628000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765451992704:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762166857.639074:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.639913:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e628000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765451992704:192.168.203.35@tcp:105: 00010000:00010000:0.0:1762166857.639925:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166857.639958:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444505856:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1039us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.639967:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 804 00000100:00100000:2.0:1762166857.640041:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.640080:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444505984 00000100:00100000:0.0:1762166857.640085:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444505984 00000100:00100000:0.0:1762166857.640122:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1200 00000100:00100000:0.0:1762166857.640130:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444505984:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166857.640333:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x8a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166857.640337:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x8a:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:0.0:1762166857.640339:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x8a:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:0.0:1762166857.640341:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8a:0x0] updating lvb ctime from disk: 0 -> 1762166857 00002000:00010000:0.0:1762166857.640344:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x8a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166857.640379:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444505984:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 249us (338us total) trans 17179869459 rc 0/0 00000100:00100000:0.0:1762166857.640387:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1200 00000100:00100000:3.0:1762166857.641274:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.641316:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444506240 00000100:00100000:2.0:1762166857.641321:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444506240 00000100:00100000:2.0:1762166857.641358:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 372 00000100:00100000:2.0:1762166857.641365:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49302:x1847765444506240:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762166857.641404:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.641435:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ee5f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919de expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.641452:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960200) 00010000:00010000:2.0:1762166857.641457:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.641491:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eecf lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.641503:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eecf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.641511:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eecf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:2.0:1762166857.641601:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000099c305d reply state 0000000089a20315 transno 8589934980 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eecf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166857.641622:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166857.641694:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49302:x1847765444506240:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 328us (419us total) trans 8589934980 rc 0/0 00000100:00100000:2.0:1762166857.641706:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 372 00010000:00010000:2.0:1762166857.642251:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eecf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.642260:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eecf lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.642265:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eecf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.642271:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.642274:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eecf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.642280:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eecf lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.642288:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960200) 00010000:00010000:2.0:1762166857.642291:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.642295:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eecf lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.642300:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eecf lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166857.642471:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.642516:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444506368 00000100:00100000:0.0:1762166857.642522:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444506368 00000100:00100000:0.0:1762166857.642559:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1201 00000100:00100000:0.0:1762166857.642573:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:49302:x1847765444506368:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.642584:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.642604:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9eed6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a24 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.642626:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9eeac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a0f expref: 13 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.642635:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.642637:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.642641:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9eed6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a24 expref: 13 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.642671:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9eeac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a0f expref: 13 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.642685:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9eeac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a0f expref: 13 pid: 6532 timeout: 578 lvb_type: 1 00000100:00100000:0.0:1762166857.642698:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e628000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451992832:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.642795:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.643845:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e628000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451992832:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.643864:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9eed6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a24 expref: 13 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.643875:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199e00, rc 0) 00000100:00100000:0.0:1762166857.643910:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:49302:x1847765444506368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1345us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.643916:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1201 00000100:00100000:3.0:1762166857.644118:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.644164:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444506496 00000100:00100000:0.0:1762166857.644170:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444506496 00010000:00010000:0.0:1762166857.644191:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9eeac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a0f expref: 13 pid: 6532 timeout: 578 lvb_type: 1 00000100:00100000:0.0:1762166857.644221:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 805 00000100:00100000:0.0:1762166857.644231:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765444506496:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.644243:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.644263:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9eeac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a0f expref: 13 pid: 6532 timeout: 578 lvb_type: 1 00010000:00010000:0.0:1762166857.644274:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9eeac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a0f expref: 13 pid: 6532 timeout: 578 lvb_type: 1 00010000:00010000:0.0:1762166857.644292:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9eeac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a0f expref: 13 pid: 6532 timeout: 578 lvb_type: 1 00010000:00010000:0.0:1762166857.644303:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.644305:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.644309:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9eed6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a24 expref: 12 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.644317:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9eed6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a24 expref: 12 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.644338:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9eed6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a24 expref: 12 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.644360:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e628000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765451992960:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762166857.644408:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.645347:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e628000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765451992960:192.168.203.35@tcp:105: 00010000:00010000:0.0:1762166857.645362:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166857.645396:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444506496:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1168us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.645402:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 805 00000100:00100000:3.0:1762166857.645527:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.645568:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444506624 00000100:00100000:0.0:1762166857.645574:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444506624 00000100:00100000:0.0:1762166857.645607:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1202 00000100:00100000:0.0:1762166857.645616:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444506624:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166857.645822:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x8a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166857.645826:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x8a:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166857.645828:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x8a:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166857.645834:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x8a:0x0] updating lvb ctime from disk: 1762166857 -> 1762166857 00002000:00010000:0.0:1762166857.645837:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x8a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166857.645868:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444506624:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 254us (342us total) trans 21474836789 rc 0/0 00000100:00100000:0.0:1762166857.645875:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1202 00000100:00100000:1.0:1762166857.646726:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.646803:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444506880 00000100:00100000:0.0:1762166857.646809:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444506880 00000100:00100000:0.0:1762166857.646848:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 153 00000100:00100000:0.0:1762166857.646857:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348210c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49302:x1847765444506880:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166857.646931:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9ee89 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919fa expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.646965:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9eedd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.646978:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9edb7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919a6 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.646987:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9ee04 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919bb expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.646994:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9eedd lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.647023:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9ee04 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919bb expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.647031:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9ee04 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919bb expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.647041:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451993088:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.647086:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9edb7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919a6 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.647092:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9edb7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919a6 expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.647099:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e628000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451993216:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.647124:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.647967:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451993088:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.647979:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e628000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451993216:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.647994:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9eedd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166857.648175:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166857.648211:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.648216:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444507136 00000100:00100000:0.0:1762166857.648224:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444507136 00000100:00100000:2.0:1762166857.648253:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444507264 00010000:00010000:0.0:1762166857.648254:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9edb7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919a6 expref: 28 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.648259:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444507264 00000100:00100000:2.0:1762166857.648295:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 154 00000100:00100000:0.0:1762166857.648295:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 806 00000100:00100000:2.0:1762166857.648306:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:37762:x1847765444507264:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1762166857.648309:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765444507136:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.648318:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.648324:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9edb7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919a6 expref: 29 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.648331:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9edb7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919a6 expref: 29 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.648345:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9edb7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919a6 expref: 29 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.648360:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960200) 00010000:00010000:0.0:1762166857.648365:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9eedd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.648372:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9eedd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.648386:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166857.648435:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765444507136:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 128us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.648452:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 806 00000100:00100000:2.0:1762166857.648465:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:37762:x1847765444507264:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 158us (252us total) trans 8589934981 rc 0/0 00000100:00100000:2.0:1762166857.648474:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 154 00000100:00100000:2.0:1762166857.649289:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.649324:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444507392 00000100:00100000:0.0:1762166857.649330:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444507392 00010000:00010000:0.0:1762166857.649349:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9ee04 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919bb expref: 28 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.649376:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 807 00000100:00100000:0.0:1762166857.649384:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444507392:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.649394:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.649398:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9ee04 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919bb expref: 28 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.649409:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9ee04 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919bb expref: 28 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.649435:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9ee04 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919bb expref: 28 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.649446:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960200) 00010000:00010000:0.0:1762166857.649450:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9eedd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.649458:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9eedd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.649475:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9eedd lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.649497:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.649513:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9eedd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.649520:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9eedd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.649533:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444507392:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 149us (243us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166857.649544:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9eee4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.649549:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 807 00010000:00010000:2.0:1762166857.649563:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eec1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a16 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.649572:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9eee4 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x37:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.649597:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eec1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a16 expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.649608:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eec1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a16 expref: 26 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.649620:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451993344:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.649671:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463e000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.650597:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451993344:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.650613:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9eee4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x37:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166857.650824:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.650865:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444507520 00000100:00100000:0.0:1762166857.650871:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444507520 00010000:00010000:0.0:1762166857.650888:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eec1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a16 expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.650913:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 808 00000100:00100000:0.0:1762166857.650921:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444507520:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.650931:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.650936:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eec1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a16 expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.650946:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eec1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a16 expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.650962:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9eec1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a16 expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.650989:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37:0x0].0x0 (ffff9ee359d01e00) 00010000:00010000:0.0:1762166857.650993:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9eee4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x37:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.651001:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9eee4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x37:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.651007:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9eee4 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x37:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.651027:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.651050:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9eee4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.651061:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444507520:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 140us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.651076:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 808 00010000:00010000:2.0:1762166857.651077:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9eee4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166857.651433:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451993472:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166857.651467:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166857.651496:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.651853:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451993472 00000100:00100000:0.0:1762166857.651859:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451993472 00000100:00100000:0.0:1762166857.651903:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1762166857.651913:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:31351:x1847765451993472:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166857.651989:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:31351:x1847765451993472:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 79us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.651997:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1762166857.652021:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451993472:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166857.652062:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451993600:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166857.652087:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166857.652106:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.652122:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451993600 00000100:00100000:0.0:1762166857.652127:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451993600 00000100:00100000:0.0:1762166857.652152:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1762166857.652158:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:31351:x1847765451993600:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166857.652212:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:31351:x1847765451993600:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 53us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.652231:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1762166857.652242:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451993600:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166857.652409:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934982 00000100:00100000:2.0:1762166857.652470:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451993728:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166857.652495:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166857.652518:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463e900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.652542:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451993728 00000100:00100000:0.0:1762166857.652547:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451993728 00000100:00100000:0.0:1762166857.652577:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1762166857.652584:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:31351:x1847765451993728:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166857.652725:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:31351:x1847765451993728:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 140us (227us total) trans 17179869460 rc 0/0 00000100:00100000:0.0:1762166857.652732:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1762166857.652757:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451993728:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166857.652853:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934983 00010000:00010000:2.0:1762166857.652879:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9eee4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.652888:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9eee4 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.652895:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9eee4 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.652900:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.652912:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9eee4 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.652919:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9eee4 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.652932:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37:0x0].0x0 (ffff9ee359d01e00) 00010000:00010000:2.0:1762166857.652935:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166857.652939:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9eee4 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.652945:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9eee4 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.652964:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9eedd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.652970:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9eedd lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.652975:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9eedd lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.652981:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.652983:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9eedd lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.652989:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9eedd lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.652996:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960200) 00010000:00010000:2.0:1762166857.652999:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166857.653002:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9eedd lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.653027:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9eedd lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.653040:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960200) 00010000:00010000:2.0:1762166857.653042:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166857.653048:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9ee89 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f919fa expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.653135:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348210c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49302:x1847765444506880:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 6279us (6409us total) trans 8589934984 rc 0/0 00000100:00100000:2.0:1762166857.653144:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 153 00000020:00080000:2.0:1762166857.653148:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166857.654664:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.654717:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444507648 00000100:00100000:2.0:1762166857.654725:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444507648 00000100:00100000:2.0:1762166857.654807:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 373 00000100:00100000:2.0:1762166857.654817:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49302:x1847765444507648:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.654837:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.654858:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eeeb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a2b expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.654911:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eeeb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a2b expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.654924:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eeeb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a2b expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.654941:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166857.654944:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166857.654959:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3400, rc 0) 00000100:00100000:2.0:1762166857.655009:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49302:x1847765444507648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 191us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.655016:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 373 00000100:00100000:3.0:1762166857.656410:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.656475:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444507904 00000100:00100000:2.0:1762166857.656482:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444507904 00000100:00100000:2.0:1762166857.656527:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 155 00000100:00100000:2.0:1762166857.656535:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49302:x1847765444507904:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166857.656724:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49302:x1847765444507904:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 189us (318us total) trans 8589934985 rc 0/0 00000100:00100000:2.0:1762166857.656732:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 155 00000100:00100000:3.0:1762166857.657914:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.657964:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444508160 00000100:00100000:2.0:1762166857.657970:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444508160 00000100:00100000:2.0:1762166857.658020:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 156 00000100:00100000:2.0:1762166857.658029:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49302:x1847765444508160:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762166857.658248:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x37:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1762166857.658350:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9eef2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.658362:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9eef2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.658369:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9eef2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.658377:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9eef2 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.658383:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9eef2 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.658401:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9eef2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.658435:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166857.658450:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166857.658460:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9eef2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.658468:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166857.658472:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9eef2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.658480:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9eef2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.658492:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:0.0:1762166857.658496:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166857.658500:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9eef2 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.658507:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9eef2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.658528:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166857.658529:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49302:x1847765444508160:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 500us (615us total) trans 8589934986 rc 0/0 00010000:00010000:0.0:1762166857.658532:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166857.658535:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166857.658538:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 156 00000100:00100000:1.0:1762166857.667453:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.667512:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444508288 00000100:00100000:2.0:1762166857.667523:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444508288 00000100:00100000:2.0:1762166857.667587:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 374 00000100:00100000:2.0:1762166857.667604:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49304:x1847765444508288:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166857.667629:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.667648:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9eef9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a32 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.667709:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef00 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.667724:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef00 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.667735:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef00 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.667749:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef07 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.667756:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef07 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.667794:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef07 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.667911:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ef0e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.667920:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ef0e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.667928:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ef0e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.667960:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166857.667964:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166857.667980:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ef0e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.667992:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ef0e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.667999:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef00 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.668005:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef00 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.668011:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef00 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.668017:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.668020:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef00 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.668028:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef00 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.668038:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166857.668047:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.668052:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef00 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.668058:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef00 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.668071:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef07 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.668077:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef07 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.668083:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef07 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.668088:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.668090:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef07 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.668096:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef07 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.668104:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01e00) 00010000:00010000:2.0:1762166857.668107:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.668110:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef07 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.668115:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef07 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.668145:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9eef9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a32 expref: 32 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.668171:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ef0e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a32 expref: 31 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.668179:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166857.668182:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166857.668184:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2600, rc 0) 00000100:00100000:2.0:1762166857.668243:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49304:x1847765444508288:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 647us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.668251:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 374 00000100:00100000:3.0:1762166857.684329:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.684401:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444508416 00000100:00100000:2.0:1762166857.684411:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444508416 00000100:00100000:2.0:1762166857.684480:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 375 00000100:00100000:2.0:1762166857.684490:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49308:x1847765444508416:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166857.684549:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ef15 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684562:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ef15 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684570:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ef15 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684578:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef1c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684582:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef1c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684586:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef1c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684705:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef23 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684714:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef23 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684721:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef23 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.684750:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166857.684754:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166857.684789:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef23 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684803:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ef15 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684808:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ef15 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684815:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ef15 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684820:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.684824:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ef15 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684831:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ef15 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684839:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166857.684841:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.684844:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ef15 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684854:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ef15 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684865:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef1c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684868:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef1c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684872:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef1c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684877:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.684880:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef1c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684885:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef1c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684893:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01e00) 00010000:00010000:2.0:1762166857.684895:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.684898:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef1c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684904:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef1c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684919:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef23 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684923:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef23 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684934:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef23 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684937:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.684939:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef23 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684942:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef23 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684947:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166857.684948:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.684950:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef23 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.684953:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef23 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166857.685008:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49308:x1847765444508416:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 521us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.685013:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 375 00000100:00100000:3.0:1762166857.694397:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.694470:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444508672 00000100:00100000:2.0:1762166857.694479:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444508672 00000100:00100000:2.0:1762166857.694527:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 376 00000100:00100000:2.0:1762166857.694538:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49310:x1847765444508672:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.694558:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.694578:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef2a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a39 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.694655:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef31 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.694676:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef31 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.694684:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef31 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.694693:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166857.694812:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef2a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a39 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.694824:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef31 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a39 expref: 33 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.694830:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166857.694832:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166857.694834:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2200, rc 0) 00000100:00100000:2.0:1762166857.694882:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49310:x1847765444508672:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 348us (496us total) trans 8589934987 rc 0/0 00000100:00100000:2.0:1762166857.694887:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 376 00000100:00100000:1.0:1762166857.696544:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.696598:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444508928 00000100:00100000:2.0:1762166857.696605:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444508928 00000100:00100000:2.0:1762166857.696644:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 377 00000100:00100000:2.0:1762166857.696653:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49310:x1847765444508928:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.696668:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.696681:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ef3f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a40 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.696738:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ef46 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.696758:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ef0e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a32 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.696789:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ef46 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.696820:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ef0e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a32 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.696833:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ef0e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a32 expref: 34 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.696847:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f27b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451993856:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.696913:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.697703:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f27b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451993856:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.697723:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ef46 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166857.697897:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.697956:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444509056 00000100:00100000:0.0:1762166857.697962:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444509056 00010000:00010000:0.0:1762166857.697986:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ef0e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a32 expref: 35 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.698011:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 809 00000100:00100000:0.0:1762166857.698022:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444509056:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.698033:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.698038:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ef0e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a32 expref: 35 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.698049:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ef0e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a32 expref: 35 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.698061:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ef0e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a32 expref: 35 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.698071:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:0.0:1762166857.698074:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ef46 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.698080:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ef46 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.698085:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ef46 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.698102:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.698129:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ef46 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166857.698136:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765444509056:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 114us (236us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166857.698138:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ef46 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166857.698148:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 809 00000004:00200000:2.0:1762166857.698152:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166857.698241:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9ef3f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a40 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.698250:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ef46 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a40 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.698261:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166857.698263:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166857.698265:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2c00, rc 0) 00000100:00100000:2.0:1762166857.698291:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49310:x1847765444508928:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1642us (1752us total) trans 8589934988 rc 0/0 00000100:00100000:2.0:1762166857.698296:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 377 00000100:00100000:1.0:1762166857.699222:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.699259:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444509184 00000100:00100000:2.0:1762166857.699266:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444509184 00000100:00100000:2.0:1762166857.699299:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 157 00000100:00100000:2.0:1762166857.699307:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49310:x1847765444509184:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:2.0:1762166857.699395:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49310:x1847765444509184:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 85us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.699402:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 157 00000100:00100000:3.0:1762166857.700093:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.700122:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444509440 00000100:00100000:2.0:1762166857.700126:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444509440 00000100:00100000:2.0:1762166857.700149:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 158 00000100:00100000:2.0:1762166857.700153:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49310:x1847765444509440:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166857.700255:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49310:x1847765444509440:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 99us (162us total) trans 8589934989 rc 0/0 00000100:00100000:2.0:1762166857.700262:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 158 00000100:00100000:3.0:1762166857.700925:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.700961:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444509696 00000100:00100000:2.0:1762166857.700965:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444509696 00000100:00100000:2.0:1762166857.700990:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 378 00000100:00100000:2.0:1762166857.700995:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49310:x1847765444509696:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.701014:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.701016:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762166857.701031:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9ef46 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a40 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.701043:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ef31 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a39 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.701049:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166857.701051:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.701059:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef54 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a47 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.701106:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ef5b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.701114:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ef5b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.701119:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ef5b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.701125:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166857.701167:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ef54 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a47 expref: 36 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.701176:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ef5b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a47 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.701180:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166857.701187:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166857.701189:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2800, rc 0) 00000100:00100000:2.0:1762166857.701214:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49310:x1847765444509696:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 219us (290us total) trans 8589934990 rc 0/0 00000100:00100000:2.0:1762166857.701218:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 378 00000100:00100000:3.0:1762166857.701935:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.701976:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444509952 00000100:00100000:2.0:1762166857.701982:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444509952 00000100:00100000:2.0:1762166857.702010:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 159 00000100:00100000:2.0:1762166857.702015:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348212450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49310:x1847765444509952:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166857.702041:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ef5b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a47 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.702054:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ef69 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.702060:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eeeb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a2b expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.702065:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ef69 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.702083:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eeeb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a2b expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.702091:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eeeb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a2b expref: 35 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.702099:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f27b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451993984:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.702140:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.702865:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f27b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451993984:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.702879:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ef69 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166857.703053:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.703095:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444510080 00000100:00100000:0.0:1762166857.703102:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444510080 00010000:00010000:0.0:1762166857.703125:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eeeb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a2b expref: 36 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.703160:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 810 00000100:00100000:0.0:1762166857.703170:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765444510080:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.703181:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.703187:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eeeb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a2b expref: 36 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.703198:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eeeb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a2b expref: 36 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.703212:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9eeeb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a2b expref: 36 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.703223:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:0.0:1762166857.703227:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ef69 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.703234:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ef69 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.703240:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ef69 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.703266:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.703289:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ef69 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.703296:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ef69 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.703304:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444510080:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 135us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.703335:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 810 00010000:00010000:2.0:1762166857.703498:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ef69 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.703504:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ef69 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.703508:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ef69 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.703512:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.703514:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ef69 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.703519:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ef69 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.703525:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166857.703527:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166857.703530:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ef69 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.703533:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ef69 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.703547:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166857.703549:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166857.703552:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ef5b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a47 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.703642:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348212450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49310:x1847765444509952:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 1626us (1708us total) trans 8589934991 rc -22/-22 00000100:00100000:2.0:1762166857.703648:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 159 00000100:00100000:3.0:1762166857.704353:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.704400:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444510208 00000100:00100000:2.0:1762166857.704406:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444510208 00000100:00100000:2.0:1762166857.704453:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 379 00000100:00100000:2.0:1762166857.704460:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49310:x1847765444510208:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.704472:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.704481:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ef70 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a4e expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.704511:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ef70 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a4e expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.704522:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ef70 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a4e expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.704538:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01e00) 00010000:00010000:2.0:1762166857.704541:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166857.704543:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2400, rc 0) 00000100:00100000:2.0:1762166857.704578:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49310:x1847765444510208:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 117us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.704595:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 379 00000100:00100000:3.0:1762166857.705817:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.705853:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444510464 00000100:00100000:2.0:1762166857.705859:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444510464 00000100:00100000:2.0:1762166857.705894:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 380 00000100:00100000:2.0:1762166857.705903:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49310:x1847765444510464:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.705914:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.705934:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ef77 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a55 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.706290:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ef7e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.706302:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ef7e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.706310:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ef7e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.706319:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x38:0x0]: returning size 0 00010000:00010000:2.0:1762166857.706355:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ef77 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a55 expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.706370:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ef7e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a55 expref: 37 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.706377:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166857.706381:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166857.706383:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3e00, rc 0) 00000100:00100000:2.0:1762166857.706439:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49310:x1847765444510464:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 537us (623us total) trans 8589934992 rc 0/0 00000100:00100000:2.0:1762166857.706456:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 380 00000100:00100000:3.0:1762166857.707628:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.707667:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444510720 00000100:00100000:2.0:1762166857.707672:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444510720 00000100:00100000:2.0:1762166857.707701:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 381 00000100:00100000:2.0:1762166857.707707:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49310:x1847765444510720:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.707717:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.707727:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ef8c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a5c expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.707800:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ef93 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.707812:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ef93 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.707819:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ef93 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.707830:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166857.707903:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9ef8c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a5c expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.707917:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ef93 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a5c expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.707924:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01e00) 00010000:00010000:2.0:1762166857.707926:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166857.707928:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159e00, rc 0) 00000100:00100000:2.0:1762166857.707969:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49310:x1847765444510720:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 262us (343us total) trans 8589934993 rc 0/0 00000100:00100000:2.0:1762166857.707985:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 381 00000100:00100000:3.0:1762166857.708808:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.708834:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444510976 00000100:00100000:2.0:1762166857.708838:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444510976 00000100:00100000:2.0:1762166857.708864:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 160 00000100:00100000:2.0:1762166857.708869:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49310:x1847765444510976:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166857.708900:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ef93 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a5c expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.708915:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efa1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.708923:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ef70 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a4e expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.708930:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efa1 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.708958:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ef70 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a4e expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.708970:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ef70 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a4e expref: 39 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.708981:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f27b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451994112:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.709027:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.709690:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f27b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451994112:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.709707:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efa1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166857.709922:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.709986:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444511104 00000100:00100000:0.0:1762166857.709996:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444511104 00010000:00010000:0.0:1762166857.710017:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ef70 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a4e expref: 40 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.710045:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 811 00000100:00100000:0.0:1762166857.710054:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2361:x1847765444511104:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.710065:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.710071:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ef70 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a4e expref: 40 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.710082:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ef70 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a4e expref: 40 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.710095:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ef70 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a4e expref: 40 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.710107:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01e00) 00010000:00010000:0.0:1762166857.710111:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efa1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.710118:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efa1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.710124:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efa1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.710148:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.710166:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efa1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.710173:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efa1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.710186:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444511104:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 132us (261us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166857.710187:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efa8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.710200:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 811 00010000:00010000:2.0:1762166857.710211:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ef7e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a55 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.710220:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efa8 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.710238:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ef7e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a55 expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.710248:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ef7e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a55 expref: 38 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.710258:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f27b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451994240:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.710296:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.710918:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f27b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451994240:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.710932:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efa8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166857.711113:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.711144:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444511232 00000100:00100000:0.0:1762166857.711148:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444511232 00010000:00010000:0.0:1762166857.711162:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ef7e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a55 expref: 39 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.711180:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 812 00000100:00100000:0.0:1762166857.711186:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444511232:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.711192:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.711196:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ef7e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a55 expref: 39 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.711204:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ef7e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a55 expref: 39 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.711220:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9ef7e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a55 expref: 39 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.711232:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:0.0:1762166857.711237:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efa8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.711244:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efa8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.711250:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efa8 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.711284:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.711302:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efa8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x38:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.711314:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2360:x1847765444511232:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 126us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.711328:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 812 00010000:00010000:2.0:1762166857.711329:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efa8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x38:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166857.711674:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f27b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451994368:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166857.711704:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166857.711729:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.711758:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451994368 00000100:00100000:0.0:1762166857.711775:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451994368 00000100:00100000:0.0:1762166857.711801:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1762166857.711806:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:31351:x1847765451994368:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166857.711861:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:31351:x1847765451994368:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 54us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.711865:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1762166857.711892:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f27b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451994368:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166857.711929:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934994 00000001:00080000:2.0:1762166857.711987:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934995 00010000:00010000:2.0:1762166857.712003:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efa8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x38:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.712008:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efa8 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x38:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.712012:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efa8 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x38:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.712016:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.712019:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efa8 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x38:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.712023:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efa8 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x38:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.712030:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166857.712032:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166857.712034:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efa8 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x38:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.712038:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efa8 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x38:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.712056:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efa1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.712059:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efa1 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.712062:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efa1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.712065:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.712067:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efa1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.712070:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efa1 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.712074:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01e00) 00010000:00010000:2.0:1762166857.712075:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166857.712076:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efa1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.712079:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efa1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.712085:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01e00) 00010000:00010000:2.0:1762166857.712086:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166857.712089:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ef93 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a5c expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.712138:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49310:x1847765444510976:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 3269us (3333us total) trans 8589934996 rc 0/0 00000100:00100000:2.0:1762166857.712144:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 160 00000020:00080000:2.0:1762166857.712150:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166857.712941:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.712985:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444511360 00000100:00100000:2.0:1762166857.712989:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444511360 00000100:00100000:2.0:1762166857.713015:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 382 00000100:00100000:2.0:1762166857.713020:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49310:x1847765444511360:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.713030:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.713040:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9efaf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a63 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.713067:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9efaf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a63 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.713074:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9efaf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a63 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.713083:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166857.713085:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166857.713087:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159a00, rc 0) 00000100:00100000:2.0:1762166857.713111:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49310:x1847765444511360:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 92us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.713116:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 382 00000100:00100000:3.0:1762166857.714088:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.714125:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444511616 00000100:00100000:2.0:1762166857.714129:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444511616 00000100:00100000:2.0:1762166857.714153:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 161 00000100:00100000:2.0:1762166857.714158:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49310:x1847765444511616:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762166857.714415:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x38:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166857.714527:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].17, 64 off9472 00000004:00080000:2.0:1762166857.714535:0:31351:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 478506772071ns, next at 479506770150ns, rc = 0 00000001:00080000:2.0:1762166857.714550:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934997 00010000:00010000:2.0:1762166857.714590:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9efb6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.714600:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9efb6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.714609:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9efb6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.714616:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9efb6 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.714622:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9efb6 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.714628:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9efb6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.714647:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166857.714664:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166857.714670:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9efb6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.714676:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166857.714679:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9efb6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.714686:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9efb6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.714698:0:32135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:0.0:1762166857.714702:0:32135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166857.714705:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9efb6 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.714711:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9efb6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166857.714729:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49310:x1847765444511616:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 569us (641us total) trans 8589934998 rc 0/0 00000100:00100000:2.0:1762166857.714746:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 161 00000020:00080000:2.0:1762166857.714750:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762166857.714757:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166857.714780:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166857.714782:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166857.715611:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.715652:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444511872 00000100:00100000:2.0:1762166857.715657:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444511872 00000100:00100000:2.0:1762166857.715685:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 162 00000100:00100000:2.0:1762166857.715693:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49310:x1847765444511872:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166857.715875:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49310:x1847765444511872:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 183us (265us total) trans 8589934999 rc 0/0 00000100:00100000:2.0:1762166857.715880:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 162 00000100:00100000:3.0:1762166857.723438:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.723500:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444512000 00000100:00100000:2.0:1762166857.723511:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444512000 00000100:00100000:2.0:1762166857.723567:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 383 00000100:00100000:2.0:1762166857.723577:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49312:x1847765444512000:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166857.723600:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.723621:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9efbd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a6a expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.723688:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efc4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.723702:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efc4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.723712:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efc4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.723725:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efcb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.723731:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efcb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.723738:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efcb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.723862:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9efd2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.723870:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9efd2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.723876:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9efd2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.723922:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166857.723926:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166857.723943:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9efd2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.723954:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9efd2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.723962:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efc4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.723968:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efc4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.723974:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efc4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.723980:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.723985:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efc4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.723992:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efc4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.724003:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166857.724006:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.724010:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efc4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.724016:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efc4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.724028:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efcb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.724040:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efcb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.724046:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efcb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.724050:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.724054:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efcb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.724060:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efcb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.724068:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01e00) 00010000:00010000:2.0:1762166857.724071:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.724074:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efcb lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.724079:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efcb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.724109:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9efbd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a6a expref: 45 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.724122:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9efd2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a6a expref: 44 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.724128:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166857.724131:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166857.724133:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158a00, rc 0) 00000100:00100000:2.0:1762166857.724192:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49312:x1847765444512000:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 616us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.724207:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 383 00000100:00100000:3.0:1762166857.725602:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.725669:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444512128 00000100:00100000:0.0:1762166857.725680:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444512128 00000100:00100000:0.0:1762166857.725736:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1203 00000100:00100000:0.0:1762166857.725746:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444512128:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166857.725799:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.725815:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199600/0xf915a5bdf3c9efd9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a71 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.725866:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e628000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451994496:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166857.725943:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9a840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.726878:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e628000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451994496:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166857.726909:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199600/0xf915a5bdf3c9efd9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a71 expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.726929:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199600/0xf915a5bdf3c9efd9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a71 expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.726940:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199600, rc 0) 00000100:00100000:0.0:1762166857.726982:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444512128:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 1237us (1384us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166857.726990:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1203 00000100:00100000:3.0:1762166857.739276:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.739341:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444512256 00000100:00100000:2.0:1762166857.739351:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444512256 00000100:00100000:2.0:1762166857.739410:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 384 00000100:00100000:2.0:1762166857.739430:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49316:x1847765444512256:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166857.739515:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9efe0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739531:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9efe0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739542:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9efe0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739556:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efe7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739563:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efe7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739569:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efe7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739660:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efee lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739666:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739670:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.739698:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166857.739715:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166857.739727:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739744:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9efe0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739751:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9efe0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739757:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9efe0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739791:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.739794:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9efe0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739800:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9efe0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739810:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166857.739812:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.739816:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9efe0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739820:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9efe0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739828:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efe7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739831:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efe7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739834:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efe7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739842:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.739844:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efe7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739847:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efe7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739851:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01e00) 00010000:00010000:2.0:1762166857.739857:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.739858:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efe7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739861:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9efe7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739872:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739875:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efee lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739878:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739881:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.739882:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739885:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efee lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739888:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166857.739892:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.739894:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efee lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.739898:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9efee lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166857.739962:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49316:x1847765444512256:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 543us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.739971:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 384 00000100:00100000:3.0:1762166857.748665:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.748744:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444512512 00000100:00100000:2.0:1762166857.748755:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444512512 00000100:00100000:2.0:1762166857.748829:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 385 00000100:00100000:2.0:1762166857.748840:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49318:x1847765444512512:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.748871:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.748891:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eff5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a78 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.748973:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9effc lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.748983:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9effc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.748990:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9effc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.748998:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166857.749087:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9eff5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a78 expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.749099:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9effc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a78 expref: 46 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.749115:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166857.749118:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166857.749119:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159600, rc 0) 00000100:00100000:2.0:1762166857.749165:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49318:x1847765444512512:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 326us (508us total) trans 8589935000 rc 0/0 00000100:00100000:2.0:1762166857.749171:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 385 00000100:00100000:3.0:1762166857.750627:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.750695:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444512640 00000100:00100000:0.0:1762166857.750711:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444512640 00000100:00100000:0.0:1762166857.750754:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1204 00000100:00100000:0.0:1762166857.750797:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444512640:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.750810:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.750824:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f00a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a7f expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.750883:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e628000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451994624:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166857.750948:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9a840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.751929:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e628000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451994624:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166857.751954:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f00a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a7f expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.751975:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f00a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a7f expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.751988:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199600, rc 0) 00000100:00100000:0.0:1762166857.752034:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444512640:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1271us (1411us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166857.752042:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1204 00000100:00100000:3.0:1762166857.754387:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.754449:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444512896 00000100:00100000:2.0:1762166857.754459:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444512896 00000100:00100000:2.0:1762166857.754519:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 386 00000100:00100000:2.0:1762166857.754529:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49318:x1847765444512896:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.754550:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.754569:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9f011 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a86 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.754658:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9f018 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.754672:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9efd2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a6a expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.754679:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9f018 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.754714:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9efd2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a6a expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.754725:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9efd2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a6a expref: 47 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.754754:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f27b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451994752:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.754849:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.755872:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f27b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451994752:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.755892:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9f018 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166857.756066:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.756113:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444513024 00000100:00100000:0.0:1762166857.756120:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444513024 00010000:00010000:0.0:1762166857.756147:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9efd2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a6a expref: 48 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.756178:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 813 00000100:00100000:0.0:1762166857.756187:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2361:x1847765444513024:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.756208:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.756215:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9efd2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a6a expref: 48 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.756227:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9efd2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a6a expref: 48 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.756245:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9efd2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a6a expref: 48 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.756258:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:0.0:1762166857.756262:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9f018 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.756269:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9f018 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.756276:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9f018 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.756296:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.756322:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9f018 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.756331:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9f018 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.756345:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000100:00100000:0.0:1762166857.756351:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:2361:x1847765444513024:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 164us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.756358:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 813 00010000:00010000:2.0:1762166857.756498:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9f011 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a86 expref: 48 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.756511:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9f018 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a86 expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.756519:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166857.756522:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166857.756525:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159200, rc 0) 00000100:00100000:2.0:1762166857.756556:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49318:x1847765444512896:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2029us (2176us total) trans 8589935001 rc 0/0 00000100:00100000:2.0:1762166857.756563:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 386 00000100:00100000:0.0:1762166857.757964:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.758036:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444513280 00000100:00100000:2.0:1762166857.758043:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444513280 00000100:00100000:2.0:1762166857.758100:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 387 00000100:00100000:2.0:1762166857.758109:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49318:x1847765444513280:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.758128:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.758144:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9f026 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a8d expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.758604:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9f02d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.758617:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9f02d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.758626:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9f02d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.758635:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x39:0x0]: returning size 0 00010000:00010000:2.0:1762166857.758668:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9f026 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a8d expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.758683:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9f02d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a8d expref: 49 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.758691:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x39:0x0].0x0 (ffff9ee359d01e00) 00010000:00010000:2.0:1762166857.758694:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166857.758696:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159800, rc 0) 00000100:00100000:2.0:1762166857.758746:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49318:x1847765444513280:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 638us (786us total) trans 8589935002 rc 0/0 00000100:00100000:2.0:1762166857.758753:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 387 00000100:00100000:3.0:1762166857.760118:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.760157:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444513536 00000100:00100000:2.0:1762166857.760164:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444513536 00000100:00100000:2.0:1762166857.760215:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 388 00000100:00100000:2.0:1762166857.760230:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49318:x1847765444513536:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.760247:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.760260:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9f03b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a94 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.760323:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f042 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.760334:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9f02d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a8d expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.760343:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f042 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.760371:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9f02d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a8d expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.760383:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9f02d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a8d expref: 50 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.760396:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f27b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451994880:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.760476:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.761372:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f27b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451994880:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.761392:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f042 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166857.761608:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.761663:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444513664 00000100:00100000:0.0:1762166857.761670:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444513664 00010000:00010000:0.0:1762166857.761696:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9f02d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a8d expref: 51 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.761747:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 814 00000100:00100000:0.0:1762166857.761758:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2360:x1847765444513664:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.761799:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.761805:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9f02d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a8d expref: 51 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.761817:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9f02d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a8d expref: 51 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.761833:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9f02d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a8d expref: 51 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.761847:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x39:0x0].0x0 (ffff9ee359d01e00) 00010000:00010000:0.0:1762166857.761852:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f042 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.761858:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f042 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.761864:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f042 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.761886:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.761909:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f042 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166857.761926:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2360:x1847765444513664:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 170us (318us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166857.761930:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f042 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166857.761938:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 814 00000004:00200000:2.0:1762166857.761950:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x39:0x0]: returning size 0 00000004:00080000:2.0:1762166857.762214:0:30818:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x8b:0x0], index 0: 0 00010000:00010000:2.0:1762166857.762332:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f042 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.762340:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f042 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.762346:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f042 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.762351:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.762355:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f042 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.762368:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f042 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.762377:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x39:0x0].0x0 (ffff9ee359d01e00) 00010000:00010000:2.0:1762166857.762380:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166857.762384:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f042 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.762388:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f042 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.762444:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9f03b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a94 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.762468:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166857.762470:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166857.762474:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9f03b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a94 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.762484:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158000, rc 0) 00000100:00100000:2.0:1762166857.762518:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49318:x1847765444513536:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2295us (2402us total) trans 8589935003 rc 301/301 00000100:00100000:2.0:1762166857.762525:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 388 00000100:00100000:3.0:1762166857.763847:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.764211:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444513920 00000100:00100000:2.0:1762166857.764219:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444513920 00000100:00100000:2.0:1762166857.764270:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 163 00000100:00100000:2.0:1762166857.764280:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49318:x1847765444513920:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166857.764608:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49318:x1847765444513920:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 329us (764us total) trans 8589935004 rc 0/0 00000100:00100000:2.0:1762166857.764617:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 163 00000100:00100000:3.0:1762166857.766318:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.766383:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444514048 00000100:00100000:2.0:1762166857.766397:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444514048 00000100:00100000:2.0:1762166857.766483:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 389 00000100:00100000:2.0:1762166857.766497:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49318:x1847765444514048:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.766525:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.766548:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f050 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91a9b expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.766641:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f057 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.766676:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9f018 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a86 expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.766685:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f057 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.766723:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9f018 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a86 expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.766737:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9f018 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a86 expref: 51 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.766754:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f27b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451995008:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.766889:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463e540 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.768402:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.768438:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f27b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765451995008:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.768474:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444514176 00010000:00010000:2.0:1762166857.768479:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f057 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166857.768484:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444514176 00010000:00010000:0.0:1762166857.768545:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9f018 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a86 expref: 52 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.768588:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 815 00000100:00100000:0.0:1762166857.768599:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2361:x1847765444514176:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.768614:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.768621:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9f018 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a86 expref: 52 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.768634:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9f018 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a86 expref: 52 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.768668:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9f018 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a86 expref: 52 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.768686:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:0.0:1762166857.768691:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f057 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.768701:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f057 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.768709:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f057 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.768741:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.768794:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f057 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.768804:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f057 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166857.768824:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444514176:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 226us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.768833:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 815 00000004:00200000:2.0:1762166857.768846:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166857.768852:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166857.768869:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f057 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.768898:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f050 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a9b expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.768922:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f057 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a9b expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.768938:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166857.768941:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166857.768943:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3e00, rc 0) 00000100:00100000:2.0:1762166857.768984:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49318:x1847765444514048:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2491us (2678us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.768992:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 389 00000100:00100000:3.0:1762166857.770187:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.770230:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444514304 00000100:00100000:0.0:1762166857.770244:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444514304 00000100:00100000:0.0:1762166857.770286:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1205 00000100:00100000:0.0:1762166857.770295:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2358:x1847765444514304:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.770317:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.770332:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f05e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91aa2 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.770384:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451995136:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166857.770447:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9a840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.771304:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451995136:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166857.771336:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f05e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91aa2 expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.771355:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f05e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91aa2 expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.771370:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199c00, rc 0) 00000100:00100000:0.0:1762166857.771406:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2358:x1847765444514304:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1112us (1223us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166857.771413:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1205 00000100:00100000:3.0:1762166857.772320:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.772375:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444514432 00000100:00100000:2.0:1762166857.772382:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444514432 00000100:00100000:2.0:1762166857.772424:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 390 00000100:00100000:2.0:1762166857.772435:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49318:x1847765444514432:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.772447:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.772465:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f065 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91aa9 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.772521:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f06c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.772533:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f06c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x39:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.772543:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f06c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x39:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.772574:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x39:0x0]: returning size 0 00000004:00200000:2.0:1762166857.772578:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166857.772603:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f06c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x39:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.772623:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f065 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x39:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91aa9 expref: 52 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.772637:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f06c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x39:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91aa9 expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.772644:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x39:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166857.772647:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166857.772650:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2800, rc 0) 00000100:00100000:2.0:1762166857.772692:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49318:x1847765444514432:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 260us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.772698:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 390 00000100:00100000:3.0:1762166857.773950:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.774017:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444514560 00000100:00100000:0.0:1762166857.774023:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444514560 00000100:00100000:0.0:1762166857.774062:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1206 00000100:00100000:0.0:1762166857.774071:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444514560:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.774084:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.774101:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f073 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ab0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166857.774129:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166857.774144:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.774146:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.774152:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f073 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ab0 expref: 14 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.774165:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f073 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ab0 expref: 14 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.774176:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199600, rc 0) 00000100:00100000:0.0:1762166857.774218:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2361:x1847765444514560:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 146us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.774225:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1206 00000100:00100000:3.0:1762166857.775927:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.775965:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444514816 00000100:00100000:2.0:1762166857.775972:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444514816 00000100:00100000:2.0:1762166857.776019:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 391 00000100:00100000:2.0:1762166857.776029:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49318:x1847765444514816:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.776044:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.776059:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f07a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ab7 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.776142:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f081 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.776155:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f081 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166857.776165:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f081 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166857.776190:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166857.776310:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f07a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ab7 expref: 54 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.776323:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f081 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ab7 expref: 53 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.776329:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166857.776331:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166857.776332:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3a00, rc 0) 00000100:00100000:2.0:1762166857.776368:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49318:x1847765444514816:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 342us (448us total) trans 8589935005 rc 0/0 00000100:00100000:2.0:1762166857.776373:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 391 00000100:00100000:3.0:1762166857.777988:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.778090:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444514944 00000100:00100000:0.0:1762166857.778097:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444514944 00000100:00100000:0.0:1762166857.778136:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1207 00000100:00100000:0.0:1762166857.778143:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444514944:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.778155:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.778168:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f08f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91abe expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.778212:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451995264:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166857.778271:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9a840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.779217:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451995264:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166857.779242:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f08f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91abe expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.779273:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f08f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91abe expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.779284:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198400, rc 0) 00000100:00100000:0.0:1762166857.779320:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444514944:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1177us (1341us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166857.779328:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1207 00000100:00100000:3.0:1762166857.780584:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.780676:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444515072 00000100:00100000:0.0:1762166857.780682:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444515072 00000100:00100000:0.0:1762166857.780729:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1208 00000100:00100000:0.0:1762166857.780737:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444515072:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.780751:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.780796:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f096 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ac5 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.780848:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451995392:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166857.780916:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9a840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.782032:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451995392:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166857.782061:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f096 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ac5 expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.782081:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f096 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ac5 expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.782112:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198e00, rc 0) 00000100:00100000:0.0:1762166857.782157:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444515072:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1417us (1575us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166857.782165:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1208 00000100:00100000:3.0:1762166857.783150:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.783183:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444515200 00000100:00100000:0.0:1762166857.783190:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444515200 00000100:00100000:0.0:1762166857.783225:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1209 00000100:00100000:0.0:1762166857.783231:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444515200:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762166857.783262:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f09d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.783275:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee382045200/0xf915a5bdf3c9eec8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a1d expref: 23 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.783283:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166857.783284:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166857.783287:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f09d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.783318:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee382045200/0xf915a5bdf3c9eec8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a1d expref: 23 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.783332:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee382045200/0xf915a5bdf3c9eec8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a1d expref: 23 pid: 26444 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.783345:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451995520:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.783414:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9a840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.784302:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765451995520:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.784317:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f09d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166857.784505:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.784548:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444515328 00000100:00100000:0.0:1762166857.784553:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444515328 00010000:00010000:0.0:1762166857.784573:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee382045200/0xf915a5bdf3c9eec8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a1d expref: 24 pid: 26444 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.784598:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 816 00000100:00100000:0.0:1762166857.784604:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765444515328:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.784613:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.784628:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee382045200/0xf915a5bdf3c9eec8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a1d expref: 24 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.784637:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee382045200/0xf915a5bdf3c9eec8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a1d expref: 24 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.784658:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee382045200/0xf915a5bdf3c9eec8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a1d expref: 24 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.784671:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.784673:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.784677:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f09d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.784700:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f09d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.784728:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.784760:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f09d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.784786:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444515328:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 180us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.784795:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 816 00010000:00010000:2.0:1762166857.784812:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f09d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.784853:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f09d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.784863:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f09d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.784873:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f09d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.784893:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166857.784899:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f09d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.784908:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f09d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.784919:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f09d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.784925:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f09d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.784977:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444515200:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 1744us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.784985:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1209 00000100:00100000:3.0:1762166857.786135:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.786183:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444515456 00000100:00100000:2.0:1762166857.786190:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444515456 00000100:00100000:2.0:1762166857.786242:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1210 00000100:00100000:2.0:1762166857.786254:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765444515456:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.786268:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.786283:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f0a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91acc expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166857.786302:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x8a:0x0] initial LVB size: 0, mtime: 0x69088847, atime: 0x69088847, ctime: 0x69088849, blocks: 0x1 00010000:00010000:2.0:1762166857.786338:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.786340:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.786350:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f0a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91acc expref: 23 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.786365:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f0a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91acc expref: 23 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.786375:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2400, rc 0) 00000100:00100000:2.0:1762166857.786410:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2358:x1847765444515456:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 158us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.786430:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1210 00000100:00100000:3.0:1762166857.811490:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.811557:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444515584 00000100:00100000:2.0:1762166857.811569:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444515584 00000100:00100000:2.0:1762166857.811632:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 392 00000100:00100000:2.0:1762166857.811642:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49318:x1847765444515584:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:1.0:1762166857.821379:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935005 is committed 00000004:00080000:1.0:1762166857.821448:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000100:00100000:2.0:1762166857.821485:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:49318:x1847765444515584:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 9839us (9999us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.821498:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 392 00000020:00080000:1.0:1762166857.821508:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee24463e3c0 refcount 2 committed 0 result 0 batchid 4294969124 00000020:00080000:1.0:1762166857.821515:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee241fb7900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee24463e600 00000020:00080000:1.0:1762166857.821527:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee241fb7200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee2481a1c00 00000020:00080000:1.0:1762166857.821556:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969123 batchid updated 00000100:00100000:2.0:1762166857.821574:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451995648:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1762166857.821575:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969124 committed batchid 4294969123 00000100:00100000:2.0:1762166857.821631:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166857.821669:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451995776:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762166857.821685:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451995904:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762166857.821691:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451995648 00000100:00100000:2.0:1762166857.821699:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451995648 00000100:00100000:0.0:1762166857.821729:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166857.821741:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451995904 00000100:00100000:2.0:1762166857.821746:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451995904 00000100:00100000:3.0:1762166857.821794:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166857.821812:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451995776 00000100:00100000:0.0:1762166857.821818:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451995776 00000100:00100000:2.0:1762166857.821824:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:2.0:1762166857.821837:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765451995648:12345-0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1762166857.821847:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969123 00000100:00100000:0.0:1762166857.821858:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00002000:00080000:2.0:1762166857.821867:0:26444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:136 count 1 00000100:00100000:3.0:1762166857.821868:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:0.0:1762166857.821875:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765451995904:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166857.821883:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765451995776:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762166857.821892:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f0ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1762166857.821893:0:6533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:138 count 1 00002000:00080000:3.0:1762166857.821901:0:7858:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:137 count 1 00010000:00010000:0.0:1762166857.821910:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f0b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.821911:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9e6f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91730 expref: 13 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.821916:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.821935:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166857.821939:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9eed6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a24 expref: 13 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.821940:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166857.821944:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9eae6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918aa expref: 13 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.821946:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f0ab lrc: 4/0,1 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.821960:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166857.821964:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166857.821968:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f0b2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.821970:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166857.821975:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166857.821979:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0b9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.821994:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9e6f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91730 expref: 13 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.822000:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9eed6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a24 expref: 13 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.822016:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9e6f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91730 expref: 13 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.822018:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9eed6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a24 expref: 13 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166857.822025:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9eae6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918aa expref: 13 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.822044:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451996160:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.822049:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f279500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451996032:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166857.822050:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9eae6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918aa expref: 13 pid: 26444 timeout: 578 lvb_type: 0 00000100:00100000:3.0:1762166857.822066:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ce9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451996288:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166857.822103:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.822104:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463e540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.822104:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9a840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.823126:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.823172:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444515712 00000100:00100000:2.0:1762166857.823178:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444515712 00000100:00100000:2.0:1762166857.823213:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1214 00000100:00100000:2.0:1762166857.823223:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765444515712:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:0.0:1762166857.823232:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f279500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765451996032:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.823257:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f0ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.823283:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451996160:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.823294:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765444515712:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 71us (169us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166857.823295:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f0b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166857.823302:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ce9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765451996288:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166857.823309:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.823310:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1214 00010000:00010000:1.0:1762166857.823323:0:7858:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166857.823342:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444515840 00000100:00100000:3.0:1762166857.823347:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444515840 00000100:00100000:2.0:1762166857.823366:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166857.823371:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9e6f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91730 expref: 14 pid: 26444 timeout: 578 lvb_type: 0 00000100:00100000:3.0:1762166857.823402:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444515968 00000100:00100000:3.0:1762166857.823407:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444515968 00000100:00100000:2.0:1762166857.823408:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.823431:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444516096 00010000:00010000:3.0:1762166857.823436:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9eed6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a24 expref: 15 pid: 26444 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.823438:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444516096 00000100:00100000:1.0:1762166857.823443:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 817 00000100:00100000:1.0:1762166857.823455:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444515840:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.823463:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9eae6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918aa expref: 16 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1762166857.823466:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166857.823470:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 818 00010000:00010000:1.0:1762166857.823478:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9e6f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91730 expref: 16 pid: 26444 timeout: 578 lvb_type: 0 00000100:00100000:3.0:1762166857.823484:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f279c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444515968:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166857.823496:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166857.823503:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 819 00010000:00010000:1.0:1762166857.823503:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9e6f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91730 expref: 16 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166857.823504:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9eed6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a24 expref: 16 pid: 26444 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.823519:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2358:x1847765444516096:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.823529:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.823538:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9eae6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918aa expref: 16 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1762166857.823538:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9e6f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91730 expref: 16 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166857.823541:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9eed6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a24 expref: 16 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.823558:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9eae6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918aa expref: 15 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1762166857.823558:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166857.823561:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166857.823565:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f0ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.823567:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9eed6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a24 expref: 15 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.823575:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9eae6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f918aa expref: 15 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1762166857.823585:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f0ab lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.823594:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166857.823598:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.823602:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166857.823603:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f0b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.823605:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.823610:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.823616:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166857.823618:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f0b2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.823623:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0b9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.823637:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f0ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.823639:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166857.823639:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765444515840:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 186us (336us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166857.823646:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166857.823655:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f0ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166857.823656:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 817 00000100:00100000:3.0:1762166857.823664:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f279c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444515968:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 183us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.823673:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2358:x1847765444516096:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 158us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.823674:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 818 00010000:00010000:1.0:1762166857.823681:0:7858:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.823691:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 819 00010000:00010000:1.0:1762166857.823698:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.823699:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f0ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.823715:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.823718:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f0ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.823733:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.823752:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1762166857.823758:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1762166857.823800:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1762166857.823814:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f0ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.823815:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166857.823823:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.823826:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166857.823833:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f0ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.823841:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f0ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.823853:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f0ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.823859:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f0ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.823878:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382044600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166857.823878:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166857.823881:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166857.823885:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.823886:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166857.823908:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.823922:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.823929:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.823950:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166857.823953:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166857.823955:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166857.824095:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765451995648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2264us (2465us total) trans 21474836790 rc 0/0 00000100:00100000:0.0:1762166857.824100:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1762166857.824118:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765451995776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2238us (2324us total) trans 21474836791 rc 0/0 00010000:00010000:0.0:1762166857.824121:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f0b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166857.824131:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000004:00080000:2.0:1762166857.824132:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34371b100/2, rc 0, transno 21474836790 00010000:00010000:0.0:1762166857.824134:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f0b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.824143:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451995648:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1762166857.824145:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34371ad80/2, rc 0, transno 21474836791 00010000:00010000:0.0:1762166857.824148:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f0b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166857.824156:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451995776:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1762166857.824160:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f0b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.824179:0:6533:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166857.824190:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166857.824197:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f0b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.824206:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166857.824209:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f0b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.824226:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f0b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.824236:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f0b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.824240:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f0b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.824251:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166857.824253:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166857.824254:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166857.824302:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3293:x1847765451995904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2435us (2574us total) trans 21474836792 rc 0/0 00000100:00100000:0.0:1762166857.824311:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000004:00080000:3.0:1762166857.824328:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee343719880/2, rc 0, transno 21474836792 00000100:00100000:3.0:1762166857.824335:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765451995904:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166857.827882:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.827918:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444516224 00000100:00100000:0.0:1762166857.827926:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444516224 00000100:00100000:0.0:1762166857.827965:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 61 00000100:00100000:0.0:1762166857.827971:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2360:x1847765444516224:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:0.0:1762166857.828021:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2360:x1847765444516224:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 49us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.828028:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 61 00000100:00100000:3.0:1762166857.830543:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.830602:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444516352 00000100:00100000:0.0:1762166857.830609:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444516352 00000100:00100000:0.0:1762166857.830654:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1215 00000100:00100000:0.0:1762166857.830664:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2359:x1847765444516352:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762166857.830701:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0c0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.830715:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.830717:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.830721:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.830733:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.830758:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.830784:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.830810:0:6533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.830816:0:6533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166857.830820:0:6533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.830829:0:6533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.830844:0:6533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.830852:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.830910:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2359:x1847765444516352:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 248us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.830921:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1215 00000100:00100000:2.0:1762166857.831889:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.831946:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444516608 00000100:00100000:3.0:1762166857.831953:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444516608 00000100:00100000:3.0:1762166857.831995:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 393 00000100:00100000:3.0:1762166857.832004:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49318:x1847765444516608:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166857.832041:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.832057:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f06c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x39:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91aa9 expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.832078:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x39:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:3.0:1762166857.832086:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166857.832110:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0c7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.832117:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0c7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166857.832123:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0c7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:3.0:1762166857.832287:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007c59d512 reply state 00000000939864ef transno 8589935006 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0c7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166857.832296:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166857.832368:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49318:x1847765444516608:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 364us (480us total) trans 8589935006 rc 0/0 00000100:00100000:3.0:1762166857.832375:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 393 00010000:00010000:0.0:1762166857.832997:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0c7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.833008:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0c7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.833014:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0c7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.833031:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382044600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.833034:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0c7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.833039:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0c7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.833047:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x39:0x0].0x0 (ffff9ee363960e00) 00010000:00010000:0.0:1762166857.833049:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166857.833051:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0c7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166857.833055:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f0c7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166857.833173:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.833206:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444516736 00000100:00100000:3.0:1762166857.833212:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444516736 00000100:00100000:0.0:1762166857.833276:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 394 00000100:00100000:0.0:1762166857.833292:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49318:x1847765444516736:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.833306:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.833319:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f0ce lrc: 2/0,0 mode: --/CR res: [0x200000404:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ad3 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.833355:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f0ce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ad3 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.833366:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f0ce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ad3 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.833383:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x39:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166857.833386:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166857.833393:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198800, rc 0) 00000100:00100000:0.0:1762166857.833442:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49318:x1847765444516736:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 158us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.833449:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 394 00000100:00100000:1.0:1762166857.834213:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.834252:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444516864 00000100:00100000:0.0:1762166857.834257:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444516864 00000100:00100000:0.0:1762166857.834294:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1216 00000100:00100000:0.0:1762166857.834303:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:49318:x1847765444516864:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.834313:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.834324:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f0d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ada expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.834343:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f073 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ab0 expref: 12 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.834349:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.834350:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.834353:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f0d5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ada expref: 12 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.834374:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f073 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ab0 expref: 12 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.834384:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f073 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ab0 expref: 12 pid: 26444 timeout: 578 lvb_type: 1 00000100:00100000:0.0:1762166857.834394:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451996416:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.834459:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9af00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.835161:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451996416:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.835180:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f0d5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ada expref: 12 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.835193:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198c00, rc 0) 00000100:00100000:0.0:1762166857.835231:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:49318:x1847765444516864:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 929us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.835243:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1216 00000100:00100000:1.0:1762166857.835322:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.835413:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444516992 00000100:00100000:3.0:1762166857.835429:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444516992 00010000:00010000:3.0:1762166857.835450:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f073 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ab0 expref: 12 pid: 26444 timeout: 578 lvb_type: 1 00000100:00100000:3.0:1762166857.835479:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 820 00000100:00100000:3.0:1762166857.835489:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444516992:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166857.835499:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.835516:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f073 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ab0 expref: 12 pid: 26444 timeout: 578 lvb_type: 1 00010000:00010000:3.0:1762166857.835536:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f073 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ab0 expref: 12 pid: 26444 timeout: 578 lvb_type: 1 00010000:00010000:3.0:1762166857.835552:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f073 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ab0 expref: 12 pid: 26444 timeout: 578 lvb_type: 1 00010000:00010000:3.0:1762166857.835564:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166857.835566:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166857.835571:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f0d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ada expref: 11 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.835580:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f0d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ada expref: 11 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.835605:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f0d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ada expref: 11 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166857.835616:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ce9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765451996544:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762166857.835663:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.836354:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ce9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765451996544:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762166857.836366:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166857.836405:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765444516992:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 918us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.836413:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 820 00000100:00100000:2.0:1762166857.836651:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.836692:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444517120 00000100:00100000:0.0:1762166857.836697:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444517120 00000100:00100000:0.0:1762166857.836731:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1217 00000100:00100000:0.0:1762166857.836739:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765444517120:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166857.836981:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x8b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166857.836985:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x8b:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:0.0:1762166857.836988:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x8b:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:0.0:1762166857.836990:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x8b:0x0] updating lvb ctime from disk: 0 -> 1762166858 00002000:00010000:0.0:1762166857.836992:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x8b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166857.837024:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444517120:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 286us (374us total) trans 21474836793 rc 0/0 00000100:00100000:0.0:1762166857.837030:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1217 00000100:00100000:2.0:1762166857.837803:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.837838:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444517376 00000100:00100000:0.0:1762166857.837843:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444517376 00000100:00100000:0.0:1762166857.837876:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 395 00000100:00100000:0.0:1762166857.837884:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49318:x1847765444517376:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166857.837931:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.837963:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f057 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a9b expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.837978:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:0.0:1762166857.837982:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166857.838012:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0dc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.838024:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.838033:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762166857.838121:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007ea41c2b reply state 00000000d0937380 transno 8589935007 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166857.838130:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166857.838184:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49318:x1847765444517376:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 300us (381us total) trans 8589935007 rc 0/0 00000100:00100000:0.0:1762166857.838191:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 395 00010000:00010000:2.0:1762166857.838840:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.838851:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0dc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.838858:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0dc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.838864:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166857.838868:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0dc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.838887:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0dc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.838899:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166857.838903:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166857.838907:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0dc lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.838914:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f0dc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166857.838927:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.838973:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444517504 00000100:00100000:0.0:1762166857.838978:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444517504 00000100:00100000:0.0:1762166857.839013:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1218 00000100:00100000:0.0:1762166857.839022:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:49318:x1847765444517504:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.839034:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.839045:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f0e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ae1 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.839073:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f0a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91acc expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.839078:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.839079:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.839082:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f0e3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae1 expref: 24 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.839100:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f0a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91acc expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.839108:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f0a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91acc expref: 24 pid: 26444 timeout: 578 lvb_type: 1 00000100:00100000:0.0:1762166857.839117:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765451996672:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.839159:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9af00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.839837:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765451996672:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.839856:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f0e3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae1 expref: 24 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.839869:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198a00, rc 0) 00000100:00100000:0.0:1762166857.839901:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:49318:x1847765444517504:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 880us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.839908:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1218 00000100:00100000:3.0:1762166857.840016:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.840059:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444517632 00000100:00100000:2.0:1762166857.840065:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444517632 00010000:00010000:2.0:1762166857.840085:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f0a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91acc expref: 24 pid: 26444 timeout: 578 lvb_type: 1 00000100:00100000:2.0:1762166857.840117:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 821 00000100:00100000:2.0:1762166857.840126:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444517632:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.840135:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.840152:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f0a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91acc expref: 24 pid: 26444 timeout: 578 lvb_type: 1 00010000:00010000:2.0:1762166857.840163:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f0a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91acc expref: 24 pid: 26444 timeout: 578 lvb_type: 1 00010000:00010000:2.0:1762166857.840183:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f0a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91acc expref: 24 pid: 26444 timeout: 578 lvb_type: 1 00010000:00010000:2.0:1762166857.840206:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.840207:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.840212:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f0e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae1 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.840221:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f0e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae1 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.840245:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f0e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae1 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.840256:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f279500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765451996800:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762166857.840302:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.841091:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f279500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765451996800:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762166857.841101:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166857.841132:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444517632:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1007us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.841140:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 821 00000100:00100000:3.0:1762166857.841234:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.841338:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444517760 00000100:00100000:0.0:1762166857.841349:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444517760 00000100:00100000:0.0:1762166857.841379:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1219 00000100:00100000:0.0:1762166857.841386:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444517760:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166857.841534:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x8a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166857.841538:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x8a:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166857.841541:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x8a:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166857.841543:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8a:0x0] updating lvb ctime from disk: 1762166857 -> 1762166858 00002000:00010000:0.0:1762166857.841545:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x8a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166857.841578:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444517760:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 192us (343us total) trans 17179869461 rc 0/0 00000100:00100000:0.0:1762166857.841584:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1219 00000100:00100000:1.0:1762166857.842539:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.842581:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444518016 00000100:00100000:2.0:1762166857.842586:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444518016 00000100:00100000:2.0:1762166857.842612:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 164 00000100:00100000:2.0:1762166857.842617:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348213c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49318:x1847765444518016:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166857.842666:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f081 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ab7 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.842701:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f0ea lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.842712:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9efaf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a63 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.842720:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9effc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a78 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.842728:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f0ea lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.842749:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9effc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a78 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.842757:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9effc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a78 expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.842792:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f279500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451996928:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.842854:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9efaf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a63 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.842863:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9efaf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a63 expref: 27 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.842873:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff80380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451997056:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.842908:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.843674:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f279500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451996928:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166857.843686:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.843688:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff80380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451997056:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.843712:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f0ea lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166857.843833:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444518272 00000100:00100000:3.0:1762166857.843838:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444518272 00000100:00100000:0.0:1762166857.843857:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.843875:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 165 00000100:00100000:3.0:1762166857.843884:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49238:x1847765444518272:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166857.843894:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444518400 00000100:00100000:2.0:1762166857.843900:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444518400 00010000:00010000:2.0:1762166857.843926:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9efaf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a63 expref: 29 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.843956:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 822 00000100:00100000:2.0:1762166857.843966:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765444518400:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.843977:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.843983:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9efaf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a63 expref: 30 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.843992:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9efaf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a63 expref: 30 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.844007:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9efaf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a63 expref: 30 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.844021:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166857.844026:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f0ea lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.844033:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f0ea lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166857.844044:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49238:x1847765444518272:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 160us (359us total) trans 8589935008 rc 0/0 00010000:00010000:2.0:1762166857.844059:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166857.844061:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 165 00000100:00100000:2.0:1762166857.844089:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444518400:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 125us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.844098:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 822 00000100:00100000:1.0:1762166857.844749:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.844828:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444518528 00000100:00100000:2.0:1762166857.844832:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444518528 00010000:00010000:2.0:1762166857.844845:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9effc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a78 expref: 28 pid: 30818 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.844864:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 823 00000100:00100000:2.0:1762166857.844871:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444518528:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.844880:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.844885:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9effc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a78 expref: 28 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.844894:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9effc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a78 expref: 28 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.844906:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9effc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91a78 expref: 28 pid: 30818 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.844917:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166857.844921:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f0ea lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.844929:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f0ea lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.844940:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f0ea lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.844959:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166857.844976:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f0ea lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.844986:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f0ea lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166857.844988:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444518528:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 116us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.845004:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 823 00010000:00010000:0.0:1762166857.845010:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f0f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.845023:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f0ce lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ad3 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.845031:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f0f1 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x39:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.845053:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f0ce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ad3 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.845074:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f0ce lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ad3 expref: 26 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.845085:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451997184:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.845130:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9af00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.845834:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451997184:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.845848:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f0f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x39:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166857.845984:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.846026:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444518656 00000100:00100000:2.0:1762166857.846032:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444518656 00010000:00010000:2.0:1762166857.846050:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f0ce lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ad3 expref: 27 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.846081:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 824 00000100:00100000:2.0:1762166857.846090:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444518656:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.846099:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.846104:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f0ce lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ad3 expref: 27 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.846112:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f0ce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ad3 expref: 27 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.846120:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f0ce lrc: 0/0,0 mode: --/CR res: [0x200000404:0x39:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ad3 expref: 27 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.846128:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x39:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:2.0:1762166857.846130:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f0f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x39:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.846144:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f0f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x39:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.846147:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f0f1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x39:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.846163:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166857.846183:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f0f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166857.846187:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444518656:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 99us (203us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166857.846198:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f0f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166857.846199:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 824 00000100:00100000:0.0:1762166857.846519:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451997312:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166857.846564:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166857.846590:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.846612:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451997312 00000100:00100000:2.0:1762166857.846617:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451997312 00000100:00100000:2.0:1762166857.846645:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1762166857.846650:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:31351:x1847765451997312:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166857.846713:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:31351:x1847765451997312:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 62us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.846720:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1762166857.846741:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451997312:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166857.846792:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451997440:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166857.846811:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166857.846824:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.846844:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451997440 00000100:00100000:2.0:1762166857.846849:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451997440 00000100:00100000:2.0:1762166857.846874:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1762166857.846881:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:31351:x1847765451997440:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166857.846926:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:31351:x1847765451997440:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 47us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.846931:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1762166857.846948:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451997440:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1762166857.847066:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935009 00000100:00100000:0.0:1762166857.847108:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451997568:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166857.847137:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166857.847156:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157b40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.847166:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451997568 00000100:00100000:2.0:1762166857.847170:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451997568 00000100:00100000:2.0:1762166857.847191:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1762166857.847195:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:31351:x1847765451997568:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166857.847315:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:31351:x1847765451997568:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 118us (176us total) trans 21474836794 rc 0/0 00000100:00100000:2.0:1762166857.847323:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1762166857.847344:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451997568:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1762166857.847390:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935010 00010000:00010000:0.0:1762166857.847406:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f0f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.847411:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f0f1 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.847428:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f0f1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.847432:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.847434:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f0f1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.847439:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f0f1 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.847446:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x39:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166857.847448:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166857.847451:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f0f1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.847454:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f0f1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.847465:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f0ea lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.847468:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f0ea lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.847479:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f0ea lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.847482:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.847483:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f0ea lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.847486:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f0ea lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.847490:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:0.0:1762166857.847492:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166857.847494:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f0ea lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.847499:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f0ea lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.847514:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:0.0:1762166857.847516:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166857.847520:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f081 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ab7 expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.847588:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348213c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49318:x1847765444518016:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 4969us (5050us total) trans 8589935011 rc 0/0 00000100:00100000:0.0:1762166857.847597:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 164 00000020:00080000:0.0:1762166857.847602:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166857.848534:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.848576:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444518784 00000100:00100000:0.0:1762166857.848582:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444518784 00000100:00100000:0.0:1762166857.848620:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 396 00000100:00100000:0.0:1762166857.848631:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49318:x1847765444518784:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.848654:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.848670:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f0f8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ae8 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.848723:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f0f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae8 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.848735:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f0f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae8 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.848749:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166857.848752:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166857.848755:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199a00, rc 0) 00000100:00100000:0.0:1762166857.848809:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49318:x1847765444518784:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 181us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.848816:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 396 00000100:00100000:1.0:1762166857.849882:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.849915:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444519040 00000100:00100000:0.0:1762166857.849921:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444519040 00000100:00100000:0.0:1762166857.849953:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 166 00000100:00100000:0.0:1762166857.849961:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49318:x1847765444519040:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166857.850111:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49318:x1847765444519040:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 150us (229us total) trans 8589935012 rc 0/0 00000100:00100000:0.0:1762166857.850119:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 166 00000100:00100000:3.0:1762166857.850884:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.850926:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444519296 00000100:00100000:0.0:1762166857.850931:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444519296 00000100:00100000:0.0:1762166857.850960:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 167 00000100:00100000:0.0:1762166857.850969:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49318:x1847765444519296:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:0.0:1762166857.851184:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x39:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166857.851274:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f0ff lrc: 3/0,1 mode: --/PW res: [0x200000404:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.851287:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f0ff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.851297:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f0ff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.851305:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f0ff lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.851311:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f0ff lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.851317:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f0ff lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.851339:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166857.851372:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166857.851381:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f0ff lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.851389:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166857.851399:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f0ff lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.851407:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f0ff lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.851413:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49318:x1847765444519296:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 443us (528us total) trans 8589935013 rc 0/0 00000100:00100000:0.0:1762166857.851432:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 167 00010000:00010000:2.0:1762166857.851437:0:32135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x39:0x0].0x0 (ffff9ee34bdb4200) 00010000:00010000:2.0:1762166857.851442:0:32135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166857.851447:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f0ff lrc: 1/0,0 mode: --/PW res: [0x200000404:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.851453:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f0ff lrc: 0/0,0 mode: --/PW res: [0x200000404:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.851469:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166857.851472:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166857.851474:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166857.859424:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.859479:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444519424 00000100:00100000:0.0:1762166857.859490:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444519424 00000100:00100000:0.0:1762166857.859548:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 397 00000100:00100000:0.0:1762166857.859560:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49320:x1847765444519424:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166857.859583:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.859604:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f106 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91aef expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.859697:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f10d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.859711:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f10d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.859721:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f10d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.859734:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f114 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.859740:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f114 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.859745:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f114 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.859883:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f11b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.859891:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f11b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.859898:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f11b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166857.859927:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166857.859932:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166857.859952:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f11b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.859964:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f11b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.859979:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f10d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.859985:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f10d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.859991:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f10d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.859997:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.860001:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f10d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.860008:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f10d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.860019:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166857.860022:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166857.860026:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f10d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.860032:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f10d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.860044:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f114 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.860050:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f114 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.860061:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f114 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.860066:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.860074:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f114 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.860079:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f114 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.860087:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4400) 00010000:00010000:0.0:1762166857.860090:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166857.860093:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f114 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.860098:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f114 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.860127:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f106 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91aef expref: 32 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.860140:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f11b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91aef expref: 31 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.860147:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166857.860150:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166857.860152:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199000, rc 0) 00000100:00100000:0.0:1762166857.860208:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49320:x1847765444519424:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 650us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.860216:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 397 00000100:00100000:1.0:1762166857.874279:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.874357:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444519552 00000100:00100000:0.0:1762166857.874370:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444519552 00000100:00100000:0.0:1762166857.874444:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 398 00000100:00100000:0.0:1762166857.874454:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49324:x1847765444519552:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166857.874534:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f122 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874549:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f122 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874560:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f122 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874572:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f129 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874578:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f129 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874585:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f129 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874687:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f130 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874696:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f130 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874703:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f130 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166857.874730:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166857.874734:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166857.874748:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f130 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874780:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f122 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874797:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f122 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874805:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f122 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874811:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.874816:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f122 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874823:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f122 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874839:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166857.874842:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166857.874845:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f122 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874850:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f122 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874860:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f129 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874866:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f129 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874871:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f129 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874875:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.874878:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f129 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874893:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f129 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874901:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4400) 00010000:00010000:0.0:1762166857.874904:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166857.874906:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f129 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874912:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f129 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874926:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f130 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874931:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f130 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874936:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f130 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874940:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.874942:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f130 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874947:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f130 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874954:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166857.874956:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166857.874959:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f130 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.874964:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f130 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166857.875061:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49324:x1847765444519552:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 608us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.875069:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 398 00000100:00100000:3.0:1762166857.885010:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.885089:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444519808 00000100:00100000:0.0:1762166857.885100:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444519808 00000100:00100000:0.0:1762166857.885154:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 399 00000100:00100000:0.0:1762166857.885164:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49326:x1847765444519808:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.885186:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.885204:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f137 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91af6 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.885296:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f13e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.885318:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f13e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.885330:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f13e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166857.885340:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166857.885473:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f137 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91af6 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.885502:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f13e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91af6 expref: 33 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.885511:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166857.885514:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166857.885530:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199600, rc 0) 00000100:00100000:0.0:1762166857.885590:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49326:x1847765444519808:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 428us (588us total) trans 8589935014 rc 0/0 00000100:00100000:0.0:1762166857.885598:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 399 00000100:00100000:3.0:1762166857.888037:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.888094:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444520064 00000100:00100000:0.0:1762166857.888103:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444520064 00000100:00100000:0.0:1762166857.888153:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 400 00000100:00100000:0.0:1762166857.888164:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49326:x1847765444520064:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.888189:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.888207:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f14c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91afd expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.888302:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f153 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.888317:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f11b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91aef expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.888326:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f153 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.888359:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f11b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91aef expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.888372:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f11b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91aef expref: 34 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.888386:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451997696:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.888476:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9af00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.889453:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451997696:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.889471:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f153 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166857.889740:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.889800:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444520192 00000100:00100000:2.0:1762166857.889806:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444520192 00010000:00010000:2.0:1762166857.889830:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f11b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91aef expref: 35 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.889870:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 825 00000100:00100000:2.0:1762166857.889881:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444520192:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.889907:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.889915:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f11b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91aef expref: 35 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.889928:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f11b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91aef expref: 35 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.889947:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f11b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91aef expref: 35 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.889961:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:2.0:1762166857.889965:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f153 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.889973:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f153 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.889979:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f153 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.890008:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166857.890041:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f153 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166857.890049:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765444520192:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 168us (308us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166857.890054:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f153 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166857.890062:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 825 00000004:00200000:0.0:1762166857.890073:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166857.890197:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f14c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91afd expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.890210:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f153 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91afd expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.890217:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166857.890220:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166857.890223:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199400, rc 0) 00000100:00100000:0.0:1762166857.890259:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49326:x1847765444520064:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2097us (2230us total) trans 8589935015 rc 0/0 00000100:00100000:0.0:1762166857.890265:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 400 00000100:00100000:3.0:1762166857.891371:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.891426:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444520320 00000100:00100000:0.0:1762166857.891431:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444520320 00000100:00100000:0.0:1762166857.891466:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 168 00000100:00100000:0.0:1762166857.891476:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49326:x1847765444520320:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:0.0:1762166857.891581:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49326:x1847765444520320:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 107us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.891601:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 168 00000100:00100000:1.0:1762166857.892403:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.892462:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444520576 00000100:00100000:0.0:1762166857.892470:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444520576 00000100:00100000:0.0:1762166857.892508:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 169 00000100:00100000:0.0:1762166857.892515:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49326:x1847765444520576:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166857.892675:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49326:x1847765444520576:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 159us (281us total) trans 8589935016 rc 0/0 00000100:00100000:0.0:1762166857.892687:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 169 00000100:00100000:3.0:1762166857.893517:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.893573:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444520832 00000100:00100000:0.0:1762166857.893578:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444520832 00000100:00100000:0.0:1762166857.893618:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 401 00000100:00100000:0.0:1762166857.893627:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49326:x1847765444520832:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.893641:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.893645:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166857.893664:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f153 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91afd expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.893679:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f13e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91af6 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.893688:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166857.893692:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166857.893704:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f161 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b04 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.893792:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f168 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.893815:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f168 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.893824:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f168 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166857.893836:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166857.893922:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f161 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b04 expref: 36 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.893936:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f168 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b04 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.893943:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166857.893946:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166857.893949:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198600, rc 0) 00000100:00100000:0.0:1762166857.893992:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49326:x1847765444520832:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 366us (474us total) trans 8589935017 rc 0/0 00000100:00100000:0.0:1762166857.893998:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 401 00000100:00100000:3.0:1762166857.895323:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.895368:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444521088 00000100:00100000:0.0:1762166857.895374:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444521088 00000100:00100000:0.0:1762166857.895410:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 170 00000100:00100000:0.0:1762166857.895428:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348212c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49326:x1847765444521088:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166857.895475:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f168 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b04 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.895496:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f176 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.895520:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f0f8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae8 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.895527:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f176 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.895559:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f0f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae8 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.895571:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f0f8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae8 expref: 35 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.895584:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451997824:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.895656:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9af00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.896844:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451997824:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.896877:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f176 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166857.897050:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.897165:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444521216 00000100:00100000:2.0:1762166857.897171:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444521216 00010000:00010000:2.0:1762166857.897199:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f0f8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae8 expref: 36 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.897235:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 826 00000100:00100000:2.0:1762166857.897254:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765444521216:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.897267:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.897274:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f0f8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae8 expref: 36 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.897286:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f0f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae8 expref: 36 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.897303:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f0f8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae8 expref: 36 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.897320:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:2.0:1762166857.897324:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f176 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.897330:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f176 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.897335:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f176 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.897354:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166857.897384:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f176 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166857.897387:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444521216:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 135us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.897400:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 826 00010000:00010000:0.0:1762166857.897403:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f176 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.897638:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f176 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.897645:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f176 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.897662:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f176 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.897667:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.897671:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f176 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.897678:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f176 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.897687:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166857.897690:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166857.897693:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f176 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.897698:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f176 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.897709:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166857.897712:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166857.897716:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f168 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b04 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.897863:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348212c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49326:x1847765444521088:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2444us (2543us total) trans 8589935018 rc -22/-22 00000100:00100000:0.0:1762166857.897873:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 170 00000100:00100000:3.0:1762166857.899450:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.899536:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444521344 00000100:00100000:0.0:1762166857.899546:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444521344 00000100:00100000:0.0:1762166857.899611:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 402 00000100:00100000:0.0:1762166857.899621:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49326:x1847765444521344:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.899653:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.899672:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f17d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b0b expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.899727:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f17d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b0b expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.899740:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f17d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b0b expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.899757:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4400) 00010000:00010000:0.0:1762166857.899785:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166857.899790:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198200, rc 0) 00000100:00100000:0.0:1762166857.899853:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49326:x1847765444521344:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 233us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.899861:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 402 00000100:00100000:1.0:1762166857.902188:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.902251:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444521600 00000100:00100000:0.0:1762166857.902263:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444521600 00000100:00100000:0.0:1762166857.902323:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 403 00000100:00100000:0.0:1762166857.902333:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49326:x1847765444521600:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.902351:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.902369:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f184 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b12 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.902895:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f18b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.902909:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f18b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.902933:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f18b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166857.902944:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x3a:0x0]: returning size 0 00010000:00010000:0.0:1762166857.902995:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f184 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b12 expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.903009:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f18b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b12 expref: 37 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.903015:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3a:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166857.903017:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166857.903019:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199e00, rc 0) 00000100:00100000:0.0:1762166857.903084:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49326:x1847765444521600:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 749us (899us total) trans 8589935019 rc 0/0 00000100:00100000:0.0:1762166857.903093:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 403 00000100:00100000:3.0:1762166857.905031:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.905102:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444521856 00000100:00100000:0.0:1762166857.905110:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444521856 00000100:00100000:0.0:1762166857.905161:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 404 00000100:00100000:0.0:1762166857.905170:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49326:x1847765444521856:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.905189:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.905201:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f199 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b19 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.905262:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f1a0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.905270:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f1a0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.905288:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f1a0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166857.905298:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166857.905375:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f199 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b19 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.905386:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f1a0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b19 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.905392:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4400) 00010000:00010000:0.0:1762166857.905394:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166857.905396:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199c00, rc 0) 00000100:00100000:0.0:1762166857.905450:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49326:x1847765444521856:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 282us (424us total) trans 8589935020 rc 0/0 00000100:00100000:0.0:1762166857.905455:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 404 00000100:00100000:3.0:1762166857.907111:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.907171:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444522112 00000100:00100000:0.0:1762166857.907183:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444522112 00000100:00100000:0.0:1762166857.907230:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 171 00000100:00100000:0.0:1762166857.907241:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49326:x1847765444522112:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166857.907295:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f1a0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b19 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.907325:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1ae lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.907337:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f17d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b0b expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.907361:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1ae lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.907394:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f17d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b0b expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.907404:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f17d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b0b expref: 39 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.907426:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451997952:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.907494:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9a300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.908557:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451997952:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.908579:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1ae lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166857.908862:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.908928:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444522240 00000100:00100000:2.0:1762166857.908939:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444522240 00010000:00010000:2.0:1762166857.908985:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f17d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b0b expref: 40 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.909049:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 827 00000100:00100000:2.0:1762166857.909059:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2360:x1847765444522240:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.909074:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.909080:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f17d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b0b expref: 40 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.909090:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f17d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b0b expref: 40 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.909108:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f17d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b0b expref: 40 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.909127:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4400) 00010000:00010000:2.0:1762166857.909132:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1ae lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.909142:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.909149:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1ae lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.909179:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166857.909211:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.909221:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166857.909232:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444522240:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 175us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.909239:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 827 00010000:00010000:0.0:1762166857.909244:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.909260:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f18b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b12 expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.909269:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1b5 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.909313:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f18b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b12 expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.909329:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f18b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b12 expref: 38 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.909343:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451998080:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.909432:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9a300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.910314:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765451998080:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.910333:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166857.910580:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.910624:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444522368 00000100:00100000:2.0:1762166857.910630:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444522368 00010000:00010000:2.0:1762166857.910659:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f18b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b12 expref: 39 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.910691:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 828 00000100:00100000:2.0:1762166857.910700:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444522368:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.910711:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.910716:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f18b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b12 expref: 39 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.910728:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f18b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b12 expref: 39 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.910747:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f18b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b12 expref: 39 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.910792:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3a:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:2.0:1762166857.910796:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.910805:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.910811:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1b5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.910832:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166857.910862:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2361:x1847765444522368:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 163us (281us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166857.910863:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166857.910875:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 828 00010000:00010000:0.0:1762166857.910876:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166857.911485:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451998208:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166857.911538:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166857.911573:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee346998480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.911585:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451998208 00000100:00100000:2.0:1762166857.911598:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451998208 00000100:00100000:2.0:1762166857.911642:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1762166857.911649:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:31351:x1847765451998208:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166857.911727:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:31351:x1847765451998208:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 79us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.911732:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1762166857.911792:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765451998208:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1762166857.911841:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935021 00000001:00080000:0.0:1762166857.911902:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935022 00010000:00010000:0.0:1762166857.911921:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.911935:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1b5 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.911949:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1b5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.911956:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.911960:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1b5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.911968:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1b5 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.911979:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3a:0x0].0x0 (ffff9ee34bdb4e00) 00010000:00010000:0.0:1762166857.911982:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166857.911986:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1b5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.911993:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1b5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.912014:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.912019:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1ae lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.912025:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1ae lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.912030:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.912033:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1ae lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.912037:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1ae lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.912054:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4400) 00010000:00010000:0.0:1762166857.912056:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166857.912059:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1ae lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.912064:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1ae lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.912075:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4400) 00010000:00010000:0.0:1762166857.912077:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166857.912082:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f1a0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b19 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.912170:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49326:x1847765444522112:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 4932us (5068us total) trans 8589935023 rc 0/0 00000100:00100000:0.0:1762166857.912180:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 171 00000020:00080000:0.0:1762166857.912184:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166857.913379:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.913465:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444522496 00000100:00100000:0.0:1762166857.913474:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444522496 00000100:00100000:0.0:1762166857.913526:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 405 00000100:00100000:0.0:1762166857.913535:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49326:x1847765444522496:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.913556:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.913576:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f1bc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b20 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.913632:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f1bc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b20 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.913647:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f1bc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b20 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.913676:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166857.913680:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166857.913683:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198000, rc 0) 00000100:00100000:0.0:1762166857.913728:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49326:x1847765444522496:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 194us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.913736:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 405 00000100:00100000:3.0:1762166857.915154:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.915210:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444522752 00000100:00100000:0.0:1762166857.915219:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444522752 00000100:00100000:0.0:1762166857.915265:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 172 00000100:00100000:0.0:1762166857.915273:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49326:x1847765444522752:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:0.0:1762166857.915695:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x3a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1762166857.915845:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].16, 64 off9408 00000004:00080000:0.0:1762166857.915854:0:31351:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 478708090916ns, next at 479708088503ns, rc = 0 00000001:00080000:0.0:1762166857.915863:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935024 00010000:00010000:0.0:1762166857.915917:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f1c3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.915933:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f1c3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.915946:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f1c3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.915953:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f1c3 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.915960:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f1c3 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.915977:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f1c3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166857.916007:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1762166857.916126:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49326:x1847765444522752:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 852us (974us total) trans 8589935025 rc 0/0 00010000:00010000:2.0:1762166857.916132:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1762166857.916134:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 172 00010000:00010000:2.0:1762166857.916139:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f1c3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00000020:00080000:0.0:1762166857.916140:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762166857.916146:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166857.916150:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f1c3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.916157:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f1c3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.916169:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3a:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:2.0:1762166857.916173:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166857.916181:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f1c3 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.916187:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f1c3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166857.916205:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166857.916207:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166857.916209:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166857.917563:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.917624:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444523008 00000100:00100000:0.0:1762166857.917633:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444523008 00000100:00100000:0.0:1762166857.917683:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 173 00000100:00100000:0.0:1762166857.917692:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49326:x1847765444523008:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166857.917950:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49326:x1847765444523008:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 258us (392us total) trans 8589935026 rc 0/0 00000100:00100000:0.0:1762166857.917958:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 173 00000100:00100000:3.0:1762166857.928017:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.928101:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444523136 00000100:00100000:0.0:1762166857.928111:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444523136 00000100:00100000:0.0:1762166857.928165:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 406 00000100:00100000:0.0:1762166857.928175:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49328:x1847765444523136:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166857.928198:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.928215:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f1ca lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b27 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.928263:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1d1 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928274:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1d1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928294:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1d1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928304:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1d8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928309:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928312:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928391:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f1df lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928395:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f1df lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928399:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f1df lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166857.928434:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166857.928437:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166857.928450:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f1df lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928458:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f1df lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928464:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1d1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928468:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1d1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928479:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1d1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928483:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.928486:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1d1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928490:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1d1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928498:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166857.928500:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166857.928503:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1d1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928507:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f1d1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928515:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928518:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1d8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928521:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928524:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.928526:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928529:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928541:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4400) 00010000:00010000:0.0:1762166857.928544:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166857.928547:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1d8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928552:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1d8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.928582:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f1ca lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b27 expref: 45 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.928595:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f1df lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b27 expref: 44 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.928601:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166857.928603:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166857.928605:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198e00, rc 0) 00000100:00100000:0.0:1762166857.928672:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49328:x1847765444523136:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 498us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.928679:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 406 00000100:00100000:3.0:1762166857.930510:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.930559:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444523264 00000100:00100000:0.0:1762166857.930568:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444523264 00000100:00100000:0.0:1762166857.930624:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1220 00000100:00100000:0.0:1762166857.930633:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444523264:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166857.930648:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.930663:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f1e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b2e expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.930733:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451998336:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166857.930852:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.932144:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451998336:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166857.932173:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f1e6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b2e expref: 13 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.932193:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f1e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b2e expref: 13 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.932206:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198400, rc 0) 00000100:00100000:0.0:1762166857.932260:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444523264:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 1627us (1755us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166857.932269:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1220 00000100:00100000:3.0:1762166857.944913:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.944989:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444523392 00000100:00100000:0.0:1762166857.945000:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444523392 00000100:00100000:0.0:1762166857.945054:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 407 00000100:00100000:0.0:1762166857.945066:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49332:x1847765444523392:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166857.945143:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f1ed lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945159:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f1ed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945170:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f1ed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945197:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f1f4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945202:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945206:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945285:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945291:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945295:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166857.945324:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166857.945327:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166857.945335:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945343:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f1ed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945347:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f1ed lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945351:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f1ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945355:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.945357:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f1ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945367:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f1ed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945375:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166857.945377:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166857.945380:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f1ed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945383:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f1ed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945392:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945395:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f1f4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945399:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945402:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.945403:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945406:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f1f4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945410:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4400) 00010000:00010000:0.0:1762166857.945411:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166857.945412:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f1f4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945429:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f1f4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945444:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945447:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1fb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945451:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945453:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.945455:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945458:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1fb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945462:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166857.945463:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166857.945464:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1fb lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.945469:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f1fb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166857.945540:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49332:x1847765444523392:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 478us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.945545:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 407 00000100:00100000:3.0:1762166857.955693:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.955789:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444523648 00000100:00100000:0.0:1762166857.955799:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444523648 00000100:00100000:0.0:1762166857.955852:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 408 00000100:00100000:0.0:1762166857.955864:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49334:x1847765444523648:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.955898:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.955916:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f202 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b35 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.956017:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f209 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.956030:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f209 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.956040:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f209 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166857.956050:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166857.956161:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f202 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b35 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.956174:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f209 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b35 expref: 46 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.956179:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166857.956181:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166857.956183:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199c00, rc 0) 00000100:00100000:0.0:1762166857.956228:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49334:x1847765444523648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 369us (545us total) trans 8589935027 rc 0/0 00000100:00100000:0.0:1762166857.956233:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 408 00000100:00100000:1.0:1762166857.958148:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.958241:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444523776 00000100:00100000:0.0:1762166857.958251:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444523776 00000100:00100000:0.0:1762166857.958306:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1221 00000100:00100000:0.0:1762166857.958315:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444523776:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.958343:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.958360:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f217 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b3c expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.958427:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451998464:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166857.958505:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.959552:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451998464:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166857.959580:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f217 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b3c expref: 13 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.959601:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f217 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b3c expref: 13 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.959613:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198400, rc 0) 00000100:00100000:0.0:1762166857.959661:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444523776:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1346us (1524us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166857.959669:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1221 00000100:00100000:3.0:1762166857.961326:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.961365:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444524032 00000100:00100000:0.0:1762166857.961373:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444524032 00000100:00100000:0.0:1762166857.961433:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 409 00000100:00100000:0.0:1762166857.961443:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49334:x1847765444524032:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.961465:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.961482:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f21e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b43 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.961590:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f225 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.961616:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f1df lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b27 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.961623:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f225 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.961648:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f1df lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b27 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.961657:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f1df lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b27 expref: 47 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.961670:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451998592:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.961736:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.962828:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451998592:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.962848:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f225 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166857.962966:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.963028:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444524160 00000100:00100000:2.0:1762166857.963035:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444524160 00010000:00010000:2.0:1762166857.963063:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f1df lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b27 expref: 48 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.963111:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 829 00000100:00100000:2.0:1762166857.963122:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2361:x1847765444524160:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.963133:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.963139:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f1df lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b27 expref: 48 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.963151:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f1df lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b27 expref: 48 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.963169:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f1df lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b27 expref: 48 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.963183:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166857.963187:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f225 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.963195:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f225 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.963202:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f225 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.963225:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166857.963242:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f225 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.963251:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f225 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166857.963265:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000100:00100000:2.0:1762166857.963276:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:2361:x1847765444524160:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 156us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.963285:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 829 00010000:00010000:0.0:1762166857.963388:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f21e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b43 expref: 48 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.963403:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f225 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b43 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.963428:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166857.963431:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166857.963434:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199800, rc 0) 00000100:00100000:0.0:1762166857.963468:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49334:x1847765444524032:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2027us (2147us total) trans 8589935028 rc 0/0 00000100:00100000:0.0:1762166857.963475:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 409 00000100:00100000:3.0:1762166857.965041:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.965079:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444524416 00000100:00100000:0.0:1762166857.965085:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444524416 00000100:00100000:0.0:1762166857.965122:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 410 00000100:00100000:0.0:1762166857.965131:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49334:x1847765444524416:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.965149:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.965165:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f233 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b4a expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.965590:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f23a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.965602:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f23a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.965611:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f23a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166857.965619:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x3b:0x0]: returning size 0 00010000:00010000:0.0:1762166857.965656:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f233 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b4a expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.965671:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f23a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b4a expref: 49 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.965691:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3b:0x0].0x0 (ffff9ee34bdb4400) 00010000:00010000:0.0:1762166857.965694:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166857.965696:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199200, rc 0) 00000100:00100000:0.0:1762166857.965794:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49334:x1847765444524416:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 633us (727us total) trans 8589935029 rc 0/0 00000100:00100000:0.0:1762166857.965802:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 410 00000100:00100000:1.0:1762166857.967436:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.967496:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444524672 00000100:00100000:0.0:1762166857.967507:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444524672 00000100:00100000:0.0:1762166857.967567:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 411 00000100:00100000:0.0:1762166857.967577:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49334:x1847765444524672:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.967596:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.967613:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f248 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b51 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.967687:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f24f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.967700:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f23a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b4a expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.967709:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f24f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.967743:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f23a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b4a expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.967755:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f23a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b4a expref: 50 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.967812:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451998720:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.967903:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.969229:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451998720:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166857.969244:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762166857.969256:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f24f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166857.969334:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444524800 00000100:00100000:2.0:1762166857.969342:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444524800 00010000:00010000:2.0:1762166857.969388:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f23a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b4a expref: 51 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.969440:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 830 00000100:00100000:2.0:1762166857.969453:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2360:x1847765444524800:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.969469:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.969477:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f23a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b4a expref: 51 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.969489:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f23a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b4a expref: 51 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.969508:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f23a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b4a expref: 51 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.969529:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3b:0x0].0x0 (ffff9ee34bdb4400) 00010000:00010000:2.0:1762166857.969535:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f24f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.969543:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f24f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.969550:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f24f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.969578:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166857.969600:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f24f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.969607:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f24f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166857.969620:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x3b:0x0]: returning size 0 00000100:00100000:2.0:1762166857.969635:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2360:x1847765444524800:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 184us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.969643:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 830 00000004:00080000:0.0:1762166857.969960:0:30817:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x8b:0x0], index 1: 0 00010000:00010000:0.0:1762166857.970080:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f24f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.970087:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f24f lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.970092:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f24f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.970097:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166857.970101:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f24f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.970106:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f24f lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.970115:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3b:0x0].0x0 (ffff9ee34bdb4400) 00010000:00010000:0.0:1762166857.970124:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166857.970128:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f24f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.970134:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f24f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.970181:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f248 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b51 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.970190:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166857.970192:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166857.970196:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f248 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b51 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.970204:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198400, rc 0) 00000100:00100000:0.0:1762166857.970247:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49334:x1847765444524672:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2672us (2833us total) trans 8589935030 rc 301/301 00000100:00100000:0.0:1762166857.970255:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 411 00000100:00100000:3.0:1762166857.971519:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.971574:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444525056 00000100:00100000:0.0:1762166857.971582:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444525056 00000100:00100000:0.0:1762166857.971633:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 174 00000100:00100000:0.0:1762166857.971642:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49334:x1847765444525056:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166857.971954:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49334:x1847765444525056:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 313us (440us total) trans 8589935031 rc 0/0 00000100:00100000:0.0:1762166857.971963:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 174 00000100:00100000:3.0:1762166857.973050:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.973131:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444525184 00000100:00100000:0.0:1762166857.973136:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444525184 00000100:00100000:0.0:1762166857.973174:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 412 00000100:00100000:0.0:1762166857.973196:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49334:x1847765444525184:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.973213:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.973230:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f25d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b58 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.973286:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f264 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.973297:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f225 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b43 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.973303:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f264 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166857.973334:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f225 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b43 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.973347:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f225 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b43 expref: 51 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.973360:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451998848:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166857.973440:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3471576c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.974363:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765451998848:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166857.974383:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f264 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166857.974666:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.974746:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444525312 00000100:00100000:2.0:1762166857.974789:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444525312 00010000:00010000:2.0:1762166857.974816:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f225 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b43 expref: 52 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.974844:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 831 00000100:00100000:2.0:1762166857.974863:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2360:x1847765444525312:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.974876:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.974882:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f225 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b43 expref: 52 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.974893:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f225 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b43 expref: 52 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.974916:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f225 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b43 expref: 52 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166857.974928:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166857.974931:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f264 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.974937:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f264 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.974942:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f264 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166857.974965:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166857.975008:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2360:x1847765444525312:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 155us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.975015:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 831 00010000:00010000:3.0:1762166857.975261:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f264 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.975278:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f264 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166857.975313:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:3.0:1762166857.975317:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166857.975341:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f264 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.975369:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f25d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b58 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.975382:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f264 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b58 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.975390:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:3.0:1762166857.975392:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166857.975403:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199400, rc 0) 00000100:00100000:3.0:1762166857.975460:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49334:x1847765444525184:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2264us (2413us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.975468:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 412 00000100:00100000:3.0:1762166857.977193:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.977250:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444525440 00000100:00100000:0.0:1762166857.977258:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444525440 00000100:00100000:0.0:1762166857.977305:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1222 00000100:00100000:0.0:1762166857.977313:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444525440:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.977343:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.977360:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f26b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b5f expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.977410:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451998976:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166857.977493:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3471576c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.978749:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451998976:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166857.978810:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f26b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b5f expref: 13 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.978825:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f26b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b5f expref: 13 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.978834:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199000, rc 0) 00000100:00100000:0.0:1762166857.978875:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444525440:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1564us (1689us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166857.978882:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1222 00000100:00100000:1.0:1762166857.980210:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.980276:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444525568 00000100:00100000:3.0:1762166857.980283:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444525568 00000100:00100000:3.0:1762166857.980333:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 413 00000100:00100000:3.0:1762166857.980342:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49334:x1847765444525568:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166857.980357:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.980376:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f272 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b66 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.980444:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f279 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.980457:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f279 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.980466:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f279 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166857.980496:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x3b:0x0]: returning size 0 00000004:00200000:3.0:1762166857.980499:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166857.980512:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f279 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.980537:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f272 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b66 expref: 52 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.980551:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f279 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b66 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.980571:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3b:0x0].0x0 (ffff9ee363960a00) 00010000:00010000:3.0:1762166857.980574:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762166857.980576:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382045600, rc 0) 00000100:00100000:3.0:1762166857.980622:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49334:x1847765444525568:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 278us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.980628:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 413 00000100:00100000:3.0:1762166857.982004:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.982045:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444525696 00000100:00100000:0.0:1762166857.982053:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444525696 00000100:00100000:0.0:1762166857.982095:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1223 00000100:00100000:0.0:1762166857.982103:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444525696:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.982114:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.982128:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f280 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b6d expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166857.982146:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166857.982167:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.982169:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.982175:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f280 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b6d expref: 25 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.982185:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f280 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b6d expref: 25 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166857.982194:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198400, rc 0) 00000100:00100000:0.0:1762166857.982229:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765444525696:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 127us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.982233:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1223 00000100:00100000:1.0:1762166857.983788:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166857.983826:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444525952 00000100:00100000:3.0:1762166857.983834:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444525952 00000100:00100000:3.0:1762166857.983887:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 414 00000100:00100000:3.0:1762166857.983897:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49334:x1847765444525952:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166857.983914:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.983930:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9f287 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b74 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.984020:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f28e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.984034:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f28e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166857.984045:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f28e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166857.984058:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:3.0:1762166857.984177:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9f287 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b74 expref: 54 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.984213:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f28e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b74 expref: 53 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.984222:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:3.0:1762166857.984225:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166857.984228:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382044600, rc 0) 00000100:00100000:3.0:1762166857.984282:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49334:x1847765444525952:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 386us (526us total) trans 8589935032 rc 0/0 00000100:00100000:3.0:1762166857.984290:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 414 00000100:00100000:1.0:1762166857.986007:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.986066:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444526080 00000100:00100000:0.0:1762166857.986074:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444526080 00000100:00100000:0.0:1762166857.986123:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1224 00000100:00100000:0.0:1762166857.986134:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444526080:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166857.986148:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166857.986170:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f29c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b7b expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.986220:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451999104:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166857.986289:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3471576c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.987466:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451999104:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166857.987495:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f29c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b7b expref: 13 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.987514:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f29c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b7b expref: 13 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.987527:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199000, rc 0) 00000100:00100000:2.0:1762166857.987567:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444526080:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1436us (1565us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166857.987573:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1224 00000100:00100000:1.0:1762166857.989336:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.989386:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444526208 00000100:00100000:2.0:1762166857.989394:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444526208 00000100:00100000:2.0:1762166857.989445:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1225 00000100:00100000:2.0:1762166857.989452:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444526208:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.989463:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.989475:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f2a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b82 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.989521:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451999232:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166857.989591:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.990521:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451999232:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166857.990544:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f2a3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b82 expref: 13 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.990582:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f2a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b82 expref: 13 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.990594:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2400, rc 0) 00000100:00100000:2.0:1762166857.990647:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444526208:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1193us (1313us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166857.990655:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1225 00000100:00100000:0.0:1762166857.991633:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.991668:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444526336 00000100:00100000:2.0:1762166857.991673:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444526336 00000100:00100000:2.0:1762166857.991704:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1226 00000100:00100000:2.0:1762166857.991709:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2358:x1847765444526336:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166857.991734:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f2aa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.991746:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f0d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ada expref: 12 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.991751:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166857.991753:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166857.991755:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f2aa lrc: 4/1,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.991792:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f0d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ada expref: 12 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.991804:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f0d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ada expref: 12 pid: 6533 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166857.991822:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451999360:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166857.991868:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.992782:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765451999360:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166857.992799:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f2aa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166857.992883:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166857.992936:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444526464 00000100:00100000:0.0:1762166857.992942:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444526464 00010000:00010000:0.0:1762166857.992968:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f0d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ada expref: 13 pid: 6533 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166857.993018:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 832 00000100:00100000:0.0:1762166857.993026:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765444526464:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.993038:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.993054:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f0d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ada expref: 13 pid: 6533 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.993065:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f0d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ada expref: 13 pid: 6533 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.993081:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f0d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ada expref: 13 pid: 6533 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166857.993093:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.993094:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.993098:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f2aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.993106:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f2aa lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.993127:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166857.993145:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f2aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.993158:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f2aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.993161:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444526464:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 135us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166857.993178:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 832 00010000:00010000:2.0:1762166857.993189:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f2aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.993199:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f2aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.993208:0:6533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f2aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.993216:0:6533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166857.993220:0:6533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f2aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.993241:0:6533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f2aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.993255:0:6533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f2aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.993262:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f2aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166857.993314:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2358:x1847765444526336:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 1602us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.993322:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1226 00000100:00100000:3.0:1762166857.994303:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166857.994342:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444526592 00000100:00100000:2.0:1762166857.994348:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444526592 00000100:00100000:2.0:1762166857.994384:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1227 00000100:00100000:2.0:1762166857.994391:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2359:x1847765444526592:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166857.994403:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.994429:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f2b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b89 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166857.994446:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x8b:0x0] initial LVB size: 0, mtime: 0x69088847, atime: 0x69088847, ctime: 0x6908884a, blocks: 0x1 00010000:00010000:2.0:1762166857.994459:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.994461:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.994471:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f2b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b89 expref: 12 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.994500:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f2b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b89 expref: 12 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.994511:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3400, rc 0) 00000100:00100000:2.0:1762166857.994550:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2359:x1847765444526592:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 156us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.994558:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1227 00000100:00100000:1.0:1762166858.017621:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.017671:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444526720 00000100:00100000:3.0:1762166858.017682:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444526720 00000100:00080000:2.0:1762166858.017742:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166858.017759:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 415 00000100:00100000:3.0:1762166858.017809:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49334:x1847765444526720:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:1.0:1762166858.026682:0:32137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935031 is committed 00000020:00080000:3.0:1762166858.026707:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969124 batchid updated 00000004:00080000:1.0:1762166858.026712:0:32137:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 12 committed 00000001:00080000:3.0:1762166858.026727:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935032 is committed 00000020:00080000:0.0:1762166858.026737:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969124 00000020:00080000:0.0:1762166858.026759:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969124 00000020:00080000:1.0:1762166858.026797:0:32137:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee347157600 refcount 2 committed 0 result 0 batchid 4294969125 00000020:00080000:1.0:1762166858.026804:0:32137:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee242fa7000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee347157f00 00000020:00080000:1.0:1762166858.026809:0:32137:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee242fa7800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3728af000 00000100:00100000:2.0:1762166858.026812:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49334:x1847765444526720:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 9000us (9192us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.026827:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 415 00000020:00080000:0.0:1762166858.026833:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969125 committed batchid 4294969124 00000100:00100000:2.0:1762166858.026984:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451999616:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166858.027005:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451999744:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166858.027013:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451999488:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1762166858.027018:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969124 00000100:00100000:2.0:1762166858.027049:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166858.027050:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166858.027087:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451999616 00000100:00100000:0.0:1762166858.027094:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451999616 00000100:00100000:1.0:1762166858.027096:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451999488 00000100:00100000:1.0:1762166858.027102:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451999488 00000100:00100000:0.0:1762166858.027140:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:0.0:1762166858.027151:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765451999616:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762166858.027157:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:2.0:1762166858.027166:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3294:x1847765451999488:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166858.027178:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1762166858.027179:0:6533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:137 count 1 00002000:00080000:2.0:1762166858.027180:0:26444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:136 count 1 00000100:00100000:3.0:1762166858.027202:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451999744 00000100:00100000:3.0:1762166858.027207:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451999744 00010000:00010000:2.0:1762166858.027208:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f2b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.027208:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f2bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166858.027234:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00010000:00010000:0.0:1762166858.027238:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ecde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91967 expref: 24 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.027239:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917ed expref: 24 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166858.027247:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3296:x1847765451999744:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1762166858.027260:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166858.027262:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166858.027264:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166858.027266:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00002000:00080000:3.0:1762166858.027268:0:6532:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:138 count 1 00010000:00010000:0.0:1762166858.027270:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f2bf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.027271:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f2b8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.027283:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.027301:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ecde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91967 expref: 24 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.027305:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f0e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae1 expref: 24 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.027308:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917ed expref: 24 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.027328:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166858.027330:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ecde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91967 expref: 24 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166858.027332:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166858.027337:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917ed expref: 24 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166858.027338:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2c6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.027351:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765451999872:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166858.027368:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452000000:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166858.027382:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f0e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae1 expref: 24 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.027390:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f0e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae1 expref: 24 pid: 6533 timeout: 578 lvb_type: 0 00000100:00100000:3.0:1762166858.027399:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765452000128:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166858.027434:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.027435:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9a300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166858.027442:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855600 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.028717:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.028786:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444526848 00000100:00100000:3.0:1762166858.028792:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444526848 00000100:00100000:2.0:1762166858.028806:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452000000:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166858.028807:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765451999872:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166858.028834:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f2b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.028837:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f2bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166858.028839:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1231 00000100:00100000:1.0:1762166858.028852:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00080000:2.0:1762166858.028873:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166858.028881:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444526976 00000100:00100000:1.0:1762166858.028892:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.028919:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444527104 00000100:00100000:2.0:1762166858.028924:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444527104 00000100:00100000:0.0:1762166858.028929:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444526976 00000100:00100000:3.0:1762166858.028944:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444526848:12345-192.168.203.35@tcp:16:lfs.0 00010000:00010000:2.0:1762166858.028950:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917ed expref: 27 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166858.028954:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ecde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91967 expref: 27 pid: 26444 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1762166858.028960:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.028993:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444527232 00000100:00100000:0.0:1762166858.028998:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444527232 00000100:00100000:1.0:1762166858.029007:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 833 00010000:00010000:0.0:1762166858.029014:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f0e3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae1 expref: 28 pid: 6533 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166858.029015:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 834 00000100:00100000:3.0:1762166858.029016:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444526848:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 75us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.029030:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444526976:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166858.029033:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1231 00000100:00100000:2.0:1762166858.029033:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2358:x1847765444527104:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.029050:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166858.029052:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166858.029055:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 835 00010000:00010000:2.0:1762166858.029060:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917ed expref: 27 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1762166858.029062:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ecde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91967 expref: 27 pid: 26444 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166858.029071:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444527232:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.029086:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166858.029091:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ecde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91967 expref: 27 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166858.029096:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f0e3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae1 expref: 27 pid: 6533 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166858.029124:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f0e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae1 expref: 27 pid: 6533 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1762166858.029130:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ecde lrc: 0/0,0 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91967 expref: 27 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.029134:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917ed expref: 27 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166858.029140:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.029144:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166858.029148:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.029150:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.029152:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166858.029158:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f2bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.029161:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9e8ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f917ed expref: 26 pid: 26444 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1762166858.029164:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2c6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.029169:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f2bf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.029197:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.029200:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.029205:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f2b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.029206:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166858.029211:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166858.029221:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f2b8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.029237:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f2bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.029240:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765444527232:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 173us (284us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166858.029251:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166858.029251:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765444526976:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 231us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.029259:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 835 00000100:00100000:1.0:1762166858.029269:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 833 00010000:00010000:3.0:1762166858.029270:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f2bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.029270:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f2b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.029283:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f2bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.029283:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f2b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.029292:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f2bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.029292:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f2b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.029300:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f2b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.029309:0:6533:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166858.029329:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1762166858.029331:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1762166858.029332:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f0e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ae1 expref: 23 pid: 6533 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166858.029337:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f2bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.029345:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1762166858.029347:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765452000128:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166858.029350:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166858.029353:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f2b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.029357:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f2bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.029362:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.029370:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166858.029376:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f2bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.029378:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f2b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.029388:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.029404:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f2bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.029405:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f2b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.029406:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.029439:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f2bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.029445:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.029451:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f2b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.029463:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.029474:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f2b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.029485:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166858.029489:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166858.029497:0:6532:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166858.029502:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166858.029508:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.029510:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166858.029515:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166858.029517:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166858.029519:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166858.029522:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.029531:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.029541:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.029548:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.029563:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166858.029564:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166858.029566:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166858.029980:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3295:x1847765451999616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2831us (2934us total) trans 17179869463 rc 0/0 00000100:00100000:2.0:1762166858.029985:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765451999488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2815us (2933us total) trans 17179869464 rc 0/0 00000100:00100000:3.0:1762166858.029988:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:2.0:1762166858.029995:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:1.0:1762166858.029997:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3296:x1847765451999744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2749us (2815us total) trans 17179869462 rc 0/0 00000100:00100000:1.0:1762166858.030006:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00010000:00010000:2.0:1762166858.030017:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166858.030042:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765444527104:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1018us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.030056:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 834 00000004:00080000:0.0:1762166858.030242:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317dc00/2, rc 0, transno 17179869462 00000100:00100000:0.0:1762166858.030250:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765451999744:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1762166858.030289:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317fb80/2, rc 0, transno 17179869464 00000100:00100000:0.0:1762166858.030294:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765451999488:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1762166858.030320:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317ed80/2, rc 0, transno 17179869463 00000100:00100000:0.0:1762166858.030325:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765451999616:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166858.035644:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.035697:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444527360 00000100:00100000:3.0:1762166858.035708:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444527360 00000100:00080000:2.0:1762166858.035808:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166858.035823:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1232 00000100:00100000:3.0:1762166858.035834:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2358:x1847765444527360:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762166858.035878:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2cd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.035892:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.035894:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.035899:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.035915:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.035944:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.035953:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.035961:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.035968:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166858.035971:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.035980:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.036006:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.036014:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166858.036087:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2358:x1847765444527360:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 255us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.036095:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1232 00000100:00100000:1.0:1762166858.038128:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.038228:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444527616 00000100:00100000:2.0:1762166858.038241:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444527616 00000100:00100000:2.0:1762166858.038307:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 416 00000100:00100000:2.0:1762166858.038316:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49334:x1847765444527616:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762166858.038364:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.038387:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f279 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b66 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.038406:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3b:0x0].0x0 (ffff9ee363960a00) 00010000:00010000:2.0:1762166858.038432:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166858.038462:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9f2d4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.038474:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9f2d4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.038482:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9f2d4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:2.0:1762166858.038663:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000021216f1f reply state 0000000013c042bd transno 8589935033 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9f2d4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166858.038672:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166858.038803:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49334:x1847765444527616:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 487us (687us total) trans 8589935033 rc 0/0 00000100:00100000:2.0:1762166858.038812:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 416 00010000:00010000:3.0:1762166858.039820:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9f2d4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.039832:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9f2d4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.039839:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9f2d4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.039845:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166858.039848:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9f2d4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.039855:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9f2d4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.039866:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3b:0x0].0x0 (ffff9ee359d01700) 00010000:00010000:3.0:1762166858.039869:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166858.039872:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9f2d4 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.039890:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9f2d4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166858.040992:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.041081:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444527744 00000100:00100000:0.0:1762166858.041093:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444527744 00000100:00100000:0.0:1762166858.041169:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 417 00000100:00100000:0.0:1762166858.041179:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49334:x1847765444527744:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.041208:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.041238:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f2db lrc: 2/0,0 mode: --/CR res: [0x200000404:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b90 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.041318:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f2db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b90 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.041336:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f2db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b90 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.041360:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3b:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:0.0:1762166858.041364:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166858.041368:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198800, rc 0) 00000100:00100000:0.0:1762166858.041459:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49334:x1847765444527744:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 281us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.041467:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 417 00000100:00100000:0.0:1762166858.043984:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.044072:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444527872 00000100:00100000:3.0:1762166858.044082:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444527872 00000100:00100000:3.0:1762166858.044145:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1233 00000100:00100000:3.0:1762166858.044155:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:49334:x1847765444527872:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.044177:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.044201:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b97 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.044243:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f280 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b6d expref: 23 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166858.044251:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.044254:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.044258:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2e2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b97 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.044299:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f280 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b6d expref: 23 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166858.044314:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f280 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b6d expref: 23 pid: 6533 timeout: 578 lvb_type: 1 00000100:00100000:3.0:1762166858.044336:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765452000256:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166858.044449:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166858.046065:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765452000256:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166858.046096:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2e2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b97 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.046113:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382045c00, rc 0) 00000100:00100000:3.0:1762166858.046177:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:49334:x1847765444527872:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2022us (2203us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.046186:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.046193:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1233 00000100:00100000:2.0:1762166858.046247:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444528000 00000100:00100000:2.0:1762166858.046255:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444528000 00010000:00010000:2.0:1762166858.046289:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f280 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b6d expref: 23 pid: 6533 timeout: 578 lvb_type: 1 00000100:00100000:2.0:1762166858.046329:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 836 00000100:00100000:2.0:1762166858.046338:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444528000:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.046352:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.046375:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f280 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b6d expref: 23 pid: 6533 timeout: 578 lvb_type: 1 00010000:00010000:2.0:1762166858.046391:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f280 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b6d expref: 23 pid: 6533 timeout: 578 lvb_type: 1 00010000:00010000:2.0:1762166858.046427:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f280 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b6d expref: 23 pid: 6533 timeout: 578 lvb_type: 1 00010000:00010000:2.0:1762166858.046440:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.046442:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.046448:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b97 expref: 22 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.046478:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b97 expref: 22 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.046507:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b97 expref: 22 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.046517:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765452000384:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762166858.046568:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.047825:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765452000384:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762166858.047845:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166858.047891:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765444528000:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1553us (1709us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.047902:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 836 00000100:00100000:0.0:1762166858.047978:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.048123:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444528128 00000100:00100000:3.0:1762166858.048130:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444528128 00000100:00100000:3.0:1762166858.048173:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1234 00000100:00100000:3.0:1762166858.048182:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765444528128:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:3.0:1762166858.048407:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x8b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166858.048411:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x8b:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:3.0:1762166858.048427:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x8b:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:3.0:1762166858.048429:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8b:0x0] updating lvb ctime from disk: 0 -> 1762166858 00002000:00010000:3.0:1762166858.048431:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x8b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762166858.048465:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444528128:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 284us (488us total) trans 17179869465 rc 0/0 00000100:00100000:3.0:1762166858.048472:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1234 00000100:00100000:1.0:1762166858.049577:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.049632:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444528384 00000100:00100000:0.0:1762166858.049637:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444528384 00000100:00100000:0.0:1762166858.049679:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 418 00000100:00100000:0.0:1762166858.049687:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49334:x1847765444528384:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166858.049730:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.049755:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f264 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b58 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.049805:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166858.049810:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166858.049847:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f2e9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.049860:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f2e9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.049870:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f2e9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762166858.049979:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ac73744f reply state 00000000a1709b8e transno 8589935034 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f2e9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166858.049988:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166858.050060:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49334:x1847765444528384:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 373us (486us total) trans 8589935034 rc 0/0 00000100:00100000:0.0:1762166858.050067:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 418 00010000:00010000:2.0:1762166858.050917:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f2e9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.050927:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f2e9 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.050934:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f2e9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.050939:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.050943:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f2e9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.050950:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f2e9 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.050976:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166858.050979:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166858.050983:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f2e9 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.050989:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f2e9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166858.051083:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.051124:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444528512 00000100:00100000:3.0:1762166858.051130:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444528512 00000100:00100000:3.0:1762166858.051206:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1235 00000100:00100000:3.0:1762166858.051214:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:49334:x1847765444528512:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.051224:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.051234:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9f2f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91b9e expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.051259:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f2b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b89 expref: 13 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166858.051265:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.051267:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.051270:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9f2f0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b9e expref: 13 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.051293:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f2b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b89 expref: 13 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166858.051302:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f2b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b89 expref: 13 pid: 6533 timeout: 578 lvb_type: 1 00000100:00100000:3.0:1762166858.051319:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765452000512:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166858.051387:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166858.053809:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765452000512:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.053820:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166858.053866:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9f2f0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b9e expref: 13 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.053871:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444528640 00000100:00100000:2.0:1762166858.053886:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444528640 00010000:00010000:2.0:1762166858.053927:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f2b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b89 expref: 14 pid: 6533 timeout: 578 lvb_type: 1 00010000:00010000:3.0:1762166858.053970:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382044200, rc 0) 00000100:00100000:2.0:1762166858.053983:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 837 00000100:00100000:2.0:1762166858.053996:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765444528640:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.054013:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.054034:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f2b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b89 expref: 14 pid: 6533 timeout: 578 lvb_type: 1 00000100:00100000:3.0:1762166858.054048:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:49334:x1847765444528512:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2830us (2962us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166858.054055:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f2b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b89 expref: 14 pid: 6533 timeout: 578 lvb_type: 1 00000100:00100000:3.0:1762166858.054066:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1235 00010000:00010000:2.0:1762166858.054098:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f2b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b89 expref: 13 pid: 6533 timeout: 578 lvb_type: 1 00010000:00010000:2.0:1762166858.054112:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.054114:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.054121:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9f2f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b9e expref: 12 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.054142:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9f2f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b9e expref: 12 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.054172:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9f2f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b9e expref: 12 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.054181:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765452000640:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762166858.054250:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.056013:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.056064:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765452000640:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762166858.056086:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166858.056141:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444528640:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 2149us (2328us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.056154:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 837 00000100:00100000:3.0:1762166858.056210:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444528768 00000100:00100000:3.0:1762166858.056235:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444528768 00000100:00100000:0.0:1762166858.056321:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1236 00000100:00100000:0.0:1762166858.056340:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444528768:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166858.056610:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x8b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166858.056617:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x8b:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166858.056634:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x8b:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166858.056636:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x8b:0x0] updating lvb ctime from disk: 1762166858 -> 1762166858 00002000:00010000:0.0:1762166858.056639:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x8b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166858.056684:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444528768:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 349us (677us total) trans 21474836795 rc 0/0 00000100:00100000:0.0:1762166858.056691:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1236 00000100:00100000:1.0:1762166858.058030:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.058081:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444529024 00000100:00100000:0.0:1762166858.058089:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444529024 00000100:00100000:0.0:1762166858.058144:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 175 00000100:00100000:0.0:1762166858.058152:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348211450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49334:x1847765444529024:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166858.058251:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f28e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b74 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.058298:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f2f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.058312:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f1bc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b20 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.058320:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f209 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b35 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.058328:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f2f7 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.058377:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f209 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b35 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.058393:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f209 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b35 expref: 27 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166858.058433:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f402a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765452000768:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166858.058526:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f1bc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b20 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.058536:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f1bc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b20 expref: 27 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166858.058545:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765452000896:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166858.058568:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9a300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.061059:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.061078:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f402a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765452000768:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166858.061096:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765452000896:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166858.061125:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444529152 00000100:00100000:1.0:1762166858.061131:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762166858.061133:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f2f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166858.061137:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444529152 00010000:00010000:2.0:1762166858.061186:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f1bc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b20 expref: 28 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166858.061239:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 838 00000100:00100000:2.0:1762166858.061250:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444529152:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.061268:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.061278:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f1bc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b20 expref: 28 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.061291:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f1bc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b20 expref: 28 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.061326:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f1bc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b20 expref: 28 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.061345:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166858.061349:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f2f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166858.061359:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f2f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166858.061366:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166858.061426:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444529408 00000100:00100000:3.0:1762166858.061432:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444529408 00000100:00100000:2.0:1762166858.061433:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444529152:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 184us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.061443:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 838 00000100:00100000:3.0:1762166858.061481:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 176 00000100:00100000:3.0:1762166858.061491:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:37763:x1847765444529408:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1762166858.061824:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:37763:x1847765444529408:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 332us (693us total) trans 8589935035 rc 0/0 00000100:00100000:3.0:1762166858.061832:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 176 00000100:00100000:1.0:1762166858.063331:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.063392:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444529536 00000100:00100000:2.0:1762166858.063405:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444529536 00010000:00010000:2.0:1762166858.063458:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f209 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b35 expref: 28 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166858.063502:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 839 00000100:00100000:2.0:1762166858.063512:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444529536:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.063527:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.063533:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f209 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b35 expref: 28 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.063546:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f209 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b35 expref: 28 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.063585:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f209 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b35 expref: 28 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.063600:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166858.063604:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f2f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166858.063611:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f2f7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166858.063615:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f2f7 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166858.063639:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166858.063658:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f2f7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.063666:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f2f7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166858.063684:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444529536:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 172us (371us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166858.063688:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f2fe lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166858.063695:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 839 00010000:00010000:0.0:1762166858.063707:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f2db lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b90 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.063716:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f2fe lrc: 4/0,1 mode: --/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.063753:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f2db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b90 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.063789:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f2db lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b90 expref: 26 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166858.063819:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765452001024:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166858.063884:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9a300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.065319:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765452001024:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166858.065344:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f2fe lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166858.065376:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.065429:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444529664 00000100:00100000:2.0:1762166858.065436:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444529664 00010000:00010000:2.0:1762166858.065462:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f2db lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b90 expref: 27 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166858.065500:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 840 00000100:00100000:2.0:1762166858.065511:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444529664:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.065524:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.065530:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f2db lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b90 expref: 27 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.065557:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f2db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b90 expref: 27 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.065570:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f2db lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b90 expref: 27 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.065583:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3b:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:2.0:1762166858.065587:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f2fe lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166858.065595:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f2fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166858.065601:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f2fe lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166858.065626:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166858.065677:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f2fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166858.065680:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444529664:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 171us (304us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166858.065692:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f2fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:2.0:1762166858.065697:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 840 00000100:00100000:0.0:1762166858.066161:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452001152:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166858.066204:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166858.066233:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3471576c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.066260:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452001152 00000100:00100000:2.0:1762166858.066266:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452001152 00000100:00100000:2.0:1762166858.066300:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1762166858.066309:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:31351:x1847765452001152:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166858.066381:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:31351:x1847765452001152:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 74us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.066387:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1762166858.066447:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452001152:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166858.066488:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452001280:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166858.066513:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166858.066535:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347d2c840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.066557:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452001280 00000100:00100000:2.0:1762166858.066570:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452001280 00000100:00100000:2.0:1762166858.066604:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1762166858.066611:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:31351:x1847765452001280:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166858.066668:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:31351:x1847765452001280:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 57us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.066675:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1762166858.066698:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452001280:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1762166858.066882:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935036 00000100:00100000:0.0:1762166858.066920:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f402a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452001408:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166858.066937:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166858.066953:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347d2cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.066974:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452001408 00000100:00100000:2.0:1762166858.066980:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452001408 00000100:00100000:2.0:1762166858.067010:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1762166858.067017:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:31351:x1847765452001408:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166858.067153:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:31351:x1847765452001408:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 136us (214us total) trans 17179869466 rc 0/0 00000100:00100000:2.0:1762166858.067160:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1762166858.067192:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f402a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452001408:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1762166858.067255:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935037 00010000:00010000:0.0:1762166858.067280:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f2fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.067289:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f2fe lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.067295:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f2fe lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.067300:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166858.067304:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f2fe lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.067310:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f2fe lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.067322:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3b:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:0.0:1762166858.067325:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166858.067328:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f2fe lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.067333:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f2fe lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.067364:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f2f7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.067376:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f2f7 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.067382:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f2f7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.067386:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166858.067390:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f2f7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.067396:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f2f7 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.067403:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166858.067406:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166858.067408:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f2f7 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.067412:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f2f7 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.067433:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166858.067435:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166858.067439:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f28e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b74 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.067516:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348211450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49334:x1847765444529024:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 9364us (9492us total) trans 8589935038 rc 0/0 00000100:00100000:0.0:1762166858.067524:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 175 00000020:00080000:0.0:1762166858.067528:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166858.068827:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.068867:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444529792 00000100:00100000:0.0:1762166858.068886:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444529792 00000100:00100000:0.0:1762166858.068987:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 419 00000100:00100000:0.0:1762166858.068998:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49334:x1847765444529792:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.069022:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.069040:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f305 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ba5 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.069092:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f305 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ba5 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.069105:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f305 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ba5 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.069123:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:0.0:1762166858.069126:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166858.069129:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199e00, rc 0) 00000100:00100000:0.0:1762166858.069179:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49334:x1847765444529792:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 182us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.069186:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 419 00000100:00100000:1.0:1762166858.070734:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.070838:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444530048 00000100:00100000:0.0:1762166858.070846:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444530048 00000100:00100000:0.0:1762166858.070898:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 177 00000100:00100000:0.0:1762166858.070906:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49334:x1847765444530048:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166858.071114:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49334:x1847765444530048:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 208us (386us total) trans 8589935039 rc 0/0 00000100:00100000:0.0:1762166858.071123:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 177 00000100:00100000:1.0:1762166858.072185:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.072227:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444530304 00000100:00100000:0.0:1762166858.072243:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444530304 00000100:00100000:0.0:1762166858.072273:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 178 00000100:00100000:0.0:1762166858.072279:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49334:x1847765444530304:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:0.0:1762166858.072498:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x3b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166858.072619:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f30c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.072634:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f30c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.072644:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f30c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.072653:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f30c lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.072663:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f30c lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.072669:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f30c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166858.072693:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1762166858.072796:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49334:x1847765444530304:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 515us (614us total) trans 8589935040 rc 0/0 00000100:00100000:0.0:1762166858.072804:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 178 00010000:00010000:2.0:1762166858.072817:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166858.072825:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f30c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166858.072832:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166858.072836:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f30c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166858.072844:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f30c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166858.072858:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3b:0x0].0x0 (ffff9ee34bdb4700) 00010000:00010000:2.0:1762166858.072861:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166858.072865:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f30c lrc: 1/0,0 mode: --/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166858.072870:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f30c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166858.072897:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166858.072900:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166858.072902:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166858.084286:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.084357:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444530432 00000100:00100000:0.0:1762166858.084376:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444530432 00000100:00100000:0.0:1762166858.084453:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 420 00000100:00100000:0.0:1762166858.084464:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49336:x1847765444530432:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166858.084489:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.084524:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f313 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91bac expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.084588:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f31a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084603:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f31a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084613:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f31a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084628:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f321 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084635:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f321 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084642:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f321 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084783:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f328 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084793:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f328 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084800:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f328 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.084831:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166858.084836:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166858.084855:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f328 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084866:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f328 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084881:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f31a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084887:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f31a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084893:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f31a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084899:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166858.084902:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f31a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084909:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f31a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084923:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166858.084926:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166858.084930:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f31a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084936:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f31a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084947:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f321 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084953:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f321 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084958:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f321 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084963:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166858.084972:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f321 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084979:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f321 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084987:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166858.084990:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166858.084993:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f321 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.084998:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f321 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.085028:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f313 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bac expref: 32 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.085041:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f328 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bac expref: 31 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.085048:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:0.0:1762166858.085050:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166858.085053:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198200, rc 0) 00000100:00100000:0.0:1762166858.085112:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49336:x1847765444530432:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 649us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.085120:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 420 00000100:00100000:1.0:1762166858.100525:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.100617:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444530560 00000100:00100000:0.0:1762166858.100629:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444530560 00000100:00100000:0.0:1762166858.100692:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 421 00000100:00100000:0.0:1762166858.100701:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49340:x1847765444530560:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166858.100858:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f32f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.100878:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f32f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.100894:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f32f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.100910:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f336 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.100918:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f336 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.100923:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f336 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101066:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f33d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101075:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f33d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101082:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f33d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.101129:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166858.101136:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166858.101151:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f33d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101165:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f32f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101183:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f32f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101190:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f32f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101196:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166858.101201:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f32f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101209:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f32f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101224:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166858.101227:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166858.101232:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f32f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101240:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f32f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101256:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f336 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101262:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f336 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101269:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f336 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101275:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166858.101278:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f336 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101294:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f336 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101302:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166858.101305:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166858.101308:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f336 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101314:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f336 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101333:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f33d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101339:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f33d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101345:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f33d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101360:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166858.101364:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f33d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101373:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f33d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101381:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:0.0:1762166858.101383:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166858.101386:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f33d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.101393:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f33d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166858.101510:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49340:x1847765444530560:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 807us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.101522:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 421 00000100:00100000:1.0:1762166858.112553:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.112810:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444530816 00000100:00100000:0.0:1762166858.112827:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444530816 00000100:00100000:0.0:1762166858.112897:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 422 00000100:00100000:0.0:1762166858.112908:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49342:x1847765444530816:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.112930:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.112951:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f344 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91bb3 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.113148:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f34b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.113162:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f34b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.113173:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f34b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.113187:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166858.113352:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f344 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bb3 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.113372:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f34b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bb3 expref: 33 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.113381:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:0.0:1762166858.113384:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166858.113400:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199a00, rc 0) 00000100:00100000:0.0:1762166858.113493:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49342:x1847765444530816:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 586us (959us total) trans 8589935041 rc 0/0 00000100:00100000:0.0:1762166858.113501:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 422 00000100:00100000:1.0:1762166858.116576:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.116667:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444531072 00000100:00100000:0.0:1762166858.116680:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444531072 00000100:00100000:0.0:1762166858.116759:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 423 00000100:00100000:0.0:1762166858.116806:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49342:x1847765444531072:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.116849:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.116876:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f359 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91bba expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.117008:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f360 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.117027:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f328 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bac expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.117036:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f360 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.117085:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f328 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bac expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.117102:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f328 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bac expref: 34 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166858.117119:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452001536:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166858.117235:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9af00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.119293:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452001536:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.119306:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762166858.119324:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f360 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166858.119374:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444531200 00000100:00100000:2.0:1762166858.119382:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444531200 00010000:00010000:2.0:1762166858.119428:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f328 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bac expref: 35 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166858.119468:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 841 00000100:00100000:2.0:1762166858.119479:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444531200:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.119494:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.119500:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f328 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bac expref: 35 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.119513:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f328 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bac expref: 35 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.119535:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f328 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bac expref: 35 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.119551:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:2.0:1762166858.119556:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f360 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.119565:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f360 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.119572:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f360 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.119619:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166858.119645:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f360 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.119655:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f360 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.119672:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000100:00100000:2.0:1762166858.119678:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765444531200:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 200us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.119688:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 841 00010000:00010000:0.0:1762166858.119841:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f359 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bba expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.119858:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f360 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bba expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.119866:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:0.0:1762166858.119869:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166858.119872:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198800, rc 0) 00000100:00100000:0.0:1762166858.119912:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49342:x1847765444531072:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3111us (3350us total) trans 8589935042 rc 0/0 00000100:00100000:0.0:1762166858.119920:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 423 00000100:00100000:1.0:1762166858.121842:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.121880:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444531328 00000100:00100000:0.0:1762166858.121889:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444531328 00000100:00100000:0.0:1762166858.121946:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 179 00000100:00100000:0.0:1762166858.121954:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49342:x1847765444531328:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:0.0:1762166858.122109:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49342:x1847765444531328:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 155us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.122132:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 179 00000100:00100000:1.0:1762166858.123343:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.123489:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444531584 00000100:00100000:3.0:1762166858.123499:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444531584 00000100:00100000:3.0:1762166858.123549:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 180 00000100:00100000:3.0:1762166858.123557:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49342:x1847765444531584:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166858.123800:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49342:x1847765444531584:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 243us (466us total) trans 8589935043 rc 0/0 00000100:00100000:3.0:1762166858.123810:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 180 00000100:00100000:1.0:1762166858.125115:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.125214:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444531840 00000100:00100000:0.0:1762166858.125225:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444531840 00000100:00100000:0.0:1762166858.125287:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 424 00000100:00100000:0.0:1762166858.125297:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49342:x1847765444531840:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.125321:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.125326:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166858.125359:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f360 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bba expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.125389:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f34b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bb3 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.125409:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:0.0:1762166858.125424:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166858.125439:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f36e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91bc1 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.125558:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f375 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.125572:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f375 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.125582:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f375 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.125595:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166858.125730:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f36e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bc1 expref: 36 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.125799:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f375 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bc1 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.125807:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:0.0:1762166858.125811:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166858.125813:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199c00, rc 0) 00000100:00100000:0.0:1762166858.125885:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49342:x1847765444531840:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 589us (777us total) trans 8589935044 rc 0/0 00000100:00100000:0.0:1762166858.125892:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 424 00000100:00100000:1.0:1762166858.127711:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.128130:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444532096 00000100:00100000:3.0:1762166858.128144:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444532096 00000100:00100000:3.0:1762166858.128209:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 181 00000100:00100000:3.0:1762166858.128223:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348210050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49342:x1847765444532096:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:3.0:1762166858.128322:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f375 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bc1 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.128361:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f383 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.128374:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f305 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ba5 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.128401:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f383 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.128450:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f305 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ba5 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.128463:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f305 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ba5 expref: 35 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:3.0:1762166858.128477:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452001664:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166858.128571:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166858.130705:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452001664:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166858.130734:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f383 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166858.130913:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.130972:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444532224 00000100:00100000:2.0:1762166858.130981:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444532224 00010000:00010000:2.0:1762166858.131017:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f305 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ba5 expref: 36 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166858.131060:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 842 00000100:00100000:2.0:1762166858.131070:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765444532224:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.131084:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.131090:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f305 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ba5 expref: 36 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.131101:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f305 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ba5 expref: 36 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.131120:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f305 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ba5 expref: 36 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.131136:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:2.0:1762166858.131141:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f383 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.131149:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f383 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.131174:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f383 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.131202:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166858.131236:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f383 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.131246:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f383 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166858.131264:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444532224:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 194us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.131273:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 842 00010000:00010000:3.0:1762166858.131532:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f383 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.131541:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f383 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.131547:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f383 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.131563:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166858.131567:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f383 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.131581:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f383 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.131593:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:3.0:1762166858.131596:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166858.131599:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f383 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.131605:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f383 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.131616:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4c00) 00010000:00010000:3.0:1762166858.131619:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166858.131624:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f375 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bc1 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166858.131746:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348210050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49342:x1847765444532096:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 3527us (4045us total) trans 8589935045 rc -22/-22 00000100:00100000:3.0:1762166858.131754:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 181 00000100:00100000:1.0:1762166858.132979:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.133044:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444532352 00000100:00100000:0.0:1762166858.133053:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444532352 00000100:00100000:0.0:1762166858.133115:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 425 00000100:00100000:0.0:1762166858.133127:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49342:x1847765444532352:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.133158:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.133187:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f38a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91bc8 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.133265:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f38a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bc8 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.133283:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f38a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bc8 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.133306:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166858.133310:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166858.133313:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199400, rc 0) 00000100:00100000:0.0:1762166858.133427:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49342:x1847765444532352:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 302us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.133435:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 425 00000100:00100000:1.0:1762166858.135528:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.135612:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444532608 00000100:00100000:0.0:1762166858.135623:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444532608 00000100:00100000:0.0:1762166858.135687:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 426 00000100:00100000:0.0:1762166858.135700:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49342:x1847765444532608:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.135723:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.135746:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f391 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91bcf expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.136404:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f398 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.136432:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f398 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.136444:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f398 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.136456:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x3c:0x0]: returning size 0 00010000:00010000:0.0:1762166858.136508:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f391 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bcf expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.136529:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f398 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bcf expref: 37 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.136537:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3c:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:0.0:1762166858.136540:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166858.136544:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198800, rc 0) 00000100:00100000:0.0:1762166858.136638:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49342:x1847765444532608:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 941us (1121us total) trans 8589935046 rc 0/0 00000100:00100000:0.0:1762166858.136646:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 426 00000100:00100000:1.0:1762166858.138546:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.138602:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444532864 00000100:00100000:0.0:1762166858.138612:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444532864 00000100:00100000:0.0:1762166858.138662:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 427 00000100:00100000:0.0:1762166858.138670:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49342:x1847765444532864:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.138692:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.138707:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f3a6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91bd6 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.138819:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f3ad lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.138833:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f3ad lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.138843:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f3ad lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.138865:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166858.138980:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f3a6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bd6 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.138994:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f3ad lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bd6 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.139000:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166858.139003:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166858.139005:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198000, rc 0) 00000100:00100000:0.0:1762166858.139087:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49342:x1847765444532864:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 418us (549us total) trans 8589935047 rc 0/0 00000100:00100000:0.0:1762166858.139095:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 427 00000100:00100000:1.0:1762166858.141407:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.141534:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444533120 00000100:00100000:3.0:1762166858.141548:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444533120 00000100:00100000:3.0:1762166858.141616:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 182 00000100:00100000:3.0:1762166858.141629:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49342:x1847765444533120:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:3.0:1762166858.141701:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f3ad lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bd6 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.141811:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f3bb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.141826:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f38a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bc8 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.141833:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f3bb lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.141870:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f38a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bc8 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.141883:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f38a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bc8 expref: 39 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:3.0:1762166858.141896:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452001792:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166858.141984:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855840 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.143905:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452001792:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166858.143940:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f3bb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166858.144212:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.144293:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444533248 00000100:00100000:2.0:1762166858.144302:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444533248 00010000:00010000:2.0:1762166858.144342:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f38a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bc8 expref: 40 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:2.0:1762166858.144386:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 843 00000100:00100000:2.0:1762166858.144397:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2361:x1847765444533248:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.144426:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.144434:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f38a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bc8 expref: 40 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.144446:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f38a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bc8 expref: 40 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.144467:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f38a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bc8 expref: 40 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:2.0:1762166858.144483:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166858.144487:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f3bb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.144514:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f3bb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.144521:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f3bb lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.144554:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166858.144619:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444533248:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 223us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.144628:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 843 00010000:00010000:1.0:1762166858.144807:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f3bb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.144815:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f3bb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.144857:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f3c2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.144871:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f398 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bcf expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.144879:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f3c2 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.144912:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f398 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bcf expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.144927:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f398 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bcf expref: 38 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1762166858.144946:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452001920:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.145021:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.147348:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452001920:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.147369:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166858.147392:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f3c2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166858.147509:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444533376 00000100:00100000:3.0:1762166858.147518:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444533376 00010000:00010000:3.0:1762166858.147555:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f398 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bcf expref: 39 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:3.0:1762166858.147596:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 844 00000100:00100000:3.0:1762166858.147605:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444533376:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166858.147619:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166858.147626:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f398 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bcf expref: 39 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166858.147657:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f398 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bcf expref: 39 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166858.147679:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f398 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bcf expref: 39 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166858.147693:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3c:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:3.0:1762166858.147698:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f3c2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.147708:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f3c2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.147715:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f3c2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.147749:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166858.147797:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f3c2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.147816:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f3c2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166858.147865:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2360:x1847765444533376:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 250us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.147884:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 844 00000100:00100000:2.0:1762166858.148269:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452002048:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166858.148331:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166858.148364:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463e000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.148394:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452002048 00000100:00100000:0.0:1762166858.148400:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452002048 00000100:00100000:0.0:1762166858.148446:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1762166858.148455:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:30821:x1847765452002048:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166858.148524:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:30821:x1847765452002048:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 71us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.148529:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1762166858.148571:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452002048:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1762166858.148615:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935048 00000001:00080000:2.0:1762166858.148682:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935049 00010000:00010000:2.0:1762166858.148706:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f3c2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.148714:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f3c2 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.148732:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f3c2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.148739:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a27400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.148744:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f3c2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.148752:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f3c2 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.148798:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3c:0x0].0x0 (ffff9ee34bdb4600) 00010000:00010000:2.0:1762166858.148805:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166858.148810:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f3c2 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.148816:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f3c2 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.148837:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f3bb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.148843:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f3bb lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.148849:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f3bb lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.148854:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.148857:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f3bb lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.148864:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f3bb lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.148882:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166858.148885:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166858.148888:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f3bb lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.148893:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f3bb lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.148907:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166858.148910:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166858.148915:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f3ad lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bd6 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.149008:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49342:x1847765444533120:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 7383us (7611us total) trans 8589935050 rc 0/0 00000100:00100000:2.0:1762166858.149017:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 182 00000020:00080000:2.0:1762166858.149021:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166858.150190:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.150239:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444533504 00000100:00100000:0.0:1762166858.150247:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444533504 00000100:00100000:0.0:1762166858.150288:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 428 00000100:00100000:0.0:1762166858.150298:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49342:x1847765444533504:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.150316:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.150341:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f3c9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91bdd expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.150389:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bdd expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.150401:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bdd expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.150428:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166858.150431:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166858.150434:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198600, rc 0) 00000100:00100000:0.0:1762166858.150472:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49342:x1847765444533504:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 177us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.150500:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 428 00010000:00010000:2.0:1762166858.151875:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166858.152229:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.152281:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444533760 00000100:00100000:2.0:1762166858.152290:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444533760 00000100:00100000:2.0:1762166858.152338:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 183 00000100:00100000:2.0:1762166858.152347:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49342:x1847765444533760:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762166858.152821:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x3c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166858.152926:0:30821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].18, 64 off9536 00000001:00080000:2.0:1762166858.152938:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935051 00010000:00010000:2.0:1762166858.152998:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f3d0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.153012:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f3d0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.153034:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f3d0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.153043:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f3d0 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.153049:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f3d0 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.153055:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f3d0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.153075:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166858.153094:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166858.153102:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f3d0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.153111:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166858.153116:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f3d0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.153123:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f3d0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.153146:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3c:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:3.0:1762166858.153150:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166858.153155:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f3d0 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.153159:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f3d0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.153176:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166858.153177:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166858.153179:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166858.153188:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49342:x1847765444533760:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 840us (959us total) trans 8589935052 rc 0/0 00000100:00100000:2.0:1762166858.153197:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 183 00000020:00080000:2.0:1762166858.153203:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166858.154567:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.154611:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444534016 00000100:00100000:2.0:1762166858.154619:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444534016 00000100:00100000:2.0:1762166858.154661:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 184 00000100:00100000:2.0:1762166858.154668:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49342:x1847765444534016:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166858.154921:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49342:x1847765444534016:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 252us (358us total) trans 8589935053 rc 0/0 00000100:00100000:2.0:1762166858.154928:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 184 00000100:00100000:1.0:1762166858.163456:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.163558:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444534144 00000100:00100000:0.0:1762166858.163569:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444534144 00000100:00100000:0.0:1762166858.163625:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 429 00000100:00100000:0.0:1762166858.163636:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49344:x1847765444534144:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166858.163660:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.163679:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f3d7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91be4 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.163744:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f3de lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.163757:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f3de lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.163788:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f3de lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.163802:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f3e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.163809:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.163816:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.163918:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f3ec lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.163927:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f3ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.163947:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f3ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.163980:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166858.163984:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166858.163999:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f3ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.164009:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f3ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.164016:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f3de lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.164022:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f3de lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.164028:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f3de lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.164033:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166858.164037:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f3de lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.164045:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f3de lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.164055:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166858.164058:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166858.164063:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f3de lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.164069:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f3de lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.164084:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.164088:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f3e5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.164091:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f3e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.164095:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166858.164097:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f3e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.164102:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f3e5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.164109:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166858.164112:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166858.164115:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f3e5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.164120:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f3e5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.164147:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f3d7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91be4 expref: 45 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.164159:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f3ec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91be4 expref: 44 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.164165:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166858.164174:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166858.164176:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199200, rc 0) 00000100:00100000:0.0:1762166858.164241:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49344:x1847765444534144:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 606us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.164253:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 429 00000100:00100000:1.0:1762166858.166557:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.166620:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444534272 00000100:00100000:0.0:1762166858.166633:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444534272 00000100:00100000:0.0:1762166858.166694:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1237 00000100:00100000:0.0:1762166858.166707:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444534272:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166858.166723:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.166751:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f3f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91beb expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.166835:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452002176:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166858.166923:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360b7c540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.168148:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452002176:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166858.168203:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f3f3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91beb expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.168229:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f3f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91beb expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.168243:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199800, rc 0) 00000100:00100000:0.0:1762166858.168304:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444534272:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 1599us (1756us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166858.168313:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1237 00000100:00100000:1.0:1762166858.182671:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.182792:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444534400 00000100:00100000:0.0:1762166858.182802:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444534400 00000100:00100000:0.0:1762166858.182857:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 430 00000100:00100000:0.0:1762166858.182867:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49348:x1847765444534400:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166858.182931:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f3fa lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.182944:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f3fa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.182954:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f3fa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.182968:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f401 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.182975:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f401 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183021:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f401 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183109:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f408 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183116:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f408 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183122:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f408 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.183153:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166858.183158:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166858.183168:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f408 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183194:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f3fa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183200:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f3fa lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183207:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f3fa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183212:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166858.183216:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f3fa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183223:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f3fa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183231:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166858.183233:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166858.183236:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f3fa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183240:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f3fa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183249:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f401 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183252:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f401 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183255:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f401 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183258:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166858.183265:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f401 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183269:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f401 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183273:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166858.183274:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166858.183275:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f401 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183278:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f401 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183288:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f408 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183291:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f408 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183295:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f408 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183297:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166858.183299:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f408 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183302:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f408 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183305:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166858.183306:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166858.183307:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f408 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.183316:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f408 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166858.183381:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49348:x1847765444534400:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 512us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.183389:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 430 00000100:00100000:1.0:1762166858.193260:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.193335:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444534656 00000100:00100000:0.0:1762166858.193343:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444534656 00000100:00100000:0.0:1762166858.193410:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 431 00000100:00100000:0.0:1762166858.193431:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49350:x1847765444534656:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.193452:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.193471:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f40f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91bf2 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.193582:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f416 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.193595:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f416 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.193606:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f416 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.193617:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166858.193743:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f40f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bf2 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.193808:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f416 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bf2 expref: 46 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.193835:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166858.193839:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166858.193843:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199a00, rc 0) 00000100:00100000:0.0:1762166858.193904:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49350:x1847765444534656:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 475us (652us total) trans 8589935054 rc 0/0 00000100:00100000:0.0:1762166858.193911:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 431 00000100:00100000:1.0:1762166858.195895:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.195978:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444534784 00000100:00100000:0.0:1762166858.195990:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444534784 00000100:00100000:0.0:1762166858.196051:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1238 00000100:00100000:0.0:1762166858.196060:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444534784:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.196076:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.196091:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f424 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91bf9 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.196150:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452002304:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166858.196231:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360b7c540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.198075:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452002304:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166858.198120:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f424 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bf9 expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.198146:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f424 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bf9 expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.198160:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199800, rc 0) 00000100:00100000:0.0:1762166858.198240:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444534784:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2179us (2356us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166858.198250:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1238 00000100:00100000:1.0:1762166858.200664:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.200791:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444535040 00000100:00100000:0.0:1762166858.200803:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444535040 00000100:00100000:0.0:1762166858.200878:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 432 00000100:00100000:0.0:1762166858.200891:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49350:x1847765444535040:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.200925:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.200952:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f42b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c00 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.201079:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f432 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.201097:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f3ec lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91be4 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.201107:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f432 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.201147:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f3ec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91be4 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.201159:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f3ec lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91be4 expref: 47 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1762166858.201172:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452002432:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166858.201268:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360b7c540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.202887:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.202893:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452002432:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166858.202958:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f432 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166858.203070:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444535168 00000100:00100000:3.0:1762166858.203084:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444535168 00010000:00010000:3.0:1762166858.203125:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f3ec lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91be4 expref: 48 pid: 30817 timeout: 578 lvb_type: 0 00000100:00100000:3.0:1762166858.203167:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 845 00000100:00100000:3.0:1762166858.203180:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2360:x1847765444535168:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166858.203198:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166858.203205:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f3ec lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91be4 expref: 48 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166858.203219:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f3ec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91be4 expref: 48 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166858.203240:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f3ec lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91be4 expref: 48 pid: 30817 timeout: 578 lvb_type: 0 00010000:00010000:3.0:1762166858.203257:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:3.0:1762166858.203275:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f432 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.203285:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f432 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.203293:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f432 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.203331:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166858.203369:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f432 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.203381:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f432 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166858.203401:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:2360:x1847765444535168:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 223us (522us total) trans 0 rc 0/0 00000004:00200000:0.0:1762166858.203405:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000100:00100000:3.0:1762166858.203425:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 845 00010000:00010000:0.0:1762166858.203631:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f42b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c00 expref: 48 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.203651:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f432 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c00 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.203661:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166858.203664:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166858.203667:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198c00, rc 0) 00000100:00100000:0.0:1762166858.203729:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49350:x1847765444535040:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2841us (3075us total) trans 8589935055 rc 0/0 00000100:00100000:0.0:1762166858.203742:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 432 00000100:00100000:1.0:1762166858.206307:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.206366:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444535424 00000100:00100000:0.0:1762166858.206377:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444535424 00000100:00100000:0.0:1762166858.206445:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 433 00000100:00100000:0.0:1762166858.206455:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49350:x1847765444535424:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.206478:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.206498:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f440 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c07 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.207011:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f447 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.207024:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f447 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.207034:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f447 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.207044:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x3d:0x0]: returning size 0 00010000:00010000:0.0:1762166858.207081:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f440 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c07 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.207098:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f447 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c07 expref: 49 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.207106:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3d:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166858.207108:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166858.207112:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198a00, rc 0) 00000100:00100000:0.0:1762166858.207175:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49350:x1847765444535424:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 721us (877us total) trans 8589935056 rc 0/0 00000100:00100000:0.0:1762166858.207182:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 433 00000100:00100000:1.0:1762166858.209055:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.209121:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444535680 00000100:00100000:0.0:1762166858.209133:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444535680 00000100:00100000:0.0:1762166858.209186:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 434 00000100:00100000:0.0:1762166858.209196:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49350:x1847765444535680:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.209215:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.209231:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f455 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c0e expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.209319:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f45c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.209332:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f447 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c07 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.209340:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f45c lrc: 4/0,1 mode: --/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.209370:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f447 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c07 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.209383:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f447 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c07 expref: 50 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.209397:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452002560:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166858.209489:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee345742840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.210602:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452002560:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166858.210624:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f45c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166858.210687:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.210847:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444535808 00000100:00100000:3.0:1762166858.210854:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444535808 00010000:00010000:3.0:1762166858.210886:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f447 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c07 expref: 51 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166858.210915:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 846 00000100:00100000:3.0:1762166858.210924:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2360:x1847765444535808:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166858.210937:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166858.210943:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f447 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c07 expref: 51 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.210955:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f447 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c07 expref: 51 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.210976:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f447 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c07 expref: 51 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.211007:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3d:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:3.0:1762166858.211011:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f45c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.211020:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f45c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.211027:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f45c lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.211053:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166858.211072:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f45c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.211082:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f45c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.211096:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x3d:0x0]: returning size 0 00000100:00100000:3.0:1762166858.211097:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2360:x1847765444535808:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 172us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.211107:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 846 00000004:00080000:0.0:1762166858.211396:0:30817:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x8c:0x0], index 0: 0 00010000:00010000:0.0:1762166858.211554:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f45c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.211562:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f45c lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.211568:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f45c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.211575:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166858.211579:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f45c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.211585:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f45c lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.211600:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3d:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166858.211603:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166858.211606:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f45c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.211612:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f45c lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.211658:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f455 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c0e expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.211668:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166858.211670:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166858.211674:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f455 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c0e expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.211683:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199800, rc 0) 00000100:00100000:0.0:1762166858.211737:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49350:x1847765444535680:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2542us (2690us total) trans 8589935057 rc 301/301 00000100:00100000:0.0:1762166858.211745:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 434 00000100:00100000:1.0:1762166858.213457:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.213535:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444536064 00000100:00100000:2.0:1762166858.213545:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444536064 00000100:00100000:2.0:1762166858.213594:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 185 00000100:00100000:2.0:1762166858.213603:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49350:x1847765444536064:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166858.213920:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49350:x1847765444536064:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 317us (473us total) trans 8589935058 rc 0/0 00000100:00100000:2.0:1762166858.213928:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 185 00000100:00100000:1.0:1762166858.215103:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.215143:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444536192 00000100:00100000:0.0:1762166858.215149:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444536192 00000100:00100000:0.0:1762166858.215187:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 435 00000100:00100000:0.0:1762166858.215196:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49350:x1847765444536192:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.215210:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.215230:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f46a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c15 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.215281:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f471 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.215292:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f432 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c00 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.215297:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f471 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.215319:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f432 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c00 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.215327:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f432 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c00 expref: 51 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.215335:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452002688:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166858.215392:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.216451:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452002688:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166858.216482:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f471 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166858.216723:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.216830:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444536320 00000100:00100000:3.0:1762166858.216835:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444536320 00010000:00010000:3.0:1762166858.216855:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f432 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c00 expref: 52 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166858.216879:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 847 00000100:00100000:3.0:1762166858.216885:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2361:x1847765444536320:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166858.216894:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166858.216898:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f432 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c00 expref: 52 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.216906:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f432 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c00 expref: 52 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.216928:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9f432 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c00 expref: 52 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.216937:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:3.0:1762166858.216940:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f471 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.216953:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f471 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.216962:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f471 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.216985:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166858.217006:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f471 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.217014:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f471 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166858.217020:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444536320:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 134us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.217026:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 847 00000004:00200000:0.0:1762166858.217042:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166858.217047:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166858.217064:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f471 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.217092:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f46a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c15 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.217107:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f471 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c15 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.217114:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166858.217117:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166858.217120:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199600, rc 0) 00000100:00100000:0.0:1762166858.217155:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49350:x1847765444536192:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1961us (2053us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.217160:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 435 00000100:00100000:1.0:1762166858.218297:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.218346:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444536448 00000100:00100000:0.0:1762166858.218352:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444536448 00000100:00100000:0.0:1762166858.218395:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1239 00000100:00100000:0.0:1762166858.218401:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444536448:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.218438:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.218450:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f478 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c1c expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.218483:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452002816:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166858.218547:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.219507:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452002816:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166858.219533:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f478 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c1c expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.219550:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f478 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c1c expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.219562:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198400, rc 0) 00000100:00100000:0.0:1762166858.219600:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444536448:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1197us (1303us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166858.219607:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1239 00000100:00100000:1.0:1762166858.220792:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.220837:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444536576 00000100:00100000:0.0:1762166858.220843:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444536576 00000100:00100000:0.0:1762166858.220886:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 436 00000100:00100000:0.0:1762166858.220896:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49350:x1847765444536576:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.220910:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.220927:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f47f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c23 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.220982:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f486 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.221004:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f486 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.221014:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f486 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.221044:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x3d:0x0]: returning size 0 00000004:00200000:0.0:1762166858.221049:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166858.221062:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f486 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.221083:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f47f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c23 expref: 52 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.221095:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f486 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3d:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c23 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.221103:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3d:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166858.221105:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762166858.221108:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199000, rc 0) 00000100:00100000:0.0:1762166858.221153:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49350:x1847765444536576:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 259us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.221159:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 436 00000100:00100000:1.0:1762166858.222409:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.222485:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444536704 00000100:00100000:0.0:1762166858.222494:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444536704 00000100:00100000:0.0:1762166858.222530:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1240 00000100:00100000:0.0:1762166858.222535:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444536704:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.222545:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.222558:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f48d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c2a expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166858.222586:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166858.222616:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.222618:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.222626:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f48d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c2a expref: 14 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.222643:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f48d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c2a expref: 14 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.222653:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198a00, rc 0) 00000100:00100000:0.0:1762166858.222698:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2361:x1847765444536704:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 161us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.222704:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1240 00000100:00100000:1.0:1762166858.224129:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.224185:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444536960 00000100:00100000:0.0:1762166858.224192:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444536960 00000100:00100000:0.0:1762166858.224239:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 437 00000100:00100000:0.0:1762166858.224248:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49350:x1847765444536960:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.224263:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.224277:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f494 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c31 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.224356:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f49b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.224368:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f49b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.224392:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f49b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.224406:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166858.224593:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f494 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c31 expref: 54 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.224608:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f49b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c31 expref: 53 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.224616:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166858.224619:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166858.224622:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198000, rc 0) 00000100:00100000:0.0:1762166858.224669:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49350:x1847765444536960:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 422us (543us total) trans 8589935059 rc 0/0 00000100:00100000:0.0:1762166858.224676:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 437 00000100:00100000:1.0:1762166858.226446:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.226527:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444537088 00000100:00100000:0.0:1762166858.226538:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444537088 00000100:00100000:0.0:1762166858.226595:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1241 00000100:00100000:0.0:1762166858.226605:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444537088:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.226616:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.226629:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f4a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c38 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.226671:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452002944:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166858.226744:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.227991:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452002944:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166858.228039:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f4a9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c38 expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.228057:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9f4a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c38 expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.228069:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198e00, rc 0) 00000100:00100000:0.0:1762166858.228112:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444537088:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1508us (1677us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166858.228120:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1241 00000100:00100000:1.0:1762166858.229722:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.229816:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444537216 00000100:00100000:0.0:1762166858.229824:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444537216 00000100:00100000:0.0:1762166858.229873:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1242 00000100:00100000:0.0:1762166858.229883:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444537216:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.229897:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.229911:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f4b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c3f expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.229954:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452003072:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166858.230034:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.231174:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452003072:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166858.231201:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f4b0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c3f expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.231218:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f4b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c3f expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.231243:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199800, rc 0) 00000100:00100000:0.0:1762166858.231280:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444537216:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1400us (1563us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166858.231286:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1242 00000100:00100000:1.0:1762166858.232312:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.232386:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444537344 00000100:00100000:0.0:1762166858.232395:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444537344 00000100:00100000:0.0:1762166858.232447:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1243 00000100:00100000:0.0:1762166858.232456:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444537344:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762166858.232492:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4b7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.232508:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b97 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.232516:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166858.232518:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166858.232521:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4b7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.232548:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b97 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.232561:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b97 expref: 23 pid: 6532 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.232571:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452003200:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166858.232642:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.233610:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452003200:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166858.233628:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4b7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166858.233792:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.233894:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444537472 00000100:00100000:3.0:1762166858.233901:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444537472 00010000:00010000:3.0:1762166858.233927:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b97 expref: 24 pid: 6532 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166858.233961:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 848 00000100:00100000:3.0:1762166858.233970:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444537472:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166858.233983:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166858.234004:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b97 expref: 24 pid: 6532 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.234027:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b97 expref: 24 pid: 6532 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.234050:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f2e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b97 expref: 24 pid: 6532 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.234064:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.234066:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.234070:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4b7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.234079:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4b7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.234110:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166858.234153:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444537472:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 181us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.234163:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 848 00010000:00010000:0.0:1762166858.234175:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4b7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.234186:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4b7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.234208:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4b7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.234214:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.234221:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.234229:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166858.234233:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.234242:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.234267:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.234275:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.234333:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765444537344:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 1877us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.234342:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1243 00000100:00100000:1.0:1762166858.235673:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.235750:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444537600 00000100:00100000:0.0:1762166858.235757:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444537600 00000100:00100000:0.0:1762166858.235822:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1244 00000100:00100000:0.0:1762166858.235831:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765444537600:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.235844:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.235860:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f4be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c46 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166858.235881:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x8b:0x0] initial LVB size: 0, mtime: 0x69088847, atime: 0x69088847, ctime: 0x6908884a, blocks: 0x1 00010000:00010000:0.0:1762166858.235899:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.235902:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.235909:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f4be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c46 expref: 23 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.235924:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f4be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c46 expref: 23 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.235949:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199200, rc 0) 00000100:00100000:0.0:1762166858.235986:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444537600:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 157us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.235993:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1244 00000100:00100000:1.0:1762166858.261755:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.261895:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444537728 00000100:00100000:0.0:1762166858.261905:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444537728 00000100:00100000:0.0:1762166858.261961:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 438 00000100:00100000:0.0:1762166858.261971:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49350:x1847765444537728:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:1.0:1762166858.278821:0:32137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935059 is committed 00000020:00080000:1.0:1762166858.278880:0:32137:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee246a9a300 refcount 2 committed 0 result 0 batchid 4294969126 00000020:00080000:1.0:1762166858.278886:0:32137:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee241fa8500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3471576c0 00000020:00080000:1.0:1762166858.278890:0:32137:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee241fa8600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee34a52b000 00000020:00080000:1.0:1762166858.278910:0:32137:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969125 batchid updated 00000020:00080000:0.0:1762166858.278939:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969126 committed batchid 4294969125 00000100:00100000:3.0:1762166858.279032:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49350:x1847765444537728:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 17053us (17276us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.279047:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 438 00000020:00080000:0.0:1762166858.279149:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969125 00000100:00100000:1.0:1762166858.280825:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.280897:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444537856 00000100:00100000:0.0:1762166858.280908:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444537856 00000100:00100000:0.0:1762166858.280964:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1245 00000100:00100000:0.0:1762166858.280973:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765444537856:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:0.0:1762166858.281077:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765444537856:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 105us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.281085:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1245 00000100:00100000:1.0:1762166858.288265:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.288361:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444537984 00000100:00100000:0.0:1762166858.288380:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444537984 00000100:00100000:0.0:1762166858.288457:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1246 00000100:00100000:0.0:1762166858.288467:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444537984:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762166858.288514:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4c5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.288547:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.288549:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.288554:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4c5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.288568:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4c5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.288596:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4c5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.288604:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.288611:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.288618:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166858.288622:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.288630:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.288643:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.288662:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.288740:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444537984:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 274us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.288748:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1246 00000100:00100000:1.0:1762166858.290230:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.290296:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444538240 00000100:00100000:3.0:1762166858.290305:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444538240 00000100:00100000:3.0:1762166858.290346:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 439 00000100:00100000:3.0:1762166858.290356:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49350:x1847765444538240:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166858.290399:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166858.290440:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9f486 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c23 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.290458:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3d:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:3.0:1762166858.290467:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166858.290499:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f4cc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.290510:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f4cc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.290518:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f4cc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:3.0:1762166858.290689:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c3add3b9 reply state 000000009e7796b9 transno 8589935060 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f4cc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166858.290698:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166858.290824:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49350:x1847765444538240:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 469us (600us total) trans 8589935060 rc 0/0 00000100:00100000:3.0:1762166858.290830:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 439 00010000:00010000:3.0:1762166858.291744:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f4cc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.291755:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f4cc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.291844:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f4cc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.291851:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166858.291867:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f4cc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.291887:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f4cc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.291899:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3d:0x0].0x0 (ffff9ee363960000) 00010000:00010000:3.0:1762166858.291903:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166858.291906:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f4cc lrc: 2/0,0 mode: --/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.291912:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f4cc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166858.291931:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.291949:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444538368 00000100:00100000:3.0:1762166858.291956:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444538368 00000100:00100000:2.0:1762166858.292027:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 440 00000100:00100000:2.0:1762166858.292039:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49350:x1847765444538368:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166858.292054:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.292069:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f4d3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c4d expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.292110:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f4d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c4d expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.292123:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f4d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c4d expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.292139:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3d:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166858.292142:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166858.292145:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2200, rc 0) 00000100:00100000:2.0:1762166858.292185:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49350:x1847765444538368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 150us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.292190:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 440 00000100:00100000:1.0:1762166858.293392:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.293526:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444538496 00000100:00100000:0.0:1762166858.293536:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444538496 00000100:00100000:0.0:1762166858.293584:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1247 00000100:00100000:0.0:1762166858.293592:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:49350:x1847765444538496:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.293604:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.293618:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f4da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c54 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.293645:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f48d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c2a expref: 15 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.293653:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.293655:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.293663:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f4da lrc: 4/0,0 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c54 expref: 15 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.293694:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f48d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c2a expref: 15 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.293705:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f48d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c2a expref: 15 pid: 26444 timeout: 579 lvb_type: 1 00000100:00100000:0.0:1762166858.293732:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452003328:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166858.293837:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.295072:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.295154:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444538624 00000100:00100000:3.0:1762166858.295163:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444538624 00000100:00100000:0.0:1762166858.295177:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452003328:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166858.295205:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f48d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c2a expref: 16 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:0.0:1762166858.295223:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f4da lrc: 3/0,0 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c54 expref: 16 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.295248:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199800, rc 0) 00000100:00100000:3.0:1762166858.295257:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 849 00000100:00100000:3.0:1762166858.295280:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444538624:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166858.295295:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166858.295307:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:49350:x1847765444538496:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1715us (1925us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.295327:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1247 00010000:00010000:3.0:1762166858.295328:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f48d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c2a expref: 16 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:3.0:1762166858.295347:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f48d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c2a expref: 15 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:3.0:1762166858.295369:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f48d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c2a expref: 15 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:3.0:1762166858.295410:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.295425:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.295432:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f4da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c54 expref: 14 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.295441:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f4da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c54 expref: 14 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.295473:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f4da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c54 expref: 14 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166858.295484:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc29c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765452003456:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762166858.295595:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855d80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.296878:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.296900:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc29c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765452003456:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762166858.296928:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166858.296931:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444538752 00000100:00100000:0.0:1762166858.296940:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444538752 00000100:00100000:3.0:1762166858.296978:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444538624:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1707us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.296991:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 849 00000100:00100000:0.0:1762166858.297013:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1248 00000100:00100000:0.0:1762166858.297028:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765444538752:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166858.297330:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x8c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166858.297334:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x8c:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:0.0:1762166858.297336:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x8c:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:0.0:1762166858.297339:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x8c:0x0] updating lvb ctime from disk: 0 -> 1762166858 00002000:00010000:0.0:1762166858.297341:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x8c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166858.297380:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444538752:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 359us (507us total) trans 21474836796 rc 0/0 00000100:00100000:0.0:1762166858.297387:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1248 00000100:00100000:1.0:1762166858.298335:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.298386:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444539008 00000100:00100000:2.0:1762166858.298397:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444539008 00000100:00100000:2.0:1762166858.298464:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 441 00000100:00100000:2.0:1762166858.298486:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49350:x1847765444539008:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762166858.298530:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.298564:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f471 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c15 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.298580:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:2.0:1762166858.298585:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166858.298630:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4e1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.298642:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4e1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.298648:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4e1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:2.0:1762166858.298818:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005b7c94cd reply state 0000000075b8b60c transno 8589935061 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4e1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166858.298829:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166858.298918:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49350:x1847765444539008:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 435us (584us total) trans 8589935061 rc 0/0 00000100:00100000:2.0:1762166858.298926:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 441 00010000:00010000:2.0:1762166858.299724:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4e1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.299734:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4e1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.299740:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4e1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.299746:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.299750:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4e1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.299807:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4e1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.299819:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:2.0:1762166858.299823:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166858.299826:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4e1 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.299831:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4e1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166858.299867:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.299920:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444539136 00000100:00100000:0.0:1762166858.299934:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444539136 00000100:00100000:0.0:1762166858.299976:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1249 00000100:00100000:0.0:1762166858.299985:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:49350:x1847765444539136:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.299996:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.300009:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c5b expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.300032:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f4be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c46 expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.300040:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.300042:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.300046:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4e8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c5b expref: 24 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.300076:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f4be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c46 expref: 24 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.300088:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f4be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c46 expref: 24 pid: 26444 timeout: 579 lvb_type: 1 00000100:00100000:0.0:1762166858.300101:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452003584:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166858.300173:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.301258:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452003584:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166858.301283:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4e8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c5b expref: 24 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.301313:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198400, rc 0) 00000100:00100000:0.0:1762166858.301354:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:49350:x1847765444539136:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1370us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.301362:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1249 00000100:00100000:2.0:1762166858.301551:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.301648:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444539264 00000100:00100000:3.0:1762166858.301655:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444539264 00010000:00010000:3.0:1762166858.301693:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f4be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c46 expref: 24 pid: 26444 timeout: 579 lvb_type: 1 00000100:00100000:3.0:1762166858.301730:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 850 00000100:00100000:3.0:1762166858.301740:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444539264:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166858.301758:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166858.301806:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f4be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c46 expref: 24 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:3.0:1762166858.301820:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f4be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c46 expref: 24 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:3.0:1762166858.301839:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f4be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c46 expref: 24 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:3.0:1762166858.301852:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.301854:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.301858:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c5b expref: 23 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.301868:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c5b expref: 23 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.301896:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c5b expref: 23 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166858.301907:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc29c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765452003712:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762166858.301953:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166858.302917:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc29c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765452003712:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762166858.302932:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166858.302964:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444539264:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1225us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.302971:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.302980:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 850 00000100:00100000:0.0:1762166858.303019:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444539392 00000100:00100000:0.0:1762166858.303029:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444539392 00000100:00100000:0.0:1762166858.303069:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1250 00000100:00100000:0.0:1762166858.303079:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765444539392:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166858.303239:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x8b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166858.303242:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x8b:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166858.303244:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x8b:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166858.303245:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8b:0x0] updating lvb ctime from disk: 1762166858 -> 1762166858 00002000:00010000:0.0:1762166858.303246:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x8b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166858.303290:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444539392:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 213us (319us total) trans 17179869467 rc 0/0 00000100:00100000:0.0:1762166858.303297:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1250 00000100:00100000:2.0:1762166858.304234:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.304297:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444539648 00000100:00100000:1.0:1762166858.304303:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444539648 00000100:00100000:1.0:1762166858.304342:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 186 00000100:00100000:1.0:1762166858.304351:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348213850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49350:x1847765444539648:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166858.304409:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f49b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c31 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.304451:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f4ef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.304463:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f3c9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bdd expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.304472:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f416 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bf2 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.304479:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f4ef lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.304505:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f416 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bf2 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.304517:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f416 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bf2 expref: 27 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1762166858.304530:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc30000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452003840:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166858.304607:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bdd expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.304618:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f3c9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bdd expref: 27 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1762166858.304628:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452003968:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.304655:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243359cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.305602:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc30000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452003840:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166858.305615:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452003968:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166858.305632:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f4ef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166858.305862:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.305887:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.305908:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444539904 00000100:00100000:3.0:1762166858.305914:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444539904 00010000:00010000:3.0:1762166858.305933:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f3c9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bdd expref: 28 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.305964:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444540032 00000100:00100000:3.0:1762166858.305969:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 851 00000100:00100000:0.0:1762166858.305971:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444540032 00000100:00100000:3.0:1762166858.305980:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444539904:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166858.305993:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166858.305999:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f3c9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bdd expref: 29 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.306009:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bdd expref: 29 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.306018:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 187 00010000:00010000:3.0:1762166858.306029:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f3c9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bdd expref: 29 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.306030:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49238:x1847765444540032:12345-192.168.203.35@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1762166858.306053:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:3.0:1762166858.306058:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f4ef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.306065:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f4ef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.306072:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166858.306115:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444539904:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 137us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.306137:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 851 00000100:00100000:0.0:1762166858.306200:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49238:x1847765444540032:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 173us (338us total) trans 8589935062 rc 0/0 00000100:00100000:0.0:1762166858.306207:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 187 00000100:00100000:1.0:1762166858.307170:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.307241:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444540160 00000100:00100000:3.0:1762166858.307246:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444540160 00010000:00010000:3.0:1762166858.307264:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f416 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bf2 expref: 28 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166858.307298:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 852 00000100:00100000:3.0:1762166858.307306:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444540160:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166858.307315:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166858.307320:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f416 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bf2 expref: 28 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.307331:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f416 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bf2 expref: 28 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.307346:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f416 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91bf2 expref: 28 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.307358:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:3.0:1762166858.307362:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f4ef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.307383:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f4ef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.307390:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f4ef lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.307426:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166858.307460:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f4ef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166858.307471:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444540160:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 164us (301us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166858.307471:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f4ef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166858.307489:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 852 00010000:00010000:2.0:1762166858.307499:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f4f6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.307512:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f4d3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c4d expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.307527:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f4f6 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.307555:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f4d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c4d expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.307568:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f4d3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c4d expref: 26 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.307579:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff80000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452004096:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166858.307639:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463e000 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.309191:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff80000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452004096:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166858.309215:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f4f6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166858.309296:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.309345:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444540288 00000100:00100000:1.0:1762166858.309350:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444540288 00010000:00010000:1.0:1762166858.309374:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f4d3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c4d expref: 27 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1762166858.309403:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 853 00000100:00100000:1.0:1762166858.309423:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444540288:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166858.309437:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166858.309443:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f4d3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c4d expref: 27 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1762166858.309454:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f4d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c4d expref: 27 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1762166858.309471:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f4d3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c4d expref: 27 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1762166858.309485:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3d:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:1.0:1762166858.309490:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f4f6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.309505:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f4f6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.309512:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f4f6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.309538:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166858.309584:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444540288:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 172us (287us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166858.309588:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f4f6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166858.309591:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 853 00010000:00010000:2.0:1762166858.309595:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f4f6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166858.309943:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff80000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452004224:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166858.309975:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166858.310001:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3507b6600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.310060:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452004224 00000100:00100000:0.0:1762166858.310065:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452004224 00000100:00100000:0.0:1762166858.310102:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1762166858.310110:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:30821:x1847765452004224:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166858.310180:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:30821:x1847765452004224:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.310187:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1762166858.310212:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff80000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452004224:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166858.310250:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff80000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452004352:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166858.310269:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166858.310301:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463e000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.310343:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452004352 00000100:00100000:0.0:1762166858.310347:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452004352 00000100:00100000:0.0:1762166858.310387:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1762166858.310395:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:30821:x1847765452004352:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166858.310479:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:30821:x1847765452004352:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 85us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.310486:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1762166858.310539:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff80000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452004352:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1762166858.310650:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935063 00000100:00100000:2.0:1762166858.310683:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff80000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452004480:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166858.310700:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166858.310718:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a180 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.310730:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452004480 00000100:00100000:0.0:1762166858.310734:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452004480 00000100:00100000:0.0:1762166858.310758:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1762166858.310788:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:30821:x1847765452004480:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166858.310938:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:30821:x1847765452004480:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 151us (235us total) trans 21474836797 rc 0/0 00000100:00100000:0.0:1762166858.310945:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1762166858.311028:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff80000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452004480:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1762166858.311084:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935064 00010000:00010000:2.0:1762166858.311105:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f4f6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.311112:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f4f6 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.311119:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f4f6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.311124:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.311128:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f4f6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.311135:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f4f6 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.311146:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3d:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166858.311148:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166858.311152:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f4f6 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.311158:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f4f6 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.311186:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f4ef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.311192:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f4ef lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.311197:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f4ef lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.311202:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.311205:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f4ef lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.311211:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f4ef lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.311218:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:2.0:1762166858.311221:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166858.311224:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f4ef lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.311230:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f4ef lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.311240:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:2.0:1762166858.311243:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166858.311249:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f49b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c31 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.311333:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348213850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49350:x1847765444539648:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 6983us (7101us total) trans 8589935065 rc 0/0 00000100:00100000:2.0:1762166858.311341:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 186 00000020:00080000:2.0:1762166858.311354:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166858.312808:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.312845:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444540416 00000100:00100000:2.0:1762166858.312851:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444540416 00000100:00100000:2.0:1762166858.312891:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 442 00000100:00100000:2.0:1762166858.312899:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49350:x1847765444540416:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166858.312916:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.312933:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4fd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c62 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.312972:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4fd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c62 expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.312983:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4fd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c62 expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.312994:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166858.312996:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166858.312998:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3c00, rc 0) 00000100:00100000:2.0:1762166858.313030:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49350:x1847765444540416:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 132us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.313036:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 442 00000100:00100000:1.0:1762166858.314894:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.314956:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444540672 00000100:00100000:2.0:1762166858.314965:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444540672 00000100:00100000:2.0:1762166858.315014:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 188 00000100:00100000:2.0:1762166858.315023:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49350:x1847765444540672:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166858.315199:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49350:x1847765444540672:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 177us (317us total) trans 8589935066 rc 0/0 00000100:00100000:2.0:1762166858.315208:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 188 00000100:00100000:3.0:1762166858.316289:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.316330:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444540928 00000100:00100000:2.0:1762166858.316336:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444540928 00000100:00100000:2.0:1762166858.316378:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 189 00000100:00100000:2.0:1762166858.316386:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49350:x1847765444540928:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762166858.316698:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x3d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1762166858.316850:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f504 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.316866:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f504 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.316877:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f504 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.316886:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f504 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.316892:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f504 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.316898:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f504 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.316922:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166858.316935:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166858.316941:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f504 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.316947:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166858.316951:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f504 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.316964:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f504 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.316973:0:32135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3d:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:0.0:1762166858.316975:0:32135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166858.316978:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f504 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.316982:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f504 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.316996:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166858.316997:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166858.316998:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166858.317015:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49350:x1847765444540928:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 629us (728us total) trans 8589935067 rc 0/0 00000100:00100000:2.0:1762166858.317024:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 189 00000100:00100000:0.0:1762166858.325695:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.325808:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444541056 00000100:00100000:1.0:1762166858.325819:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444541056 00000100:00100000:1.0:1762166858.325877:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 443 00000100:00100000:1.0:1762166858.325886:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49352:x1847765444541056:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:1.0:1762166858.325910:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.325935:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9f50b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c69 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.325996:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f512 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326010:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f512 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326021:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f512 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326034:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f519 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326057:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f519 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326064:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f519 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326170:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f520 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326179:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f520 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326186:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f520 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166858.326215:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166858.326219:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166858.326246:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f520 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326258:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f520 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326266:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f512 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326273:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f512 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326279:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f512 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326286:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166858.326290:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f512 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326304:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f512 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326315:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166858.326319:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166858.326324:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f512 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326330:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f512 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326341:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f519 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326348:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f519 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326353:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f519 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326358:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166858.326361:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f519 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326367:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f519 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326373:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3c00) 00010000:00010000:1.0:1762166858.326376:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166858.326378:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f519 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326383:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f519 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.326432:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26600/0xf915a5bdf3c9f50b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c69 expref: 32 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.326446:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f520 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c69 expref: 31 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.326453:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:1.0:1762166858.326455:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166858.326458:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a27a00, rc 0) 00000100:00100000:1.0:1762166858.326519:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49352:x1847765444541056:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 633us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.326527:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 443 00000100:00100000:1.0:1762166858.342047:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.342119:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444541184 00000100:00100000:2.0:1762166858.342130:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444541184 00000100:00100000:2.0:1762166858.342185:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 444 00000100:00100000:2.0:1762166858.342198:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49356:x1847765444541184:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166858.342285:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f527 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342301:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f527 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342313:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f527 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342328:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f52e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342334:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f52e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342340:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f52e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342456:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f535 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342465:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f535 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342472:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f535 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166858.342501:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166858.342510:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166858.342520:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f535 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342531:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f527 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342546:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f527 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342552:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f527 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342557:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.342560:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f527 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342567:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f527 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342578:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166858.342581:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166858.342586:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f527 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342592:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9f527 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342605:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f52e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342611:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f52e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342616:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f52e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342621:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.342624:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f52e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342640:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f52e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342648:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01300) 00010000:00010000:2.0:1762166858.342651:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166858.342654:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f52e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342659:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f52e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342675:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f535 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342680:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f535 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342685:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f535 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342690:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.342692:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f535 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342698:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f535 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342705:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166858.342707:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166858.342710:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f535 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.342716:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f535 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166858.342837:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49356:x1847765444541184:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 642us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.342846:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 444 00000100:00100000:3.0:1762166858.351860:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.351961:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444541440 00000100:00100000:2.0:1762166858.351971:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444541440 00000100:00100000:2.0:1762166858.352026:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 445 00000100:00100000:2.0:1762166858.352036:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49358:x1847765444541440:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166858.352056:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.352075:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f53c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c70 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.352163:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f543 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.352177:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f543 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.352188:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f543 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166858.352199:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166858.352314:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f53c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c70 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.352331:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f543 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c70 expref: 33 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.352339:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166858.352342:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166858.352358:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3800, rc 0) 00000100:00100000:2.0:1762166858.352427:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49358:x1847765444541440:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 392us (576us total) trans 8589935068 rc 0/0 00000100:00100000:2.0:1762166858.352435:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 445 00000100:00100000:0.0:1762166858.354810:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.354910:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444541696 00000100:00100000:3.0:1762166858.354920:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444541696 00000100:00100000:3.0:1762166858.354981:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 446 00000100:00100000:3.0:1762166858.354993:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49358:x1847765444541696:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.355015:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.355032:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f551 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c77 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.355115:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f558 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.355128:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f520 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c69 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.355137:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f558 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.355169:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f520 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c69 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.355182:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f520 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c69 expref: 34 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166858.355194:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452004608:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166858.355285:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166858.356594:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452004608:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.356595:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166858.356629:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f558 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166858.356661:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444541824 00000100:00100000:0.0:1762166858.356670:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444541824 00010000:00010000:0.0:1762166858.356718:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f520 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c69 expref: 35 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.356754:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 854 00000100:00100000:0.0:1762166858.356805:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444541824:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.356820:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.356829:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f520 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c69 expref: 35 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.356844:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f520 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c69 expref: 35 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.356880:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f520 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c69 expref: 35 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.356896:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:0.0:1762166858.356900:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f558 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.356908:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f558 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.356915:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f558 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.356943:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166858.356979:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f558 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.356987:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f558 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166858.356995:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765444541824:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 230us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.357003:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 854 00000004:00200000:3.0:1762166858.357012:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:3.0:1762166858.357210:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f551 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c77 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.357228:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f558 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c77 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.357235:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:3.0:1762166858.357237:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166858.357239:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382045800, rc 0) 00000100:00100000:3.0:1762166858.357283:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49358:x1847765444541696:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2294us (2481us total) trans 8589935069 rc 0/0 00000100:00100000:3.0:1762166858.357289:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 446 00000100:00100000:1.0:1762166858.358382:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.358463:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444541952 00000100:00100000:2.0:1762166858.358472:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444541952 00000100:00100000:2.0:1762166858.358530:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 190 00000100:00100000:2.0:1762166858.358546:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49358:x1847765444541952:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:2.0:1762166858.358683:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49358:x1847765444541952:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 144us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.358692:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 190 00000100:00100000:1.0:1762166858.359587:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.359667:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444542208 00000100:00100000:2.0:1762166858.359677:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444542208 00000100:00100000:2.0:1762166858.359722:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 191 00000100:00100000:2.0:1762166858.359731:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49358:x1847765444542208:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166858.359989:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49358:x1847765444542208:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 260us (403us total) trans 8589935070 rc 0/0 00000100:00100000:2.0:1762166858.359995:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 191 00000100:00100000:0.0:1762166858.361009:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.361067:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444542464 00000100:00100000:3.0:1762166858.361075:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444542464 00000100:00100000:3.0:1762166858.361114:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 447 00000100:00100000:3.0:1762166858.361122:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49358:x1847765444542464:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.361142:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.361163:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1762166858.361192:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f558 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c77 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.361211:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9f543 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c70 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.361222:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:3.0:1762166858.361228:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166858.361242:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9f566 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c7e expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.361330:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f56d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.361344:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f56d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.361354:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f56d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166858.361366:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:3.0:1762166858.361472:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9f566 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c7e expref: 36 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.361483:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f56d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c7e expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.361488:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:3.0:1762166858.361491:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166858.361492:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382045200, rc 0) 00000100:00100000:3.0:1762166858.361537:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49358:x1847765444542464:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 417us (531us total) trans 8589935071 rc 0/0 00000100:00100000:3.0:1762166858.361542:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 447 00000100:00100000:1.0:1762166858.362545:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.362621:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444542720 00000100:00100000:2.0:1762166858.362631:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444542720 00000100:00100000:2.0:1762166858.362694:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 192 00000100:00100000:2.0:1762166858.362705:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348211850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49358:x1847765444542720:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166858.362808:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f56d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c7e expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.362869:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f57b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.362896:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4fd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c62 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.362904:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f57b lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.362933:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4fd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c62 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.362953:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4fd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c62 expref: 35 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.362972:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452004736:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166858.363048:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.364174:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452004736:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166858.364201:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f57b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166858.364436:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.364489:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444542848 00000100:00100000:0.0:1762166858.364498:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444542848 00010000:00010000:0.0:1762166858.364531:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4fd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c62 expref: 36 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.364580:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 855 00000100:00100000:0.0:1762166858.364592:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765444542848:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.364606:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.364612:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4fd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c62 expref: 36 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.364639:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4fd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c62 expref: 36 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.364656:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9f4fd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c62 expref: 36 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.364673:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:0.0:1762166858.364677:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f57b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.364696:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f57b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.364703:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f57b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.364730:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166858.364808:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f57b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166858.364812:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444542848:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 221us (374us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166858.364823:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f57b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166858.364830:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 855 00010000:00010000:2.0:1762166858.365043:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f57b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.365049:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f57b lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.365056:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f57b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.365060:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.365063:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f57b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.365067:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f57b lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.365073:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166858.365075:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166858.365077:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f57b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.365082:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f57b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.365092:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166858.365094:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166858.365099:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f56d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c7e expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.365200:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348211850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49358:x1847765444542720:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2497us (2656us total) trans 8589935072 rc -22/-22 00000100:00100000:2.0:1762166858.365208:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 192 00000100:00100000:1.0:1762166858.366152:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.366196:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444542976 00000100:00100000:3.0:1762166858.366204:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444542976 00000100:00100000:3.0:1762166858.366260:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 448 00000100:00100000:3.0:1762166858.366273:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49358:x1847765444542976:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.366297:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.366316:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f582 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c85 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.366370:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f582 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c85 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.366383:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f582 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c85 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.366404:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960000) 00010000:00010000:3.0:1762166858.366406:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166858.366422:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382045c00, rc 0) 00000100:00100000:3.0:1762166858.366476:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49358:x1847765444542976:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 206us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.366483:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 448 00000100:00100000:1.0:1762166858.368002:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.368041:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444543232 00000100:00100000:3.0:1762166858.368049:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444543232 00000100:00100000:3.0:1762166858.368092:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 449 00000100:00100000:3.0:1762166858.368102:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49358:x1847765444543232:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.368118:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.368157:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f589 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c8c expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.368756:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f590 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.368803:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f590 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.368813:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f590 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166858.368826:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x3e:0x0]: returning size 0 00010000:00010000:3.0:1762166858.368880:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f589 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c8c expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.368902:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f590 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c8c expref: 37 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.368911:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3e:0x0].0x0 (ffff9ee363960a00) 00010000:00010000:3.0:1762166858.368914:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166858.368917:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382045600, rc 0) 00000100:00100000:3.0:1762166858.368966:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49358:x1847765444543232:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 866us (969us total) trans 8589935073 rc 0/0 00000100:00100000:3.0:1762166858.368974:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 449 00000100:00100000:1.0:1762166858.370737:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.370836:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444543488 00000100:00100000:3.0:1762166858.370847:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444543488 00000100:00100000:3.0:1762166858.370914:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 450 00000100:00100000:3.0:1762166858.370928:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49358:x1847765444543488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.370953:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.370981:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9f59e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c93 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.371061:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f5a5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.371071:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f5a5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.371077:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f5a5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166858.371086:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:3.0:1762166858.371179:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9f59e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c93 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.371191:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f5a5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c93 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.371197:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960000) 00010000:00010000:3.0:1762166858.371199:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166858.371202:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382045800, rc 0) 00000100:00100000:3.0:1762166858.371241:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49358:x1847765444543488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 319us (512us total) trans 8589935074 rc 0/0 00000100:00100000:3.0:1762166858.371245:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 450 00000100:00100000:1.0:1762166858.372402:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.372488:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444543744 00000100:00100000:2.0:1762166858.372503:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444543744 00000100:00100000:2.0:1762166858.372573:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 193 00000100:00100000:2.0:1762166858.372584:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49358:x1847765444543744:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166858.372668:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f5a5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c93 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.372718:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f5b3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.372730:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f582 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c85 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.372738:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f5b3 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.372795:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f582 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c85 expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.372809:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f582 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c85 expref: 39 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.372823:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452004864:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166858.372908:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.374171:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452004864:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166858.374193:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f5b3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166858.374388:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.374473:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444543872 00000100:00100000:0.0:1762166858.374482:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444543872 00010000:00010000:0.0:1762166858.374514:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f582 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c85 expref: 40 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.374545:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 856 00000100:00100000:0.0:1762166858.374553:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2360:x1847765444543872:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.374566:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.374585:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f582 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c85 expref: 40 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.374596:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f582 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c85 expref: 40 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.374614:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f582 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c85 expref: 40 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.374630:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960000) 00010000:00010000:0.0:1762166858.374635:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f5b3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.374643:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f5b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.374651:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f5b3 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.374679:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166858.374734:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444543872:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 181us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.374741:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 856 00010000:00010000:2.0:1762166858.374810:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f5b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.374819:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f5b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.374845:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f5ba lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.374858:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f590 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c8c expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.374867:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f5ba lrc: 4/0,1 mode: --/EX res: [0x200000404:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.374897:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f590 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c8c expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.374909:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f590 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c8c expref: 38 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.374921:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452004992:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166858.374978:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.376279:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452004992:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166858.376304:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f5ba lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166858.376341:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.376448:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444544000 00000100:00100000:0.0:1762166858.376456:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444544000 00010000:00010000:0.0:1762166858.376486:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f590 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c8c expref: 39 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.376523:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 857 00000100:00100000:0.0:1762166858.376535:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444544000:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.376562:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.376570:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f590 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c8c expref: 39 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.376582:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f590 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c8c expref: 39 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.376600:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f590 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c8c expref: 39 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.376615:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3e:0x0].0x0 (ffff9ee363960a00) 00010000:00010000:0.0:1762166858.376619:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f5ba lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.376628:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f5ba lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.376635:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f5ba lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.376663:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166858.376703:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f5ba lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.376712:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f5ba lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166858.376723:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2360:x1847765444544000:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 190us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.376732:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 857 00000100:00100000:2.0:1762166858.377129:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452005120:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166858.377172:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166858.377211:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9af00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.377240:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452005120 00000100:00100000:0.0:1762166858.377245:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452005120 00000100:00100000:0.0:1762166858.377275:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1762166858.377280:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:30821:x1847765452005120:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166858.377355:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:30821:x1847765452005120:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 74us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.377371:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1762166858.377392:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452005120:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1762166858.377444:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935075 00000001:00080000:2.0:1762166858.377507:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935076 00010000:00010000:2.0:1762166858.377528:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f5ba lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.377537:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f5ba lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.377543:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f5ba lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.377549:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.377553:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f5ba lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.377560:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f5ba lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.377569:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3e:0x0].0x0 (ffff9ee363960a00) 00010000:00010000:2.0:1762166858.377572:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166858.377576:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f5ba lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.377582:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f5ba lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.377598:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f5b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.377604:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f5b3 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.377615:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f5b3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.377621:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.377623:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f5b3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.377629:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f5b3 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.377637:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960000) 00010000:00010000:2.0:1762166858.377639:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166858.377642:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f5b3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.377647:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f5b3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.377658:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960000) 00010000:00010000:2.0:1762166858.377661:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166858.377666:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f5a5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c93 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.377739:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49358:x1847765444543744:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 5157us (5340us total) trans 8589935077 rc 0/0 00000100:00100000:2.0:1762166858.377749:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 193 00000020:00080000:2.0:1762166858.377754:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166858.379052:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.379104:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444544128 00000100:00100000:3.0:1762166858.379115:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444544128 00000100:00100000:3.0:1762166858.379172:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 451 00000100:00100000:3.0:1762166858.379184:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49358:x1847765444544128:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.379212:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.379252:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9f5c1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91c9a expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.379319:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9f5c1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c9a expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.379336:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9f5c1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c9a expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.379355:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960e00) 00010000:00010000:3.0:1762166858.379359:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166858.379363:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382044a00, rc 0) 00000100:00100000:3.0:1762166858.379432:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49358:x1847765444544128:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 250us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.379441:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 451 00000100:00100000:1.0:1762166858.380873:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.380936:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444544384 00000100:00100000:2.0:1762166858.380947:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444544384 00000100:00100000:2.0:1762166858.381003:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 194 00000100:00100000:2.0:1762166858.381018:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49358:x1847765444544384:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762166858.381439:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x3e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166858.381541:0:30821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].17, 64 off9472 00000001:00080000:2.0:1762166858.381552:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935078 00010000:00010000:2.0:1762166858.381600:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f5c8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.381615:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f5c8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.381624:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f5c8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.381632:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f5c8 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.381637:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f5c8 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.381643:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f5c8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.381673:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1762166858.381813:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49358:x1847765444544384:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 800us (948us total) trans 8589935079 rc 0/0 00000100:00100000:2.0:1762166858.381822:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 194 00000020:00080000:2.0:1762166858.381827:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762166858.381937:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166858.381944:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f5c8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.381951:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166858.381957:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f5c8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.381966:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f5c8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.381983:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3e:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:3.0:1762166858.381987:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166858.381992:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f5c8 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.381997:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9f5c8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.382032:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166858.382034:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166858.382036:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166858.382997:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.383087:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444544640 00000100:00100000:2.0:1762166858.383093:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444544640 00000100:00100000:2.0:1762166858.383137:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 195 00000100:00100000:2.0:1762166858.383146:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49358:x1847765444544640:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166858.383370:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49358:x1847765444544640:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 224us (376us total) trans 8589935080 rc 0/0 00000100:00100000:2.0:1762166858.383380:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 195 00000100:00100000:1.0:1762166858.392915:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.392997:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444544768 00000100:00100000:3.0:1762166858.393015:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444544768 00000100:00100000:3.0:1762166858.393088:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 452 00000100:00100000:3.0:1762166858.393101:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49360:x1847765444544768:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:3.0:1762166858.393135:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.393166:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f5cf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ca1 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.393251:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f5d6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393268:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f5d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393280:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f5d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393295:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393302:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393309:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393453:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f5e4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393482:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393489:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166858.393530:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:3.0:1762166858.393535:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166858.393556:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393568:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393576:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f5d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393582:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f5d6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393589:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f5d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393594:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166858.393599:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f5d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393607:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f5d6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393619:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:3.0:1762166858.393622:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166858.393627:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f5d6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393638:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f5d6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393657:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393662:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5dd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393667:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393672:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166858.393675:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393681:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393688:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee363960100) 00010000:00010000:3.0:1762166858.393691:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166858.393694:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5dd lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393699:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5dd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.393733:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f5cf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ca1 expref: 45 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.393749:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f5e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ca1 expref: 44 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.393823:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960e00) 00010000:00010000:3.0:1762166858.393826:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166858.393829:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382045c00, rc 0) 00000100:00100000:3.0:1762166858.393920:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49360:x1847765444544768:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 822us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.393928:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 452 00000100:00100000:1.0:1762166858.396293:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.396361:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444544896 00000100:00100000:0.0:1762166858.396372:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444544896 00000100:00100000:0.0:1762166858.396435:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1251 00000100:00100000:0.0:1762166858.396444:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444544896:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166858.396459:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.396473:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f5eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ca8 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.396519:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452005248:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166858.396582:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.397848:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452005248:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166858.397879:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f5eb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ca8 expref: 16 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.397899:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f5eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ca8 expref: 16 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.397910:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198200, rc 0) 00000100:00100000:0.0:1762166858.397957:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444544896:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 1514us (1669us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166858.397965:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1251 00000100:00100000:1.0:1762166858.411040:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.411143:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444545024 00000100:00100000:3.0:1762166858.411158:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444545024 00000100:00100000:3.0:1762166858.411222:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 453 00000100:00100000:3.0:1762166858.411233:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49364:x1847765444545024:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:3.0:1762166858.411302:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f5f2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411317:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f5f2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411328:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f5f2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411340:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411346:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411351:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411465:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f600 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411488:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f600 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411494:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f600 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166858.411528:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:3.0:1762166858.411532:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166858.411544:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f600 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411556:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f5f2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411562:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f5f2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411568:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f5f2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411573:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382044600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166858.411578:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f5f2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411585:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f5f2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411596:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:3.0:1762166858.411599:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166858.411602:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f5f2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411608:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f5f2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411628:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411633:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5f9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411638:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411643:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166858.411646:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411651:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5f9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411659:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee363960100) 00010000:00010000:3.0:1762166858.411662:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166858.411664:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5f9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411670:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f5f9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411685:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f600 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411691:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f600 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411696:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f600 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411708:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee382045800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166858.411711:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f600 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411717:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f600 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411725:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960e00) 00010000:00010000:3.0:1762166858.411727:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166858.411730:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f600 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.411735:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f600 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166858.411866:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49364:x1847765444545024:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 635us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.411874:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 453 00000100:00100000:1.0:1762166858.421995:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.422081:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444545280 00000100:00100000:3.0:1762166858.422095:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444545280 00000100:00100000:3.0:1762166858.422170:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 454 00000100:00100000:3.0:1762166858.422183:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49366:x1847765444545280:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.422211:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.422236:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f607 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91caf expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.422364:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f60e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.422381:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f60e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.422445:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f60e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166858.422460:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:3.0:1762166858.422626:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f607 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91caf expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.422651:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f60e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91caf expref: 46 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.422660:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960e00) 00010000:00010000:3.0:1762166858.422664:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166858.422668:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382045600, rc 0) 00000100:00100000:3.0:1762166858.422745:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49366:x1847765444545280:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 565us (763us total) trans 8589935081 rc 0/0 00000100:00100000:3.0:1762166858.422755:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 454 00000100:00100000:1.0:1762166858.424939:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.425026:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444545408 00000100:00100000:0.0:1762166858.425039:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444545408 00000100:00100000:0.0:1762166858.425095:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1252 00000100:00100000:0.0:1762166858.425119:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444545408:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.425138:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.425156:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f61c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91cb6 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.425209:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452005376:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166858.425298:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.426315:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452005376:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166858.426358:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f61c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cb6 expref: 16 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.426398:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f61c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cb6 expref: 16 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.426424:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198200, rc 0) 00000100:00100000:0.0:1762166858.426483:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444545408:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1367us (1554us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166858.426492:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1252 00000100:00100000:1.0:1762166858.428220:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.428265:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444545664 00000100:00100000:3.0:1762166858.428274:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444545664 00000100:00100000:3.0:1762166858.428333:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 455 00000100:00100000:3.0:1762166858.428344:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49366:x1847765444545664:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.428365:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.428386:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f623 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91cbd expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.428489:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f62a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.428504:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f5e4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ca1 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.428526:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f62a lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.428557:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f5e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ca1 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.428570:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f5e4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ca1 expref: 47 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166858.428583:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452005504:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166858.428648:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166858.429735:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452005504:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166858.429756:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f62a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166858.429968:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.430025:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444545792 00000100:00100000:0.0:1762166858.430039:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444545792 00010000:00010000:0.0:1762166858.430087:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f5e4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ca1 expref: 48 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.430134:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 858 00000100:00100000:0.0:1762166858.430146:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2361:x1847765444545792:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.430165:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.430186:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f5e4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ca1 expref: 48 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.430195:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f5e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ca1 expref: 48 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.430215:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045c00/0xf915a5bdf3c9f5e4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ca1 expref: 48 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.430232:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960e00) 00010000:00010000:0.0:1762166858.430236:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f62a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.430242:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f62a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.430248:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f62a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.430274:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166858.430305:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f62a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.430317:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f62a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166858.430332:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000100:00100000:0.0:1762166858.430342:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:2361:x1847765444545792:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 196us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.430351:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 858 00010000:00010000:3.0:1762166858.430555:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044600/0xf915a5bdf3c9f623 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cbd expref: 48 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.430577:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f62a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cbd expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.430586:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960e00) 00010000:00010000:3.0:1762166858.430599:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166858.430603:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee382045200, rc 0) 00000100:00100000:3.0:1762166858.430653:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49366:x1847765444545664:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2312us (2438us total) trans 8589935082 rc 0/0 00000100:00100000:3.0:1762166858.430662:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 455 00000100:00100000:1.0:1762166858.432136:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.432180:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444546048 00000100:00100000:3.0:1762166858.432189:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444546048 00000100:00100000:3.0:1762166858.432235:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 456 00000100:00100000:3.0:1762166858.432245:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49366:x1847765444546048:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.432267:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.432284:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f638 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91cc4 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.432685:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9f63f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.432700:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9f63f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.432711:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9f63f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166858.432721:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x3f:0x0]: returning size 0 00010000:00010000:3.0:1762166858.432754:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045800/0xf915a5bdf3c9f638 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cc4 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.432808:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9f63f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cc4 expref: 49 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.432818:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3f:0x0].0x0 (ffff9ee363960100) 00010000:00010000:3.0:1762166858.432831:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166858.432835:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216c600, rc 0) 00000100:00100000:3.0:1762166858.432885:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49366:x1847765444546048:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 641us (753us total) trans 8589935083 rc 0/0 00000100:00100000:3.0:1762166858.432893:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 456 00000100:00100000:1.0:1762166858.434292:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.434365:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444546304 00000100:00100000:3.0:1762166858.434383:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444546304 00000100:00100000:3.0:1762166858.434459:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 457 00000100:00100000:3.0:1762166858.434469:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49366:x1847765444546304:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.434495:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.434515:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9f64d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ccb expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.434614:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9f654 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.434629:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9f63f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cc4 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.434639:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9f654 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.434678:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9f63f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cc4 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.434693:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9f63f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cc4 expref: 50 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166858.434708:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452005632:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166858.434834:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166858.436025:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452005632:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.436046:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166858.436051:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9f654 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166858.436097:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444546432 00000100:00100000:0.0:1762166858.436106:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444546432 00010000:00010000:0.0:1762166858.436137:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9f63f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cc4 expref: 51 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.436174:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 859 00000100:00100000:0.0:1762166858.436184:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444546432:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.436212:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.436219:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9f63f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cc4 expref: 51 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.436233:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9f63f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cc4 expref: 51 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.436255:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c600/0xf915a5bdf3c9f63f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cc4 expref: 51 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.436273:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3f:0x0].0x0 (ffff9ee363960100) 00010000:00010000:0.0:1762166858.436277:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9f654 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.436286:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9f654 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.436293:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9f654 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.436318:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166858.436336:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9f654 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.436344:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9f654 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166858.436360:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x3f:0x0]: returning size 0 00000100:00100000:0.0:1762166858.436363:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2361:x1847765444546432:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 180us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.436384:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 859 00000004:00080000:3.0:1762166858.436749:0:30817:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x8c:0x0], index 1: 0 00010000:00010000:3.0:1762166858.436937:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9f654 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.436946:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9f654 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.436953:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9f654 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.436960:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee38216ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166858.436964:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9f654 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.436972:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9f654 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.436982:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3f:0x0].0x0 (ffff9ee363960100) 00010000:00010000:3.0:1762166858.436984:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166858.436987:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9f654 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.436997:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ca00/0xf915a5bdf3c9f654 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.437049:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9f64d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ccb expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.437058:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:3.0:1762166858.437060:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166858.437065:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3c9f64d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ccb expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.437074:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216cc00, rc 0) 00000100:00100000:3.0:1762166858.437111:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49366:x1847765444546304:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2645us (2826us total) trans 8589935084 rc 301/301 00000100:00100000:3.0:1762166858.437116:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 457 00000100:00100000:1.0:1762166858.438081:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.438139:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444546688 00000100:00100000:2.0:1762166858.438148:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444546688 00000100:00100000:2.0:1762166858.438193:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 196 00000100:00100000:2.0:1762166858.438204:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49366:x1847765444546688:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762166858.438489:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49366:x1847765444546688:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 287us (410us total) trans 8589935085 rc 0/0 00000100:00100000:2.0:1762166858.438497:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 196 00000100:00100000:1.0:1762166858.439454:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.439508:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444546816 00000100:00100000:3.0:1762166858.439514:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444546816 00000100:00100000:3.0:1762166858.439551:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 458 00000100:00100000:3.0:1762166858.439560:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49366:x1847765444546816:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.439585:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.439607:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9f662 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91cd2 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.439673:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9f669 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.439688:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f62a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cbd expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.439716:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9f669 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.439755:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f62a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cbd expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.439791:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f62a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cbd expref: 51 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166858.439806:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452005760:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166858.439888:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166858.440872:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452005760:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166858.440891:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9f669 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166858.441485:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.441537:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444546944 00000100:00100000:0.0:1762166858.441548:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444546944 00010000:00010000:0.0:1762166858.441587:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f62a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cbd expref: 52 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.441629:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 860 00000100:00100000:0.0:1762166858.441653:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2361:x1847765444546944:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.441668:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.441675:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f62a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cbd expref: 52 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.441689:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f62a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cbd expref: 52 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.441712:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045200/0xf915a5bdf3c9f62a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cbd expref: 52 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.441731:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960e00) 00010000:00010000:0.0:1762166858.441735:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9f669 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.441745:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9f669 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.441752:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9f669 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.441797:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166858.441825:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9f669 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.441837:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9f669 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166858.441865:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444546944:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 200us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.441874:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 860 00000004:00200000:3.0:1762166858.441886:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:3.0:1762166858.441892:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166858.441911:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9f669 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.441942:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216c400/0xf915a5bdf3c9f662 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cd2 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.441974:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9f669 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cd2 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.442045:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960e00) 00010000:00010000:3.0:1762166858.442048:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166858.442051:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216d400, rc 0) 00000100:00100000:3.0:1762166858.442090:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49366:x1847765444546816:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2532us (2638us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.442097:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 458 00000100:00100000:1.0:1762166858.443357:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.443403:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444547072 00000100:00100000:0.0:1762166858.443410:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444547072 00000100:00100000:0.0:1762166858.443463:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1253 00000100:00100000:0.0:1762166858.443470:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444547072:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.443490:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.443502:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f670 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91cd9 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.443539:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452005888:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166858.443589:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.444963:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452005888:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166858.444994:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f670 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cd9 expref: 16 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.445013:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f670 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cd9 expref: 16 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.445025:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198200, rc 0) 00000100:00100000:0.0:1762166858.445073:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444547072:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1601us (1717us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166858.445081:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1253 00000100:00100000:1.0:1762166858.446506:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.447166:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444547200 00000100:00100000:3.0:1762166858.447178:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444547200 00000100:00100000:3.0:1762166858.447239:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 459 00000100:00100000:3.0:1762166858.447253:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49366:x1847765444547200:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.447271:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.447292:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9f677 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ce0 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.447359:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9f67e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.447373:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9f67e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.447383:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9f67e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166858.447427:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x3f:0x0]: returning size 0 00000004:00200000:3.0:1762166858.447431:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166858.447459:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9f67e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.447483:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d000/0xf915a5bdf3c9f677 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ce0 expref: 52 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.447500:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9f67e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3f:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ce0 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.447508:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3f:0x0].0x0 (ffff9ee363960f00) 00010000:00010000:3.0:1762166858.447511:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762166858.447515:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348229200, rc 0) 00000100:00100000:3.0:1762166858.447568:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49366:x1847765444547200:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 317us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.447575:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 459 00000100:00100000:1.0:1762166858.449241:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.449341:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444547328 00000100:00100000:0.0:1762166858.449353:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444547328 00000100:00100000:0.0:1762166858.449403:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1254 00000100:00100000:0.0:1762166858.449427:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765444547328:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.449442:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.449461:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f685 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ce7 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166858.449485:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166858.449512:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.449514:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.449523:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f685 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ce7 expref: 25 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.449538:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f685 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ce7 expref: 25 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.449550:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199e00, rc 0) 00000100:00100000:0.0:1762166858.449606:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444547328:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 195us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.449613:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1254 00000100:00100000:1.0:1762166858.450956:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.451009:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444547584 00000100:00100000:3.0:1762166858.451016:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444547584 00000100:00100000:3.0:1762166858.451055:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 460 00000100:00100000:3.0:1762166858.451062:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49366:x1847765444547584:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.451076:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.451091:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f68c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91cee expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.451160:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3c9f693 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.451170:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3c9f693 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.451179:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3c9f693 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166858.451202:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:3.0:1762166858.451320:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f68c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cee expref: 54 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.451333:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3c9f693 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cee expref: 53 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.451338:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960e00) 00010000:00010000:3.0:1762166858.451340:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166858.451341:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348229e00, rc 0) 00000100:00100000:3.0:1762166858.451382:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49366:x1847765444547584:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 320us (430us total) trans 8589935086 rc 0/0 00000100:00100000:3.0:1762166858.451388:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 460 00000100:00100000:1.0:1762166858.453026:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.453077:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444547712 00000100:00100000:0.0:1762166858.453085:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444547712 00000100:00100000:0.0:1762166858.453133:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1255 00000100:00100000:0.0:1762166858.453143:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444547712:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.453157:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.453171:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f6a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91cf5 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.453223:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452006016:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166858.453293:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.454270:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452006016:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166858.454296:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f6a1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cf5 expref: 16 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.454333:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f6a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cf5 expref: 16 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.454344:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199c00, rc 0) 00000100:00100000:0.0:1762166858.454388:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444547712:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1245us (1367us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166858.454395:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1255 00000100:00100000:1.0:1762166858.455888:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.455941:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444547840 00000100:00100000:0.0:1762166858.455948:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444547840 00000100:00100000:0.0:1762166858.455996:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1256 00000100:00100000:0.0:1762166858.456004:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765444547840:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.456017:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.456032:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f6a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91cfc expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.456075:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452006144:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166858.456135:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.457429:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452006144:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166858.457463:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f6a8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cfc expref: 16 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.457481:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f6a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cfc expref: 16 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.457511:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198200, rc 0) 00000100:00100000:0.0:1762166858.457560:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765444547840:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1556us (1676us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166858.457568:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1256 00000100:00100000:1.0:1762166858.459258:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.459371:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444547968 00000100:00100000:0.0:1762166858.459384:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444547968 00000100:00100000:0.0:1762166858.459451:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1257 00000100:00100000:0.0:1762166858.459461:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444547968:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762166858.459501:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f6af lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.459518:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f4da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c54 expref: 15 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.459525:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166858.459527:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166858.459530:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f6af lrc: 4/1,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.459559:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f4da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c54 expref: 15 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.459571:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f4da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c54 expref: 15 pid: 26444 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.459585:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452006272:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166858.459669:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.461211:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452006272:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166858.461242:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f6af lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166858.461352:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.461433:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444548096 00000100:00100000:0.0:1762166858.461440:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444548096 00010000:00010000:0.0:1762166858.461467:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f4da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c54 expref: 16 pid: 26444 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.461504:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 861 00000100:00100000:0.0:1762166858.461516:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444548096:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.461529:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.461550:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f4da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c54 expref: 16 pid: 26444 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.461563:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f4da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c54 expref: 16 pid: 26444 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.461591:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f4da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c54 expref: 16 pid: 26444 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.461605:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.461607:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.461611:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f6af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.461636:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f6af lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.461672:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166858.461722:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444548096:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 209us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.461732:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 861 00010000:00010000:2.0:1762166858.461873:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f6af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.461883:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f6af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.461907:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f6af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.461915:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f6af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.461922:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f6af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.461929:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166858.461934:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f6af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.461947:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f6af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.461960:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f6af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.461967:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f6af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.462038:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765444547968:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2578us (2791us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.462048:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1257 00000100:00100000:1.0:1762166858.463898:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.463970:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444548224 00000100:00100000:2.0:1762166858.463982:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444548224 00000100:00100000:2.0:1762166858.464034:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1258 00000100:00100000:2.0:1762166858.464045:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2358:x1847765444548224:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166858.464059:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.464078:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d03 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166858.464099:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x8c:0x0] initial LVB size: 0, mtime: 0x69088847, atime: 0x69088847, ctime: 0x6908884a, blocks: 0x1 00010000:00010000:2.0:1762166858.464116:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.464118:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.464126:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d03 expref: 15 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.464146:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d03 expref: 15 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.464158:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2200, rc 0) 00000100:00100000:2.0:1762166858.464209:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2358:x1847765444548224:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 166us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.464215:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1258 00000100:00100000:1.0:1762166858.490635:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.490750:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444548352 00000100:00100000:3.0:1762166858.490802:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444548352 00000100:00100000:3.0:1762166858.490871:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 461 00000100:00100000:3.0:1762166858.490883:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49366:x1847765444548352:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:1.0:1762166858.508050:0:32137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935062 is committed 00000001:00080000:2.0:1762166858.508054:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935085 is committed 00000020:00080000:1.0:1762166858.508071:0:32137:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969126 batchid updated 00000001:00080000:1.0:1762166858.508095:0:32137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935086 is committed 00000020:00080000:2.0:1762166858.508107:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee24463e000 refcount 2 committed 0 result 0 batchid 4294969127 00000020:00080000:2.0:1762166858.508113:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee241fb7900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee24463ea80 00000020:00080000:2.0:1762166858.508116:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee241fb7200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee244065800 00000020:00080000:0.0:1762166858.508169:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969127 committed batchid 4294969126 00000100:00100000:3.0:1762166858.508180:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49366:x1847765444548352:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 17296us (17556us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.508190:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 461 00000020:00080000:0.0:1762166858.508367:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969126 00000100:00100000:1.0:1762166858.509717:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.509837:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444548480 00000100:00100000:2.0:1762166858.509846:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444548480 00000100:00100000:2.0:1762166858.509896:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1259 00000100:00100000:2.0:1762166858.509907:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444548480:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:2.0:1762166858.510024:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444548480:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 118us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.510032:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1259 00000100:00100000:1.0:1762166858.517332:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.517448:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444548608 00000100:00100000:2.0:1762166858.517458:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444548608 00000100:00100000:2.0:1762166858.517516:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1260 00000100:00100000:2.0:1762166858.517527:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444548608:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166858.517571:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6bd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.517586:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.517588:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.517593:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6bd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.517606:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6bd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.517630:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6bd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.517638:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.517646:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.517652:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166858.517656:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.517665:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.517679:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.517691:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.517816:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444548608:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 291us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.517824:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1260 00000100:00100000:1.0:1762166858.520189:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.520266:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444548864 00000100:00100000:3.0:1762166858.520280:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444548864 00000100:00100000:3.0:1762166858.520338:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 462 00000100:00100000:3.0:1762166858.520348:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49366:x1847765444548864:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166858.520399:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166858.520440:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9f67e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ce0 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.520474:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3f:0x0].0x0 (ffff9ee363960f00) 00010000:00010000:3.0:1762166858.520485:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166858.520516:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f6c4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.520529:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f6c4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.520537:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f6c4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:3.0:1762166858.520705:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006f6eed6c reply state 00000000cc1b4937 transno 8589935087 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f6c4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166858.520713:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166858.520844:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49366:x1847765444548864:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 496us (662us total) trans 8589935087 rc 0/0 00000100:00100000:3.0:1762166858.520852:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 462 00000100:00100000:1.0:1762166858.522508:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166858.522518:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f6c4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.522541:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f6c4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.522551:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f6c4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.522558:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166858.522607:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f6c4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.522615:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f6c4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.522644:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3f:0x0].0x0 (ffff9ee363960100) 00010000:00010000:3.0:1762166858.522647:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166858.522652:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f6c4 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.522657:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f6c4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166858.523747:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444548992 00000100:00100000:0.0:1762166858.523759:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444548992 00000100:00100000:0.0:1762166858.523840:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 463 00000100:00100000:0.0:1762166858.523852:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49366:x1847765444548992:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.523876:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.523895:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f6cb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d0a expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.523964:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f6cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d0a expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.523978:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f6cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d0a expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.523996:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3f:0x0].0x0 (ffff9ee34bdb4700) 00010000:00010000:0.0:1762166858.523999:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166858.524002:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199800, rc 0) 00000100:00100000:0.0:1762166858.524082:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49366:x1847765444548992:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 233us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.524090:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 463 00000100:00100000:1.0:1762166858.525640:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.525701:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444549120 00000100:00100000:2.0:1762166858.525709:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444549120 00000100:00100000:2.0:1762166858.525791:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1261 00000100:00100000:2.0:1762166858.525802:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:49366:x1847765444549120:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166858.525816:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.525834:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d11 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.525862:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f685 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ce7 expref: 26 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.525870:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.525873:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.525877:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6d2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d11 expref: 26 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.525908:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f685 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ce7 expref: 26 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.525917:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f685 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ce7 expref: 26 pid: 26444 timeout: 579 lvb_type: 1 00000100:00100000:2.0:1762166858.525928:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452006400:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166858.526004:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347d2c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.527877:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.527951:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452006400:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166858.527983:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6d2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d11 expref: 26 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.528001:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2600, rc 0) 00000100:00100000:2.0:1762166858.528064:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49366:x1847765444549120:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2264us (2428us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.528077:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1261 00000100:00100000:0.0:1762166858.529496:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444549248 00000100:00100000:0.0:1762166858.529509:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444549248 00010000:00010000:0.0:1762166858.529552:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f685 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ce7 expref: 26 pid: 26444 timeout: 579 lvb_type: 1 00000100:00100000:0.0:1762166858.529601:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 862 00000100:00100000:0.0:1762166858.529610:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444549248:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.529625:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.529649:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f685 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ce7 expref: 26 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:0.0:1762166858.529663:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f685 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ce7 expref: 26 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:0.0:1762166858.529688:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f685 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ce7 expref: 26 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:0.0:1762166858.529702:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.529704:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.529710:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d11 expref: 25 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.529720:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d11 expref: 25 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.529827:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d11 expref: 25 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.529843:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765452006528:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762166858.529922:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.532285:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765452006528:192.168.203.35@tcp:105: 00010000:00010000:0.0:1762166858.532317:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166858.532394:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444549248:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 2784us (4528us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.532421:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 862 00000100:00100000:3.0:1762166858.532509:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.532602:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444549376 00000100:00100000:2.0:1762166858.532612:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444549376 00000100:00100000:2.0:1762166858.532693:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1262 00000100:00100000:2.0:1762166858.532706:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765444549376:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166858.533004:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x8c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166858.533008:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x8c:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:2.0:1762166858.533011:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x8c:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:2.0:1762166858.533013:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8c:0x0] updating lvb ctime from disk: 0 -> 1762166858 00002000:00010000:2.0:1762166858.533015:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x8c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166858.533079:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444549376:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 372us (577us total) trans 17179869468 rc 0/0 00000100:00100000:2.0:1762166858.533087:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1262 00000100:00100000:1.0:1762166858.535199:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.535303:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444549632 00000100:00100000:0.0:1762166858.535312:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444549632 00000100:00100000:0.0:1762166858.535373:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 464 00000100:00100000:0.0:1762166858.535383:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49366:x1847765444549632:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166858.535446:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.535472:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d400/0xf915a5bdf3c9f669 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cd2 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.535492:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960e00) 00010000:00010000:0.0:1762166858.535497:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166858.535534:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f6d9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.535546:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f6d9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.535572:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f6d9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762166858.535690:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000efeef870 reply state 00000000a0e9eb8c transno 8589935088 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f6d9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166858.535699:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166858.535826:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49366:x1847765444549632:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 443us (635us total) trans 8589935088 rc 0/0 00000100:00100000:0.0:1762166858.535833:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 464 00010000:00010000:2.0:1762166858.537978:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f6d9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.537995:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f6d9 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.538004:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f6d9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.538010:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.538016:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f6d9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.538024:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f6d9 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166858.538039:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166858.538045:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960e00) 00010000:00010000:2.0:1762166858.538051:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166858.538054:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f6d9 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.538060:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9f6d9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166858.538295:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444549760 00000100:00100000:0.0:1762166858.538305:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444549760 00000100:00100000:0.0:1762166858.538363:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1263 00000100:00100000:0.0:1762166858.538386:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:49366:x1847765444549760:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.538402:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.538434:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f6e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d18 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.538468:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d03 expref: 16 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.538477:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.538479:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.538483:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f6e0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d18 expref: 16 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.538517:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d03 expref: 16 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.538548:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d03 expref: 16 pid: 26444 timeout: 579 lvb_type: 1 00000100:00100000:0.0:1762166858.538563:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452006656:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166858.538649:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.540243:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.540341:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452006656:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166858.540368:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f6e0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d18 expref: 16 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.540389:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198200, rc 0) 00000100:00100000:2.0:1762166858.540397:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444549888 00000100:00100000:2.0:1762166858.540403:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444549888 00010000:00010000:2.0:1762166858.540441:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d03 expref: 17 pid: 26444 timeout: 579 lvb_type: 1 00000100:00100000:0.0:1762166858.540447:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:49366:x1847765444549760:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2065us (2419us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.540454:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1263 00000100:00100000:2.0:1762166858.540479:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 863 00000100:00100000:2.0:1762166858.540488:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444549888:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.540507:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.540533:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d03 expref: 16 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:2.0:1762166858.540547:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d03 expref: 16 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:2.0:1762166858.540567:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d03 expref: 16 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:2.0:1762166858.540579:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.540581:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.540586:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f6e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d18 expref: 15 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.540596:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f6e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d18 expref: 15 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.540630:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f6e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d18 expref: 15 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.540643:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765452006784:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762166858.540704:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347d2c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.542323:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765452006784:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762166858.542348:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166858.542385:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.542422:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444549888:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1923us (2172us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.542434:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 863 00000100:00100000:0.0:1762166858.542475:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444550016 00000100:00100000:0.0:1762166858.542482:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444550016 00000100:00100000:0.0:1762166858.542537:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1264 00000100:00100000:0.0:1762166858.542548:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765444550016:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166858.542730:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x8c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166858.542734:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x8c:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166858.542736:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x8c:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166858.542739:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x8c:0x0] updating lvb ctime from disk: 1762166858 -> 1762166858 00002000:00010000:0.0:1762166858.542741:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x8c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166858.542808:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444550016:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 262us (437us total) trans 21474836798 rc 0/0 00000100:00100000:0.0:1762166858.542828:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1264 00000100:00100000:1.0:1762166858.544693:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.544877:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444550272 00000100:00100000:2.0:1762166858.544888:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444550272 00000100:00100000:2.0:1762166858.544940:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 197 00000100:00100000:2.0:1762166858.544949:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348211c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49366:x1847765444550272:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762166858.545021:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3c9f693 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cee expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.545069:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f6e7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.545086:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9f5c1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c9a expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.545093:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f60e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91caf expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.545100:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f6e7 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.545130:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f60e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91caf expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.545142:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f60e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91caf expref: 27 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.545156:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452006912:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166858.545235:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9f5c1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c9a expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.545246:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9f5c1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c9a expref: 27 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.545256:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452007040:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166858.545283:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347d2c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.546785:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452006912:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166858.546801:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452007040:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166858.547158:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f6e7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166858.547396:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.547446:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.547494:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444550528 00000100:00100000:2.0:1762166858.547501:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444550528 00010000:00010000:2.0:1762166858.547528:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9f5c1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c9a expref: 28 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.547566:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 864 00000100:00100000:2.0:1762166858.547575:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444550528:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.547588:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.547595:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9f5c1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c9a expref: 28 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.547605:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9f5c1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c9a expref: 28 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.547624:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044a00/0xf915a5bdf3c9f5c1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c9a expref: 28 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.547632:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444550656 00000100:00100000:0.0:1762166858.547638:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444550656 00010000:00010000:2.0:1762166858.547641:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960e00) 00010000:00010000:2.0:1762166858.547647:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f6e7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.547657:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f6e7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.547663:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166858.547683:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 198 00000100:00100000:0.0:1762166858.547693:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:43349:x1847765444550656:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166858.547712:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444550528:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 136us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.547720:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 864 00000100:00100000:0.0:1762166858.547914:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:43349:x1847765444550656:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 221us (517us total) trans 8589935089 rc 0/0 00000100:00100000:0.0:1762166858.547921:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 198 00000100:00100000:1.0:1762166858.549034:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.549081:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444550784 00000100:00100000:2.0:1762166858.549087:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444550784 00010000:00010000:2.0:1762166858.549110:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f60e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91caf expref: 28 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.549142:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 865 00000100:00100000:2.0:1762166858.549155:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444550784:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.549166:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.549172:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f60e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91caf expref: 28 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.549184:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f60e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91caf expref: 28 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.549200:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382045600/0xf915a5bdf3c9f60e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91caf expref: 28 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.549215:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960e00) 00010000:00010000:2.0:1762166858.549219:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f6e7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.549228:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f6e7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.549235:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f6e7 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.549260:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166858.549290:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f6e7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166858.549301:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444550784:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 146us (269us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166858.549302:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f6e7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166858.549316:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 865 00010000:00010000:1.0:1762166858.549331:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f6ee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.549345:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f6cb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d0a expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.549353:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f6ee lrc: 4/0,1 mode: --/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.549384:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f6cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d0a expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.549398:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f6cb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d0a expref: 26 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1762166858.549441:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de00000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452007168:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.549508:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.550511:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de00000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452007168:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166858.550531:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f6ee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166858.550819:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.550852:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444550912 00000100:00100000:2.0:1762166858.550859:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444550912 00010000:00010000:2.0:1762166858.550886:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f6cb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d0a expref: 27 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.550917:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 866 00000100:00100000:2.0:1762166858.550925:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444550912:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.550937:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.550942:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f6cb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d0a expref: 27 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.550953:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f6cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d0a expref: 27 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.550975:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f6cb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d0a expref: 27 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.550987:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3f:0x0].0x0 (ffff9ee34bdb4700) 00010000:00010000:2.0:1762166858.550992:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f6ee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.551000:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f6ee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.551006:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f6ee lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.551025:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166858.551053:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444550912:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 130us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.551059:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 866 00010000:00010000:1.0:1762166858.551073:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f6ee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.551083:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f6ee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166858.551428:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de00700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452007296:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166858.551463:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166858.551491:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.551574:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452007296 00000100:00100000:0.0:1762166858.551578:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452007296 00000100:00100000:0.0:1762166858.551610:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1762166858.551617:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:30821:x1847765452007296:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166858.551701:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:30821:x1847765452007296:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 83us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.551708:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1762166858.551801:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de00700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452007296:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166858.551836:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de00700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452007424:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166858.551859:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166858.551883:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3482d7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.551929:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452007424 00000100:00100000:0.0:1762166858.551933:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452007424 00000100:00100000:0.0:1762166858.551965:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1762166858.551971:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:30821:x1847765452007424:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166858.552042:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:30821:x1847765452007424:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 70us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.552049:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1762166858.552156:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de00700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452007424:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1762166858.552499:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935090 00000100:00100000:1.0:1762166858.552580:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de00700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452007552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166858.553566:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166858.553606:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f48e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.553630:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452007552 00000100:00100000:0.0:1762166858.553641:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452007552 00000100:00100000:0.0:1762166858.553693:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1762166858.553702:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:30821:x1847765452007552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166858.553971:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:30821:x1847765452007552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 270us (408us total) trans 17179869469 rc 0/0 00000100:00100000:0.0:1762166858.553978:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1762166858.554056:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de00700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452007552:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1762166858.554190:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935091 00010000:00010000:1.0:1762166858.554231:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f6ee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.554259:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f6ee lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.554267:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f6ee lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.554273:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a27600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166858.554279:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f6ee lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.554288:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f6ee lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.554307:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3f:0x0].0x0 (ffff9ee34bdb4700) 00010000:00010000:1.0:1762166858.554310:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166858.554314:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f6ee lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.554320:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f6ee lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.554345:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f6e7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.554351:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f6e7 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.554357:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f6e7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.554362:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166858.554365:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f6e7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.554382:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f6e7 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.554390:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960e00) 00010000:00010000:1.0:1762166858.554393:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166858.554396:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f6e7 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.554402:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f6e7 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.554430:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee363960e00) 00010000:00010000:1.0:1762166858.554433:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166858.554440:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3c9f693 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91cee expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166858.554599:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348211c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49366:x1847765444550272:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 9651us (9913us total) trans 8589935092 rc 0/0 00000100:00100000:1.0:1762166858.554608:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 197 00000020:00080000:1.0:1762166858.554613:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166858.556264:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.556409:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444551040 00000100:00100000:2.0:1762166858.556430:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444551040 00000100:00100000:2.0:1762166858.556490:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 465 00000100:00100000:2.0:1762166858.556503:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49366:x1847765444551040:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166858.556531:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.556555:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6f5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d1f expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.556626:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6f5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d1f expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.556642:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6f5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d1f expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.556664:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01f00) 00010000:00010000:2.0:1762166858.556667:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166858.556671:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2200, rc 0) 00000100:00100000:2.0:1762166858.556727:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49366:x1847765444551040:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 227us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.556736:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 465 00000100:00100000:3.0:1762166858.558378:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.558459:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444551296 00000100:00100000:1.0:1762166858.558473:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444551296 00000100:00100000:1.0:1762166858.558558:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 199 00000100:00100000:1.0:1762166858.558570:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49366:x1847765444551296:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166858.558888:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49366:x1847765444551296:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 319us (512us total) trans 8589935093 rc 0/0 00000100:00100000:1.0:1762166858.558897:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 199 00000100:00100000:3.0:1762166858.560618:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.560914:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444551552 00000100:00100000:1.0:1762166858.560944:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444551552 00000100:00100000:1.0:1762166858.561024:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 200 00000100:00100000:1.0:1762166858.561035:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49366:x1847765444551552:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:1.0:1762166858.561356:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x3f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1762166858.561515:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f6fc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.561536:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f6fc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.561549:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f6fc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.561559:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f6fc lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.561566:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f6fc lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.561572:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f6fc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.561606:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166858.561660:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166858.561676:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f6fc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.561688:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a27400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166858.561693:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f6fc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.561703:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f6fc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.561722:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3f:0x0].0x0 (ffff9ee34ada3c00) 00010000:00010000:2.0:1762166858.561725:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166858.561730:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f6fc lrc: 1/0,0 mode: --/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.561736:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f6fc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166858.561743:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49366:x1847765444551552:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 707us (1129us total) trans 8589935094 rc 0/0 00000100:00100000:1.0:1762166858.561802:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 200 00010000:00010000:2.0:1762166858.561826:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166858.561831:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166858.561834:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166858.571585:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.571671:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444551680 00000100:00100000:2.0:1762166858.571681:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444551680 00000100:00100000:2.0:1762166858.571735:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 466 00000100:00100000:2.0:1762166858.571745:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49368:x1847765444551680:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166858.571800:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.571825:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f703 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d26 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.571885:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f70a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.571897:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f70a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.571908:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f70a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.571920:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f711 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.571927:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f711 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.571933:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f711 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572029:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f718 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572037:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f718 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572043:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f718 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166858.572070:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166858.572074:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166858.572089:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f718 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572100:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f718 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572109:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f70a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572115:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f70a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572121:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f70a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572128:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.572132:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f70a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572139:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f70a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572151:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166858.572154:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166858.572158:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f70a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572165:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f70a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572177:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f711 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572182:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f711 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572187:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f711 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572192:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.572194:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f711 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572199:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f711 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572206:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01600) 00010000:00010000:2.0:1762166858.572208:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166858.572211:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f711 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572217:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f711 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.572260:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f703 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d26 expref: 32 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.572272:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f718 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d26 expref: 31 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.572279:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01f00) 00010000:00010000:2.0:1762166858.572281:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166858.572284:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2800, rc 0) 00000100:00100000:2.0:1762166858.572343:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49368:x1847765444551680:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 597us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.572351:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 466 00000100:00100000:3.0:1762166858.587448:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.587531:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444551808 00000100:00100000:2.0:1762166858.587542:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444551808 00000100:00100000:2.0:1762166858.587611:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 467 00000100:00100000:2.0:1762166858.587622:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49372:x1847765444551808:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166858.587693:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f71f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.587710:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f71f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.587721:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f71f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.587736:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f726 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.587743:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f726 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.587749:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f726 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.587904:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f72d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.587913:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f72d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.587920:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f72d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166858.587950:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166858.587955:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166858.587965:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f72d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.587978:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f71f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.587984:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f71f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.587991:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f71f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.587997:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.588000:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f71f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.588007:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f71f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.588019:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166858.588022:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166858.588027:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f71f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.588033:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f71f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.588043:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f726 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.588046:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f726 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.588050:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f726 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.588053:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.588055:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f726 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.588058:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f726 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.588063:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01600) 00010000:00010000:2.0:1762166858.588064:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166858.588066:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f726 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.588068:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f726 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.588079:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f72d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.588082:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f72d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.588086:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f72d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.588088:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.588090:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f72d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.588092:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f72d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.588096:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01f00) 00010000:00010000:2.0:1762166858.588097:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166858.588098:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f72d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.588104:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f72d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166858.588163:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49372:x1847765444551808:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 544us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.588168:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 467 00000100:00100000:3.0:1762166858.598462:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.598571:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444552064 00000100:00100000:2.0:1762166858.598581:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444552064 00000100:00100000:2.0:1762166858.598635:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 468 00000100:00100000:2.0:1762166858.598644:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49374:x1847765444552064:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166858.598663:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.598681:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f734 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d2d expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.598798:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f73b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.598812:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f73b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.598823:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f73b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166858.598834:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166858.598961:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f734 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d2d expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.598979:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f73b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d2d expref: 33 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.598991:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01f00) 00010000:00010000:2.0:1762166858.598994:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166858.598997:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3a00, rc 0) 00000100:00100000:2.0:1762166858.599063:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49374:x1847765444552064:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 419us (610us total) trans 8589935095 rc 0/0 00000100:00100000:2.0:1762166858.599070:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 468 00000100:00100000:3.0:1762166858.601844:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.601923:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444552320 00000100:00100000:2.0:1762166858.601932:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444552320 00000100:00100000:2.0:1762166858.602612:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 469 00000100:00100000:2.0:1762166858.602626:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49374:x1847765444552320:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166858.602650:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.602669:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f749 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d34 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.602755:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f750 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.602799:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f718 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d26 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.602807:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f750 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.602841:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f718 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d26 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.602855:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f718 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d26 expref: 34 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.602874:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765452007680:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166858.602959:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243359780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.604482:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765452007680:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166858.604507:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f750 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166858.604699:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.604866:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444552448 00000100:00100000:2.0:1762166858.604873:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444552448 00010000:00010000:2.0:1762166858.604901:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f718 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d26 expref: 35 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.604937:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 867 00000100:00100000:2.0:1762166858.604947:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444552448:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.604958:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.604963:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f718 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d26 expref: 35 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.604974:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f718 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d26 expref: 35 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.604992:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f718 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d26 expref: 35 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.605007:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01f00) 00010000:00010000:2.0:1762166858.605012:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f750 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.605024:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f750 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.605031:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f750 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.605058:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166858.605104:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765444552448:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 158us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.605111:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 867 00010000:00010000:1.0:1762166858.605252:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f750 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.605268:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f750 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166858.605292:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166858.605517:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f749 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d34 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.605540:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f750 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d34 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.605549:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01f00) 00010000:00010000:1.0:1762166858.605552:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166858.605555:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3e00, rc 0) 00000100:00100000:1.0:1762166858.605643:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49374:x1847765444552320:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3021us (3806us total) trans 8589935096 rc 0/0 00000100:00100000:1.0:1762166858.605652:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 469 00000100:00100000:3.0:1762166858.607178:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.607239:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444552576 00000100:00100000:1.0:1762166858.607251:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444552576 00000100:00100000:1.0:1762166858.607307:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 201 00000100:00100000:1.0:1762166858.607317:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49374:x1847765444552576:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:1.0:1762166858.607465:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49374:x1847765444552576:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 150us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.607473:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 201 00000100:00100000:3.0:1762166858.608548:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.608612:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444552832 00000100:00100000:1.0:1762166858.608621:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444552832 00000100:00100000:1.0:1762166858.608669:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 202 00000100:00100000:1.0:1762166858.608678:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49374:x1847765444552832:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166858.608943:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49374:x1847765444552832:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 266us (400us total) trans 8589935097 rc 0/0 00000100:00100000:1.0:1762166858.608951:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 202 00000100:00100000:0.0:1762166858.610145:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.610231:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444553088 00000100:00100000:1.0:1762166858.610261:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444553088 00000100:00100000:1.0:1762166858.610314:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 470 00000100:00100000:1.0:1762166858.610324:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49374:x1847765444553088:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166858.610345:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.610349:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1762166858.610372:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f750 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d34 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.610392:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f73b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d2d expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.610402:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01f00) 00010000:00010000:1.0:1762166858.610407:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166858.610430:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f75e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d3b expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.610521:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f765 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.610533:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f765 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.610542:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f765 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166858.610553:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166858.610662:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f75e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d3b expref: 36 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.610675:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f765 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d3b expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.610692:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01f00) 00010000:00010000:1.0:1762166858.610695:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166858.610698:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a26000, rc 0) 00000100:00100000:1.0:1762166858.610748:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49374:x1847765444553088:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 426us (608us total) trans 8589935098 rc 0/0 00000100:00100000:1.0:1762166858.610755:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 470 00000100:00100000:3.0:1762166858.612114:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.612166:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444553344 00000100:00100000:1.0:1762166858.612174:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444553344 00000100:00100000:1.0:1762166858.612224:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 203 00000100:00100000:1.0:1762166858.612232:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348212850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49374:x1847765444553344:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166858.612286:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f765 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d3b expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.612315:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f773 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.612326:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6f5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d1f expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.612334:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f773 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.612369:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6f5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d1f expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.612381:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6f5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d1f expref: 35 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1762166858.612420:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452007808:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.612498:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f48e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.613676:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452007808:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166858.613712:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f773 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166858.613856:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.613912:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444553472 00000100:00100000:2.0:1762166858.613921:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444553472 00010000:00010000:2.0:1762166858.613957:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6f5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d1f expref: 36 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.613998:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 868 00000100:00100000:2.0:1762166858.614008:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765444553472:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.614022:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.614029:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6f5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d1f expref: 36 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.614042:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6f5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d1f expref: 36 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.614060:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f6f5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d1f expref: 36 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.614077:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01f00) 00010000:00010000:2.0:1762166858.614082:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f773 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.614091:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f773 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.614098:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f773 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.614126:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166858.614177:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444553472:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 171us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.614185:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 868 00010000:00010000:1.0:1762166858.614292:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f773 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.614302:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f773 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.614633:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f773 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.614642:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f773 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.614649:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f773 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.614655:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a27a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166858.614661:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f773 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.614669:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f773 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.614684:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01f00) 00010000:00010000:1.0:1762166858.614688:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166858.614710:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f773 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.614717:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f773 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.614731:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01f00) 00010000:00010000:1.0:1762166858.614733:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166858.614740:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f765 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d3b expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166858.614987:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348212850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49374:x1847765444553344:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2753us (2876us total) trans 8589935099 rc -22/-22 00000100:00100000:1.0:1762166858.614999:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 203 00000100:00100000:3.0:1762166858.616315:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.616502:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444553600 00000100:00100000:1.0:1762166858.616513:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444553600 00000100:00100000:1.0:1762166858.616572:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 471 00000100:00100000:1.0:1762166858.616587:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49374:x1847765444553600:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166858.616613:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.616637:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f77a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d42 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.616698:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f77a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d42 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.616712:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f77a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d42 expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.616731:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3e00) 00010000:00010000:1.0:1762166858.616734:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166858.616746:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a27800, rc 0) 00000100:00100000:1.0:1762166858.616824:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49374:x1847765444553600:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 241us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.616831:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 471 00000100:00100000:3.0:1762166858.618574:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.618640:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444553856 00000100:00100000:1.0:1762166858.618650:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444553856 00000100:00100000:1.0:1762166858.618709:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 472 00000100:00100000:1.0:1762166858.618720:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49374:x1847765444553856:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166858.618742:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.618790:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f781 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d49 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.619323:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f788 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.619337:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f788 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.619348:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f788 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166858.619358:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x40:0x0]: returning size 0 00010000:00010000:1.0:1762166858.619401:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f781 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d49 expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.619436:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f788 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d49 expref: 37 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.619444:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:1.0:1762166858.619447:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166858.619464:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a27200, rc 0) 00000100:00100000:1.0:1762166858.619527:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49374:x1847765444553856:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 809us (959us total) trans 8589935100 rc 0/0 00000100:00100000:1.0:1762166858.619534:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 472 00000100:00100000:0.0:1762166858.621449:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.621507:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444554112 00000100:00100000:1.0:1762166858.621518:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444554112 00000100:00100000:1.0:1762166858.621571:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 473 00000100:00100000:1.0:1762166858.621581:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49374:x1847765444554112:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166858.621602:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.621619:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27e00/0xf915a5bdf3c9f796 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d50 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.621690:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f79d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.621702:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f79d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.621711:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f79d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166858.621721:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166858.621873:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27e00/0xf915a5bdf3c9f796 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d50 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.621888:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f79d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d50 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.621895:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3e00) 00010000:00010000:1.0:1762166858.621898:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166858.621914:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a27c00, rc 0) 00000100:00100000:1.0:1762166858.621970:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49374:x1847765444554112:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 391us (535us total) trans 8589935101 rc 0/0 00000100:00100000:1.0:1762166858.621976:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 473 00000100:00100000:3.0:1762166858.623259:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.623358:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444554368 00000100:00100000:1.0:1762166858.623372:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444554368 00000100:00100000:1.0:1762166858.623464:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 204 00000100:00100000:1.0:1762166858.623476:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49374:x1847765444554368:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166858.623580:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f79d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d50 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.623624:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f7ab lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.623639:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f77a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d42 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.623648:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f7ab lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.623693:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f77a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d42 expref: 39 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.623710:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f77a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d42 expref: 39 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1762166858.623731:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452007936:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.623920:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee346998480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.625578:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452007936:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166858.625648:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f7ab lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166858.625817:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.625886:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444554496 00000100:00100000:2.0:1762166858.625896:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444554496 00010000:00010000:2.0:1762166858.625937:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f77a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d42 expref: 40 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.625983:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 869 00000100:00100000:2.0:1762166858.625994:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2360:x1847765444554496:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.626010:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.626018:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f77a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d42 expref: 40 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.626033:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f77a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d42 expref: 40 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.626058:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f77a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d42 expref: 40 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.626083:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3e00) 00010000:00010000:2.0:1762166858.626088:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f7ab lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.626098:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f7ab lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.626106:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f7ab lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.626133:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166858.626180:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444554496:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 189us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.626189:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 869 00010000:00010000:1.0:1762166858.626283:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f7ab lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.626295:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f7ab lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.626326:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f7b2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.626341:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f788 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d49 expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.626350:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f7b2 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.626403:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f788 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d49 expref: 38 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.626431:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f788 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d49 expref: 38 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1762166858.626448:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452008064:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.626571:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee346998480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166858.628538:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.628547:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452008064:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166858.628582:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f7b2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166858.628605:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444554624 00000100:00100000:2.0:1762166858.628615:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444554624 00010000:00010000:2.0:1762166858.628655:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f788 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d49 expref: 39 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.628695:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 870 00000100:00100000:2.0:1762166858.628703:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444554624:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.628716:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.628722:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f788 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d49 expref: 39 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.628736:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f788 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d49 expref: 39 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.628759:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f788 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d49 expref: 39 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.628798:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:2.0:1762166858.628804:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f7b2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.628814:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f7b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.628821:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f7b2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.628859:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166858.628899:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f7b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x40:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.628910:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f7b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x40:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166858.628912:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2360:x1847765444554624:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 208us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.628926:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 870 00000100:00100000:0.0:1762166858.629316:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452008192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166858.629357:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166858.629390:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.629442:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452008192 00000100:00100000:2.0:1762166858.629447:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452008192 00000100:00100000:2.0:1762166858.629482:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1762166858.629490:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:30821:x1847765452008192:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166858.629565:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:30821:x1847765452008192:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 76us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.629572:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1762166858.629742:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452008192:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1762166858.629807:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935102 00000001:00080000:0.0:1762166858.629853:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935103 00010000:00010000:0.0:1762166858.629876:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f7b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x40:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.629883:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f7b2 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x40:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.629890:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f7b2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x40:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.629896:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166858.629901:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f7b2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x40:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.629924:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f7b2 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x40:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.629934:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:0.0:1762166858.629937:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166858.629941:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f7b2 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x40:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.629947:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f7b2 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x40:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.629966:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f7ab lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.629971:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f7ab lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.629976:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f7ab lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.629979:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a27a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166858.629982:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f7ab lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.629987:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f7ab lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.629992:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3e00) 00010000:00010000:0.0:1762166858.629994:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166858.629997:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f7ab lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.630001:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f7ab lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.630028:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3e00) 00010000:00010000:0.0:1762166858.630031:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166858.630039:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f79d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d50 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.630115:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49374:x1847765444554368:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 6641us (6860us total) trans 8589935104 rc 0/0 00000100:00100000:0.0:1762166858.630123:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 204 00000020:00080000:0.0:1762166858.630127:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166858.631230:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.631314:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444554752 00000100:00100000:1.0:1762166858.631340:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444554752 00000100:00100000:1.0:1762166858.631422:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 474 00000100:00100000:1.0:1762166858.631434:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49374:x1847765444554752:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166858.631470:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.631497:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27e00/0xf915a5bdf3c9f7b9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d57 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.631568:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27e00/0xf915a5bdf3c9f7b9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d57 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.631586:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27e00/0xf915a5bdf3c9f7b9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d57 expref: 40 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.631612:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:1.0:1762166858.631616:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166858.631620:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a27e00, rc 0) 00000100:00100000:1.0:1762166858.631694:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49374:x1847765444554752:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 263us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.631702:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 474 00000100:00100000:3.0:1762166858.633238:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.633300:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444555008 00000100:00100000:0.0:1762166858.633307:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444555008 00000100:00100000:0.0:1762166858.633355:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 205 00000100:00100000:0.0:1762166858.633364:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49374:x1847765444555008:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:0.0:1762166858.633947:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x40:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1762166858.634084:0:30821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].19, 64 off9600 00000001:00080000:0.0:1762166858.634095:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935105 00010000:00010000:0.0:1762166858.634143:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f7c0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.634158:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f7c0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.634169:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f7c0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.634178:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f7c0 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.634184:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f7c0 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.634202:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f7c0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.634225:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166858.634253:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166858.634262:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f7c0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.634271:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166858.634276:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f7c0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.634286:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f7c0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.634300:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40:0x0].0x0 (ffff9ee34bdb4200) 00010000:00010000:3.0:1762166858.634303:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166858.634308:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f7c0 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.634315:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9f7c0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.634333:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166858.634335:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166858.634337:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166858.634349:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49374:x1847765444555008:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 984us (1114us total) trans 8589935106 rc 0/0 00000100:00100000:0.0:1762166858.634357:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 205 00000020:00080000:0.0:1762166858.634362:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166858.635675:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.635800:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444555264 00000100:00100000:0.0:1762166858.635810:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444555264 00000100:00100000:0.0:1762166858.635864:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 206 00000100:00100000:0.0:1762166858.635874:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49374:x1847765444555264:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166858.636164:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49374:x1847765444555264:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 290us (497us total) trans 8589935107 rc 0/0 00000100:00100000:0.0:1762166858.636171:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 206 00000100:00100000:1.0:1762166858.645846:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.646022:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444555392 00000100:00100000:2.0:1762166858.646036:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444555392 00000100:00100000:2.0:1762166858.646096:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 475 00000100:00100000:2.0:1762166858.646107:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49376:x1847765444555392:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166858.646130:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.646149:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f7c7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d5e expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.646211:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7ce lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646224:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7ce lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646235:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7ce lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646247:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7d5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646254:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646260:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646356:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f7dc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646364:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f7dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646371:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f7dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166858.646400:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166858.646404:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166858.646433:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f7dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646444:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f7dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646452:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7ce lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646458:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7ce lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646465:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7ce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646471:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.646475:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7ce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646483:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7ce lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646493:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166858.646496:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166858.646501:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7ce lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646506:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7ce lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646527:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646534:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7d5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646540:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646545:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.646548:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646554:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7d5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646562:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01600) 00010000:00010000:2.0:1762166858.646570:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166858.646573:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7d5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646579:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7d5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.646609:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f7c7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d5e expref: 45 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.646621:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f7dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d5e expref: 44 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.646629:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:2.0:1762166858.646631:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166858.646634:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3a00, rc 0) 00000100:00100000:2.0:1762166858.646705:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49376:x1847765444555392:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 600us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.646713:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 475 00000100:00100000:3.0:1762166858.648868:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.648963:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444555520 00000100:00100000:0.0:1762166858.648970:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444555520 00000100:00100000:0.0:1762166858.649012:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1265 00000100:00100000:0.0:1762166858.649020:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444555520:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166858.649037:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.649054:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f7e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d65 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.649108:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452008320:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166858.649186:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.650523:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452008320:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166858.650569:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f7e3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d65 expref: 27 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.650591:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f7e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d65 expref: 27 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.650604:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198a00, rc 0) 00000100:00100000:0.0:1762166858.650652:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444555520:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 1632us (1790us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166858.650660:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1265 00000100:00100000:1.0:1762166858.664218:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.664289:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444555648 00000100:00100000:2.0:1762166858.664300:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444555648 00000100:00100000:2.0:1762166858.664360:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 476 00000100:00100000:2.0:1762166858.664370:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49380:x1847765444555648:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166858.664454:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f7ea lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664471:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f7ea lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664482:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f7ea lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664496:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7f1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664503:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664511:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664627:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7f8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664636:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664643:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166858.664674:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166858.664678:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166858.664689:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664705:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f7ea lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664713:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f7ea lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664719:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f7ea lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664725:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.664729:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f7ea lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664735:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f7ea lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664746:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166858.664749:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166858.664753:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f7ea lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664759:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f7ea lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664804:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664810:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7f1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664815:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7f1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664820:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.664823:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7f1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664831:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7f1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664838:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01600) 00010000:00010000:2.0:1762166858.664841:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166858.664844:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7f1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664849:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f7f1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664864:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664870:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7f8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664875:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7f8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664880:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.664883:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7f8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664888:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7f8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664894:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:2.0:1762166858.664897:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166858.664899:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7f8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.664904:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7f8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166858.664975:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49380:x1847765444555648:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 606us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.664983:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 476 00000100:00100000:3.0:1762166858.675595:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.675668:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444555904 00000100:00100000:2.0:1762166858.675679:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444555904 00000100:00100000:2.0:1762166858.675739:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 477 00000100:00100000:2.0:1762166858.675749:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49382:x1847765444555904:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166858.675804:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.675824:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7ff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d6c expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.675925:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f806 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.675938:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f806 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.675950:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f806 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166858.675961:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166858.676082:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f7ff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d6c expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.676101:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f806 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d6c expref: 46 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.676115:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:2.0:1762166858.676118:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166858.676122:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2000, rc 0) 00000100:00100000:2.0:1762166858.676178:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49382:x1847765444555904:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 431us (591us total) trans 8589935108 rc 0/0 00000100:00100000:2.0:1762166858.676186:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 477 00000100:00100000:3.0:1762166858.678009:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.678072:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444556032 00000100:00100000:0.0:1762166858.678081:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444556032 00000100:00100000:0.0:1762166858.678126:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1266 00000100:00100000:0.0:1762166858.678135:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444556032:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.678150:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.678166:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f814 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d73 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.678213:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452008448:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166858.678280:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.679455:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452008448:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166858.679491:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f814 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d73 expref: 27 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.679512:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f814 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d73 expref: 27 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.679537:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198a00, rc 0) 00000100:00100000:0.0:1762166858.679588:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444556032:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1454us (1585us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166858.679596:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1266 00000100:00100000:3.0:1762166858.682233:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.682335:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444556288 00000100:00100000:2.0:1762166858.682344:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444556288 00000100:00100000:2.0:1762166858.682435:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 478 00000100:00100000:2.0:1762166858.682446:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49382:x1847765444556288:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166858.682480:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.682505:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f81b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d7a expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.682598:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f822 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.682614:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f7dc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d5e expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.682621:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f822 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.682654:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f7dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d5e expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.682667:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f7dc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d5e expref: 47 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.682695:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765452008576:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166858.682800:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.684042:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765452008576:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166858.684077:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f822 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166858.684585:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.684645:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444556416 00000100:00100000:2.0:1762166858.684652:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444556416 00010000:00010000:2.0:1762166858.684682:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f7dc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d5e expref: 48 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.684715:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 871 00000100:00100000:2.0:1762166858.684724:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2360:x1847765444556416:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.684738:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.684745:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f7dc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d5e expref: 48 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.684756:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f7dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d5e expref: 48 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.684795:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f7dc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d5e expref: 48 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.684811:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:2.0:1762166858.684816:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f822 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.684823:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f822 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.684831:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f822 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.684870:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166858.684909:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f822 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.684919:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f822 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762166858.684920:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:2360:x1847765444556416:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 196us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.684936:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 871 00000004:00200000:1.0:1762166858.684944:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166858.685074:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9f81b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d7a expref: 48 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.685100:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f822 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d7a expref: 47 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.685105:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:1.0:1762166858.685107:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166858.685109:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2200, rc 0) 00000100:00100000:1.0:1762166858.685139:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49382:x1847765444556288:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2697us (2915us total) trans 8589935109 rc 0/0 00000100:00100000:1.0:1762166858.685143:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 478 00000100:00100000:3.0:1762166858.686823:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.686882:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444556672 00000100:00100000:1.0:1762166858.686899:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444556672 00000100:00100000:1.0:1762166858.686971:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 479 00000100:00100000:1.0:1762166858.686982:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49382:x1847765444556672:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166858.687007:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.687028:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9f830 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d81 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.687664:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26e00/0xf915a5bdf3c9f837 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.687681:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26e00/0xf915a5bdf3c9f837 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.687692:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26e00/0xf915a5bdf3c9f837 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166858.687706:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x41:0x0]: returning size 0 00010000:00010000:1.0:1762166858.687754:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9f830 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d81 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.687816:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26e00/0xf915a5bdf3c9f837 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d81 expref: 49 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.687826:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x41:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166858.687830:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166858.687834:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a26e00, rc 0) 00000100:00100000:1.0:1762166858.687918:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49382:x1847765444556672:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 938us (1102us total) trans 8589935110 rc 0/0 00000100:00100000:1.0:1762166858.687926:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 479 00000100:00100000:3.0:1762166858.689688:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.689745:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444556928 00000100:00100000:1.0:1762166858.689756:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444556928 00000100:00100000:1.0:1762166858.689845:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 480 00000100:00100000:1.0:1762166858.689858:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49382:x1847765444556928:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166858.689886:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.689903:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f845 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d88 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.689986:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f84c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.690001:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26e00/0xf915a5bdf3c9f837 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d81 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.690009:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f84c lrc: 4/0,1 mode: --/EX res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.690062:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26e00/0xf915a5bdf3c9f837 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d81 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.690092:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26e00/0xf915a5bdf3c9f837 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d81 expref: 50 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1762166858.690108:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765452008704:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.690198:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485c00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.691790:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765452008704:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166858.691809:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762166858.691832:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f84c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166858.691964:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444557056 00000100:00100000:0.0:1762166858.691973:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444557056 00010000:00010000:0.0:1762166858.692010:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26e00/0xf915a5bdf3c9f837 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d81 expref: 51 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.692055:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 872 00000100:00100000:0.0:1762166858.692066:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444557056:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.692082:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.692089:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26e00/0xf915a5bdf3c9f837 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d81 expref: 51 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.692102:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26e00/0xf915a5bdf3c9f837 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d81 expref: 51 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.692125:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26e00/0xf915a5bdf3c9f837 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d81 expref: 51 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.692144:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x41:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:0.0:1762166858.692149:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f84c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166858.692159:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f84c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166858.692177:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f84c lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166858.692208:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166858.692259:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2361:x1847765444557056:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 194us (462us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166858.692266:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f84c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166858.692271:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 872 00010000:00010000:1.0:1762166858.692280:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f84c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166858.692297:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x41:0x0]: returning size 0 00000004:00080000:1.0:1762166858.692670:0:30818:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x8d:0x0], index 0: 0 00010000:00010000:1.0:1762166858.692880:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f84c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.692889:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f84c lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.692896:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f84c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.692902:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166858.692907:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f84c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.692925:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f84c lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.692937:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x41:0x0].0x0 (ffff9ee34ada3300) 00010000:00010000:1.0:1762166858.692940:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166858.692944:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f84c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.692949:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f84c lrc: 0/0,0 mode: --/EX res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.693010:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f845 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d88 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.693019:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166858.693022:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166858.693026:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f845 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d88 expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.693035:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a27000, rc 0) 00000100:00100000:1.0:1762166858.693083:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49382:x1847765444556928:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3228us (3402us total) trans 8589935111 rc 301/301 00000100:00100000:1.0:1762166858.693092:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 480 00000100:00100000:3.0:1762166858.694303:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.694388:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444557312 00000100:00100000:0.0:1762166858.694397:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444557312 00000100:00100000:0.0:1762166858.694455:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 207 00000100:00100000:0.0:1762166858.694465:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49382:x1847765444557312:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166858.694793:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49382:x1847765444557312:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 329us (497us total) trans 8589935112 rc 0/0 00000100:00100000:0.0:1762166858.694802:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 207 00000100:00100000:3.0:1762166858.695754:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.695844:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444557440 00000100:00100000:1.0:1762166858.695855:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444557440 00000100:00100000:1.0:1762166858.695919:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 481 00000100:00100000:1.0:1762166858.695930:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49382:x1847765444557440:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166858.695955:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.695992:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f85a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d8f expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.696092:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f861 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.696109:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f822 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d7a expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.696117:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f861 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.696157:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f822 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d7a expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.696171:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f822 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d7a expref: 51 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1762166858.696188:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765452008832:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.696281:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee346998480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.697303:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765452008832:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166858.697335:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f861 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166858.697432:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.697506:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444557568 00000100:00100000:0.0:1762166858.697514:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444557568 00010000:00010000:0.0:1762166858.697550:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f822 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d7a expref: 52 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.697586:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 873 00000100:00100000:0.0:1762166858.697596:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2361:x1847765444557568:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.697609:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.697617:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f822 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d7a expref: 52 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.697629:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f822 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d7a expref: 52 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.697671:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9f822 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d7a expref: 52 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.697686:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:0.0:1762166858.697690:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f861 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166858.697698:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f861 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166858.697706:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f861 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166858.697741:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166858.697758:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f861 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.697813:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f861 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166858.697814:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444557568:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 219us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.697835:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 873 00000004:00200000:1.0:1762166858.697859:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166858.697880:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166858.697907:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f861 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.697939:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f85a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d8f expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.697955:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f861 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d8f expref: 50 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.697962:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:1.0:1762166858.697965:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166858.697968:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a27a00, rc 0) 00000100:00100000:1.0:1762166858.697999:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49382:x1847765444557440:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2073us (2248us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.698005:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 481 00000100:00100000:3.0:1762166858.699041:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.699081:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444557696 00000100:00100000:0.0:1762166858.699087:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444557696 00000100:00100000:0.0:1762166858.699118:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1267 00000100:00100000:0.0:1762166858.699124:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444557696:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.699135:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.699146:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f868 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d96 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.699184:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452008960:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166858.699235:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.700105:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452008960:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166858.700141:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f868 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d96 expref: 27 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.700157:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f868 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d96 expref: 27 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.700169:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198a00, rc 0) 00000100:00100000:0.0:1762166858.700211:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444557696:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1086us (1172us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166858.700218:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1267 00000100:00100000:3.0:1762166858.701352:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.701404:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444557824 00000100:00100000:1.0:1762166858.701419:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444557824 00000100:00100000:1.0:1762166858.701464:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 482 00000100:00100000:1.0:1762166858.701473:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49382:x1847765444557824:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166858.701488:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.701507:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9f86f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91d9d expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.701567:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f876 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.701578:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f876 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x41:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.701589:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f876 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x41:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166858.701628:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x41:0x0]: returning size 0 00000004:00200000:1.0:1762166858.701632:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166858.701646:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f876 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x41:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.701667:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9f86f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d9d expref: 52 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.701678:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f876 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x41:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d9d expref: 51 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.701684:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x41:0x0].0x0 (ffff9ee34ada3900) 00010000:00010000:1.0:1762166858.701687:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1762166858.701690:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a26000, rc 0) 00000100:00100000:1.0:1762166858.701739:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49382:x1847765444557824:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 267us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.701746:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 482 00000100:00100000:3.0:1762166858.703233:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.703316:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444557952 00000100:00100000:2.0:1762166858.703324:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444557952 00000100:00100000:2.0:1762166858.703371:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1268 00000100:00100000:2.0:1762166858.703380:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765444557952:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166858.703393:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.703421:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f87d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91da4 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166858.703444:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166858.703460:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.703462:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.703470:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f87d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91da4 expref: 17 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.703485:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f87d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91da4 expref: 17 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.703497:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3a00, rc 0) 00000100:00100000:2.0:1762166858.703547:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765444557952:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 169us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.703554:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1268 00000100:00100000:3.0:1762166858.705315:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.705380:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444558208 00000100:00100000:1.0:1762166858.705396:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444558208 00000100:00100000:1.0:1762166858.705499:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 483 00000100:00100000:1.0:1762166858.705511:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49382:x1847765444558208:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166858.705534:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.705557:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f884 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91dab expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.705671:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f88b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.705709:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f88b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.705723:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f88b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166858.705738:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1762166858.705935:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f884 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dab expref: 54 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.705953:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f88b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dab expref: 53 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.705963:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:1.0:1762166858.705966:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166858.705970:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a26200, rc 0) 00000100:00100000:1.0:1762166858.706046:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49382:x1847765444558208:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 537us (735us total) trans 8589935113 rc 0/0 00000100:00100000:1.0:1762166858.706055:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 483 00000100:00100000:3.0:1762166858.707426:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.707509:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444558336 00000100:00100000:2.0:1762166858.707519:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444558336 00000100:00100000:2.0:1762166858.707573:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1269 00000100:00100000:2.0:1762166858.707582:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444558336:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166858.707599:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.707620:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f899 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91db2 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.707670:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452009088:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166858.707744:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.708822:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452009088:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166858.708852:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f899 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91db2 expref: 27 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.708871:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9f899 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91db2 expref: 27 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.708883:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3e00, rc 0) 00000100:00100000:2.0:1762166858.708922:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444558336:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1341us (1511us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166858.708930:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1269 00000100:00100000:3.0:1762166858.710165:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.710235:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444558464 00000100:00100000:2.0:1762166858.710241:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444558464 00000100:00100000:2.0:1762166858.710279:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1270 00000100:00100000:2.0:1762166858.710286:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444558464:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166858.710299:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.710311:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f8a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91db9 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.710351:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452009216:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166858.710407:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.711297:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452009216:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166858.711421:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f8a0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91db9 expref: 27 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.711439:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9f8a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91db9 expref: 27 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.711450:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2400, rc 0) 00000100:00100000:2.0:1762166858.711492:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444558464:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1206us (1330us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166858.711500:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1270 00000100:00100000:3.0:1762166858.712572:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.712679:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444558592 00000100:00100000:2.0:1762166858.712685:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444558592 00000100:00100000:2.0:1762166858.712721:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1271 00000100:00100000:2.0:1762166858.712729:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444558592:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166858.712792:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f8a7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.712808:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d11 expref: 26 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.712817:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166858.712819:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166858.712822:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f8a7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.712847:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d11 expref: 26 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.712859:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d11 expref: 26 pid: 26444 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.712871:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452009344:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166858.713038:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.714095:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452009344:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166858.714113:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f8a7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166858.714302:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.714343:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444558720 00000100:00100000:0.0:1762166858.714350:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444558720 00010000:00010000:0.0:1762166858.714375:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d11 expref: 27 pid: 26444 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.714423:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 874 00000100:00100000:0.0:1762166858.714432:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444558720:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.714443:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.714461:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d11 expref: 27 pid: 26444 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.714472:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d11 expref: 27 pid: 26444 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.714492:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9f6d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d11 expref: 27 pid: 26444 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.714521:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.714523:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.714527:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f8a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.714536:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f8a7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.714565:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166858.714607:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f8a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.714607:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444558720:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 172us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.714636:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 874 00010000:00010000:1.0:1762166858.714646:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f8a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.714686:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f8a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.714716:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f8a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.714724:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f8a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.714731:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166858.714736:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f8a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.714746:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f8a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.714799:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f8a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.714809:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9f8a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166858.714921:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765444558592:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2188us (2347us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.714931:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1271 00000100:00100000:3.0:1762166858.716525:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.716714:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444558848 00000100:00100000:1.0:1762166858.716724:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444558848 00000100:00100000:1.0:1762166858.716817:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1272 00000100:00100000:1.0:1762166858.716826:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2359:x1847765444558848:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166858.716853:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.716873:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9f8ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91dc0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166858.716894:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x8c:0x0] initial LVB size: 0, mtime: 0x69088847, atime: 0x69088847, ctime: 0x6908884a, blocks: 0x1 00010000:00010000:1.0:1762166858.716910:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166858.716912:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166858.716919:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9f8ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dc0 expref: 26 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166858.716934:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9f8ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dc0 expref: 26 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166858.716944:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a26400, rc 0) 00000100:00100000:1.0:1762166858.716995:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765444558848:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 170us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.717001:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1272 00000100:00100000:3.0:1762166858.741282:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.741626:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444558976 00000100:00100000:1.0:1762166858.741636:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444558976 00000100:00100000:1.0:1762166858.741697:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 484 00000100:00100000:1.0:1762166858.741708:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49382:x1847765444558976:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:2.0:1762166858.752812:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935112 is committed 00000001:00080000:3.0:1762166858.752825:0:32137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935113 is committed 00000020:00080000:2.0:1762166858.752865:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969127 batchid updated 00000020:00080000:3.0:1762166858.752870:0:32137:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee3507b6600 refcount 2 committed 0 result 0 batchid 4294969128 00000020:00080000:3.0:1762166858.752875:0:32137:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee3436b7200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee24463ecc0 00000020:00080000:3.0:1762166858.752879:0:32137:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee3436b7800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee24558f800 00000020:00080000:0.0:1762166858.752909:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969128 committed batchid 4294969127 00000100:00100000:1.0:1762166858.753030:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49382:x1847765444558976:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 11301us (11734us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.753049:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 484 00000020:00080000:0.0:1762166858.753142:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969127 00000100:00100000:3.0:1762166858.754531:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.754605:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444559104 00000100:00100000:1.0:1762166858.754616:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444559104 00000100:00100000:1.0:1762166858.754684:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1273 00000100:00100000:1.0:1762166858.754695:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444559104:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:1.0:1762166858.754834:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444559104:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 141us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.754843:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1273 00000100:00100000:3.0:1762166858.762225:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.762299:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444559232 00000100:00100000:1.0:1762166858.762309:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444559232 00000100:00100000:1.0:1762166858.762356:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1274 00000100:00100000:1.0:1762166858.762363:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444559232:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762166858.762405:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8b5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.762430:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166858.762432:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166858.762437:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.762450:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.762478:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.762486:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.762492:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.762513:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a27000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166858.762515:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.762521:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.762531:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.762535:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166858.762598:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444559232:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 235us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.762606:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1274 00000100:00100000:3.0:1762166858.764242:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.764306:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444559488 00000100:00100000:1.0:1762166858.764321:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444559488 00000100:00100000:1.0:1762166858.764424:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 485 00000100:00100000:1.0:1762166858.764437:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49382:x1847765444559488:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762166858.764511:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166858.764543:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f876 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x41:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d9d expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.764566:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x41:0x0].0x0 (ffff9ee34ada3900) 00010000:00010000:1.0:1762166858.764597:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166858.764641:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f8bc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.764656:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f8bc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.764666:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f8bc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:1.0:1762166858.764934:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bb8cb72c reply state 000000007d25dac6 transno 8589935114 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f8bc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166858.764944:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166858.765064:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49382:x1847765444559488:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 630us (828us total) trans 8589935114 rc 0/0 00000100:00100000:1.0:1762166858.765073:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 485 00010000:00010000:0.0:1762166858.766367:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f8bc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166858.766385:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f8bc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166858.766388:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762166858.766395:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f8bc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166858.766403:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a27c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166858.766419:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f8bc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166858.766427:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f8bc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166858.766460:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x41:0x0].0x0 (ffff9ee34ada3700) 00010000:00010000:0.0:1762166858.766464:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166858.766469:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f8bc lrc: 2/0,0 mode: --/PW res: [0x200000404:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166858.766475:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27c00/0xf915a5bdf3c9f8bc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166858.766541:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444559616 00000100:00100000:1.0:1762166858.766550:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444559616 00000100:00100000:1.0:1762166858.766603:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 486 00000100:00100000:1.0:1762166858.766613:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49382:x1847765444559616:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166858.766636:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.766653:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f8c3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91dc7 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.766701:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f8c3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dc7 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.766715:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f8c3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dc7 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.766743:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x41:0x0].0x0 (ffff9ee34ada3c00) 00010000:00010000:1.0:1762166858.766746:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166858.766748:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a27200, rc 0) 00000100:00100000:1.0:1762166858.766833:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49382:x1847765444559616:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 218us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.766842:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 486 00000100:00100000:3.0:1762166858.767970:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.768056:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444559744 00000100:00100000:1.0:1762166858.768062:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444559744 00000100:00100000:1.0:1762166858.768104:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1275 00000100:00100000:1.0:1762166858.768113:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:49382:x1847765444559744:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166858.768124:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.768137:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f8ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91dce expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.768161:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f87d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91da4 expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166858.768169:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166858.768171:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166858.768175:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f8ca lrc: 4/0,0 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dce expref: 18 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.768222:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f87d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91da4 expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166858.768239:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f87d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91da4 expref: 18 pid: 26444 timeout: 579 lvb_type: 1 00000100:00100000:1.0:1762166858.768257:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452009472:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.768326:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350438d80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.769344:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452009472:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166858.769371:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f8ca lrc: 3/0,0 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dce expref: 18 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.769386:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a27600, rc 0) 00000100:00100000:1.0:1762166858.769444:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:49382:x1847765444559744:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1331us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.769452:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1275 00000100:00100000:3.0:1762166858.769687:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.769758:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444559872 00000100:00100000:2.0:1762166858.769793:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444559872 00010000:00010000:2.0:1762166858.769835:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f87d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91da4 expref: 18 pid: 26444 timeout: 579 lvb_type: 1 00000100:00100000:2.0:1762166858.769867:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 875 00000100:00100000:2.0:1762166858.769876:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444559872:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.769887:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.769908:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f87d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91da4 expref: 18 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:2.0:1762166858.769922:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f87d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91da4 expref: 18 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:2.0:1762166858.769942:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9f87d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91da4 expref: 18 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:2.0:1762166858.769954:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.769956:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.769960:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f8ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dce expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.769970:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f8ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dce expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.770006:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f8ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dce expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.770019:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765452009600:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762166858.770072:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166858.771396:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.771446:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765452009600:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762166858.771450:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444560000 00000100:00100000:1.0:1762166858.771458:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444560000 00010000:00010000:2.0:1762166858.771467:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166858.771504:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1276 00000100:00100000:1.0:1762166858.771514:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444560000:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:2.0:1762166858.771527:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444559872:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1651us (1838us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.771537:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 875 00002000:00010000:1.0:1762166858.771741:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x8d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166858.771746:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x8d:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:1.0:1762166858.771748:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x8d:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:1.0:1762166858.771750:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x8d:0x0] updating lvb ctime from disk: 0 -> 1762166859 00002000:00010000:1.0:1762166858.771753:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x8d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762166858.771826:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444560000:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 313us (432us total) trans 21474836799 rc 0/0 00000100:00100000:1.0:1762166858.771834:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1276 00000100:00100000:3.0:1762166858.772948:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.772991:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444560256 00000100:00100000:1.0:1762166858.773006:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444560256 00000100:00100000:1.0:1762166858.773037:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 487 00000100:00100000:1.0:1762166858.773043:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49382:x1847765444560256:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762166858.773089:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166858.773111:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f861 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d8f expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.773126:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:1.0:1762166858.773130:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166858.773167:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8d1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.773178:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8d1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.773187:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8d1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:1.0:1762166858.773301:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e28dddf1 reply state 00000000e889aa61 transno 8589935115 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8d1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166858.773309:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166858.773377:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49382:x1847765444560256:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 332us (432us total) trans 8589935115 rc 0/0 00000100:00100000:1.0:1762166858.773397:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 487 00010000:00010000:2.0:1762166858.774215:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8d1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.774227:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8d1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.774234:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8d1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.774239:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a27000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.774243:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8d1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.774249:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8d1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.774261:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:2.0:1762166858.774264:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166858.774268:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8d1 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166858.774274:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9f8d1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166858.774437:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.774480:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444560384 00000100:00100000:1.0:1762166858.774485:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444560384 00000100:00100000:1.0:1762166858.774514:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1277 00000100:00100000:1.0:1762166858.774519:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49382:x1847765444560384:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166858.774528:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.774547:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f8d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91dd5 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.774571:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9f8ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dc0 expref: 27 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166858.774580:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166858.774582:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166858.774586:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f8d8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dd5 expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.774625:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9f8ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dc0 expref: 27 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166858.774639:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9f8ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dc0 expref: 27 pid: 26444 timeout: 579 lvb_type: 1 00000100:00100000:1.0:1762166858.774652:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452009728:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.774709:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350438d80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.775727:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452009728:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166858.775751:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f8d8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dd5 expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.775782:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a27800, rc 0) 00000100:00100000:1.0:1762166858.775814:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49382:x1847765444560384:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1294us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.775820:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1277 00000100:00100000:3.0:1762166858.776212:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.776325:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444560512 00000100:00100000:2.0:1762166858.776332:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444560512 00010000:00010000:2.0:1762166858.776358:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9f8ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dc0 expref: 27 pid: 26444 timeout: 579 lvb_type: 1 00000100:00100000:2.0:1762166858.776400:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 876 00000100:00100000:2.0:1762166858.776407:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444560512:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.776428:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.776444:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9f8ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dc0 expref: 27 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:2.0:1762166858.776454:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9f8ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dc0 expref: 27 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:2.0:1762166858.776471:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a26400/0xf915a5bdf3c9f8ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dc0 expref: 27 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:2.0:1762166858.776495:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.776497:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.776502:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f8d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dd5 expref: 26 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.776512:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f8d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dd5 expref: 26 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.776548:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f8d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dd5 expref: 26 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.776561:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765452009856:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762166858.776718:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.777903:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765452009856:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762166858.777918:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166858.777959:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444560512:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1552us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.777968:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 876 00000100:00100000:3.0:1762166858.778612:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.778657:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444560640 00000100:00100000:1.0:1762166858.778664:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444560640 00000100:00100000:1.0:1762166858.778708:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1278 00000100:00100000:1.0:1762166858.778718:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444560640:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762166858.778929:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x8c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166858.778933:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x8c:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:1.0:1762166858.778935:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x8c:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:1.0:1762166858.778937:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8c:0x0] updating lvb ctime from disk: 1762166858 -> 1762166859 00002000:00010000:1.0:1762166858.778939:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x8c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762166858.778970:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444560640:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 255us (360us total) trans 17179869470 rc 0/0 00000100:00100000:1.0:1762166858.778976:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1278 00000100:00100000:3.0:1762166858.780051:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.780122:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444560896 00000100:00100000:0.0:1762166858.780130:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444560896 00000100:00100000:0.0:1762166858.780177:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 208 00000100:00100000:0.0:1762166858.780186:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348211050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49382:x1847765444560896:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166858.780249:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f88b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dab expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.780284:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f8df lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.780297:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27e00/0xf915a5bdf3c9f7b9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d57 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.780305:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f806 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d6c expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.780313:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f8df lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.780346:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f806 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d6c expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.780395:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f806 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d6c expref: 27 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.780421:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452009984:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166858.780514:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27e00/0xf915a5bdf3c9f7b9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d57 expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.780525:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27e00/0xf915a5bdf3c9f7b9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d57 expref: 27 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.780534:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452010112:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166858.780562:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.782119:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.782180:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452009984:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166858.782212:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444561152 00000100:00100000:2.0:1762166858.782232:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444561152 00000100:00100000:2.0:1762166858.782281:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 209 00000100:00100000:2.0:1762166858.782291:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49238:x1847765444561152:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166858.782510:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49238:x1847765444561152:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 219us (398us total) trans 8589935116 rc 0/0 00000100:00100000:2.0:1762166858.782518:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 209 00000100:00100000:1.0:1762166858.782868:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452010112:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166858.782898:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f8df lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166858.783202:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.783264:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444561280 00000100:00100000:2.0:1762166858.783269:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444561280 00010000:00010000:2.0:1762166858.783291:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27e00/0xf915a5bdf3c9f7b9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d57 expref: 29 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.783325:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 877 00000100:00100000:2.0:1762166858.783332:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765444561280:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.783342:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166858.783347:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166858.783357:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27e00/0xf915a5bdf3c9f7b9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d57 expref: 29 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.783378:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444561408 00010000:00010000:2.0:1762166858.783382:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27e00/0xf915a5bdf3c9f7b9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d57 expref: 29 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.783384:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444561408 00010000:00010000:0.0:1762166858.783405:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f806 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d6c expref: 30 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.783417:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27e00/0xf915a5bdf3c9f7b9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d57 expref: 30 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.783444:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:2.0:1762166858.783449:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f8df lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166858.783457:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 878 00010000:00010000:2.0:1762166858.783467:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f8df lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.783475:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166858.783480:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765444561408:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.783489:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.783495:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f806 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d6c expref: 29 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.783504:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f806 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d6c expref: 29 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.783517:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765444561280:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 183us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.783535:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 877 00010000:00010000:0.0:1762166858.783538:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9f806 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d6c expref: 29 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.783552:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:0.0:1762166858.783556:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f8df lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.783563:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f8df lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.783570:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f8df lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.783593:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166858.783618:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765444561408:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 151us (274us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166858.783619:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f8df lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166858.783629:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 878 00010000:00010000:1.0:1762166858.783634:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f8df lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.783656:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f8e6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.783667:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f8c3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dc7 expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.783686:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f8e6 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x41:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.783711:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f8c3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dc7 expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.783723:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f8c3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dc7 expref: 26 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1762166858.783734:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452010240:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.783816:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350438d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166858.785454:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.785489:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452010240:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166858.785517:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f8e6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x41:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166858.785584:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444561536 00000100:00100000:0.0:1762166858.785591:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444561536 00010000:00010000:0.0:1762166858.785617:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f8c3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dc7 expref: 27 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.785655:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 879 00000100:00100000:0.0:1762166858.785663:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444561536:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.785676:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.785681:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f8c3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dc7 expref: 27 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.785706:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f8c3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dc7 expref: 27 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.785724:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27200/0xf915a5bdf3c9f8c3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x41:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dc7 expref: 27 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.785737:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x41:0x0].0x0 (ffff9ee34ada3c00) 00010000:00010000:0.0:1762166858.785741:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f8e6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x41:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.785749:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f8e6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x41:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.785756:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f8e6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x41:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.785806:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166858.785854:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444561536:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 190us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.785864:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 879 00010000:00010000:1.0:1762166858.785875:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f8e6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.785896:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f8e6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166858.786452:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452010368:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166858.786524:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166858.786585:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350438d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166858.786613:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452010368 00000100:00100000:3.0:1762166858.786632:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452010368 00000100:00100000:3.0:1762166858.786687:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1762166858.786698:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:30821:x1847765452010368:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166858.786821:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:30821:x1847765452010368:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 125us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.786833:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1762166858.786849:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452010368:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166858.786905:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452010496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166858.786929:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166858.786974:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3504380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166858.787031:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452010496 00000100:00100000:3.0:1762166858.787035:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452010496 00000100:00100000:3.0:1762166858.787071:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1762166858.787078:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:30821:x1847765452010496:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166858.787191:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452010496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166858.787204:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:30821:x1847765452010496:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 119us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.787217:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000001:00080000:1.0:1762166858.787383:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935117 00000100:00100000:1.0:1762166858.787452:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452010624:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166858.787478:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166858.787502:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350438b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166858.787537:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452010624 00000100:00100000:3.0:1762166858.787546:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452010624 00000100:00100000:3.0:1762166858.787590:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1762166858.787598:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:30821:x1847765452010624:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166858.787871:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30821:x1847765452010624:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 273us (391us total) trans 21474836800 rc 0/0 00000100:00100000:3.0:1762166858.787879:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1762166858.787926:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452010624:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1762166858.788013:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935118 00010000:00010000:1.0:1762166858.788043:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f8e6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.788052:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f8e6 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.788059:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f8e6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.788066:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166858.788070:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f8e6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.788078:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f8e6 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.788095:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x41:0x0].0x0 (ffff9ee34ada3c00) 00010000:00010000:1.0:1762166858.788099:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166858.788104:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f8e6 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.788109:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f8e6 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.788144:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f8df lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.788149:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f8df lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.788153:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f8df lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.788156:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166858.788158:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f8df lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.788163:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f8df lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.788169:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:1.0:1762166858.788171:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166858.788174:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f8df lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.788178:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9f8df lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.788189:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:1.0:1762166858.788192:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166858.788199:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f88b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dab expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166858.788309:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348211050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49382:x1847765444560896:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 8123us (8260us total) trans 8589935119 rc 0/0 00000100:00100000:1.0:1762166858.788319:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 208 00000020:00080000:1.0:1762166858.788330:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166858.789738:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.789825:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444561664 00000100:00100000:1.0:1762166858.789837:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444561664 00000100:00100000:1.0:1762166858.789905:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 488 00000100:00100000:1.0:1762166858.789916:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49382:x1847765444561664:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166858.789941:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.789967:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f8ed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ddc expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.790031:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f8ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ddc expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.790047:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f8ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ddc expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.790065:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3900) 00010000:00010000:1.0:1762166858.790068:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166858.790071:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a27a00, rc 0) 00000100:00100000:1.0:1762166858.790125:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49382:x1847765444561664:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 211us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.790132:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 488 00000100:00100000:0.0:1762166858.792216:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.792279:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444561920 00000100:00100000:1.0:1762166858.792288:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444561920 00000100:00100000:1.0:1762166858.792337:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 210 00000100:00100000:1.0:1762166858.792345:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49382:x1847765444561920:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166858.792592:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49382:x1847765444561920:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 248us (384us total) trans 8589935120 rc 0/0 00000100:00100000:1.0:1762166858.792606:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 210 00000100:00100000:3.0:1762166858.793907:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.794001:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444562176 00000100:00100000:1.0:1762166858.794008:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444562176 00000100:00100000:1.0:1762166858.794049:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 211 00000100:00100000:1.0:1762166858.794057:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49382:x1847765444562176:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:1.0:1762166858.794238:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x41:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1762166858.794346:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f8f4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.794362:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f8f4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.794372:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f8f4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.794379:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f8f4 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.794384:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f8f4 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.794387:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f8f4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.794418:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166858.794459:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166858.794474:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f8f4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.794484:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a27400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166858.794487:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f8f4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.794494:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f8f4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166858.794510:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49382:x1847765444562176:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 453us (608us total) trans 8589935121 rc 0/0 00010000:00010000:0.0:1762166858.794513:0:32135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x41:0x0].0x0 (ffff9ee34ada3600) 00010000:00010000:0.0:1762166858.794515:0:32135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:1.0:1762166858.794517:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 211 00010000:00010000:0.0:1762166858.794520:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f8f4 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.794525:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27400/0xf915a5bdf3c9f8f4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166858.794543:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166858.794545:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166858.794548:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166858.804117:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.804186:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444562304 00000100:00100000:1.0:1762166858.804200:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444562304 00000100:00100000:1.0:1762166858.804276:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 489 00000100:00100000:1.0:1762166858.804288:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49384:x1847765444562304:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:1.0:1762166858.804339:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.804365:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f8fb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91de3 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.804462:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f902 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804476:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f902 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804486:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f902 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804496:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f909 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804501:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f909 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804505:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f909 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804654:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f910 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804662:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f910 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804667:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f910 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166858.804712:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166858.804717:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166858.804740:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f910 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804759:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f910 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804801:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f902 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804808:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f902 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804816:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f902 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804823:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166858.804828:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f902 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804838:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f902 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804855:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166858.804859:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166858.804863:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f902 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804869:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f902 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804884:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f909 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804889:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f909 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804894:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f909 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804909:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166858.804911:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f909 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804918:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f909 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804925:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3b00) 00010000:00010000:1.0:1762166858.804928:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166858.804931:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f909 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804936:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f909 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.804970:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f8fb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91de3 expref: 32 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.804980:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f910 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91de3 expref: 31 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.804985:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3900) 00010000:00010000:1.0:1762166858.804987:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166858.804989:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a26c00, rc 0) 00000100:00100000:1.0:1762166858.805064:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49384:x1847765444562304:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 778us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.805071:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 489 00000100:00100000:2.0:1762166858.819459:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.819579:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444562432 00000100:00100000:1.0:1762166858.819589:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444562432 00000100:00100000:1.0:1762166858.819664:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 490 00000100:00100000:1.0:1762166858.819674:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49388:x1847765444562432:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:1.0:1762166858.819743:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f917 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.819759:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f917 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.819794:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f917 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.819808:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f91e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.819815:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f91e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.819821:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f91e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.819924:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f925 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.819933:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f925 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.819939:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f925 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166858.819970:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1762166858.819974:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762166858.819985:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f925 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.819997:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f917 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820009:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f917 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820015:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f917 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820021:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166858.820025:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f917 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820033:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f917 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820044:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:1.0:1762166858.820047:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166858.820052:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f917 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820058:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f917 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820071:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f91e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820077:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f91e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820082:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f91e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820087:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166858.820089:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f91e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820103:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f91e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820111:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34ada3b00) 00010000:00010000:1.0:1762166858.820114:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166858.820116:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f91e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820121:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f91e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820135:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f925 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820140:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f925 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820146:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f925 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820151:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166858.820153:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f925 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820159:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f925 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820165:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3900) 00010000:00010000:1.0:1762166858.820167:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166858.820170:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f925 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166858.820175:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9f925 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166858.820262:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49388:x1847765444562432:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 589us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.820270:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 490 00000100:00100000:3.0:1762166858.832146:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.832228:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444562688 00000100:00100000:0.0:1762166858.832238:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444562688 00000100:00100000:0.0:1762166858.832304:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 491 00000100:00100000:0.0:1762166858.832316:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49390:x1847765444562688:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.832339:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.832359:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f92c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91dea expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.832470:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f933 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.832495:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f933 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.832507:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f933 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.832519:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166858.832645:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f92c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dea expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.832685:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f933 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dea expref: 33 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.832694:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3900) 00010000:00010000:0.0:1762166858.832698:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166858.832701:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198800, rc 0) 00000100:00100000:0.0:1762166858.832814:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49390:x1847765444562688:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 450us (626us total) trans 8589935122 rc 0/0 00000100:00100000:0.0:1762166858.832822:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 491 00000100:00100000:3.0:1762166858.835105:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.835151:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444562944 00000100:00100000:0.0:1762166858.835160:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444562944 00000100:00100000:0.0:1762166858.835200:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 492 00000100:00100000:0.0:1762166858.835207:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49390:x1847765444562944:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.835223:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.835249:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f941 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91df1 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.835331:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f948 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.835345:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f910 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91de3 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.835353:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f948 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.835383:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f910 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91de3 expref: 34 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.835426:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f910 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91de3 expref: 34 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.835441:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452010752:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166858.835514:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.836457:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f403480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452010752:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166858.836477:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f948 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166858.836992:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.837035:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444563072 00000100:00100000:0.0:1762166858.837042:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444563072 00010000:00010000:0.0:1762166858.837068:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f910 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91de3 expref: 35 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.837103:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 880 00000100:00100000:0.0:1762166858.837113:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444563072:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.837126:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.837133:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f910 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91de3 expref: 35 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.837145:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f910 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91de3 expref: 35 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.837163:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9f910 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91de3 expref: 35 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.837192:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3900) 00010000:00010000:0.0:1762166858.837197:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f948 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.837206:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f948 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.837213:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f948 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.837238:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166858.837267:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f948 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.837276:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f948 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166858.837287:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765444563072:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 175us (303us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166858.837296:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000100:00100000:0.0:1762166858.837297:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 880 00010000:00010000:3.0:1762166858.837435:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9f941 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91df1 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.837451:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f948 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91df1 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.837458:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3900) 00010000:00010000:3.0:1762166858.837461:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166858.837464:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199a00, rc 0) 00000100:00100000:3.0:1762166858.837587:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49390:x1847765444562944:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2379us (2490us total) trans 8589935123 rc 0/0 00000100:00100000:3.0:1762166858.837595:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 492 00000100:00100000:3.0:1762166858.839215:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.839272:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444563200 00000100:00100000:1.0:1762166858.839280:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444563200 00000100:00100000:1.0:1762166858.839328:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 212 00000100:00100000:1.0:1762166858.839339:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49390:x1847765444563200:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:1.0:1762166858.839481:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49390:x1847765444563200:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 145us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.839489:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 212 00000100:00100000:2.0:1762166858.841070:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.841200:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444563456 00000100:00100000:1.0:1762166858.841216:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444563456 00000100:00100000:1.0:1762166858.841287:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 213 00000100:00100000:1.0:1762166858.841299:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49390:x1847765444563456:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166858.841602:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49390:x1847765444563456:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 305us (537us total) trans 8589935124 rc 0/0 00000100:00100000:1.0:1762166858.841612:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 213 00000100:00100000:3.0:1762166858.842910:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.842958:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444563712 00000100:00100000:0.0:1762166858.842968:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444563712 00000100:00100000:0.0:1762166858.843024:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 493 00000100:00100000:0.0:1762166858.843036:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49390:x1847765444563712:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.843060:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.843063:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166858.843089:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f948 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91df1 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.843114:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f933 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dea expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.843124:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3900) 00010000:00010000:0.0:1762166858.843128:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166858.843157:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f956 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91df8 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.843239:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f95d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.843251:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f95d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.843260:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f95d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.843270:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166858.843375:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f956 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91df8 expref: 36 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.843388:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f95d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91df8 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.843395:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3900) 00010000:00010000:0.0:1762166858.843397:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166858.843400:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198000, rc 0) 00000100:00100000:0.0:1762166858.843469:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49390:x1847765444563712:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 437us (565us total) trans 8589935125 rc 0/0 00000100:00100000:0.0:1762166858.843477:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 493 00000100:00100000:3.0:1762166858.844920:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.845030:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444563968 00000100:00100000:1.0:1762166858.845045:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444563968 00000100:00100000:1.0:1762166858.845149:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 214 00000100:00100000:1.0:1762166858.845162:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348213050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49390:x1847765444563968:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166858.845258:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f95d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91df8 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.845303:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f96b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.845333:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f8ed lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ddc expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.845343:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f96b lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.845384:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f8ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ddc expref: 35 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.845401:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f8ed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ddc expref: 35 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1762166858.845429:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452010880:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.845548:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350438b40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.846746:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452010880:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166858.846807:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f96b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166858.846892:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.846955:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444564096 00000100:00100000:2.0:1762166858.846962:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444564096 00010000:00010000:2.0:1762166858.846994:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f8ed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ddc expref: 36 pid: 30818 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.847026:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 881 00000100:00100000:2.0:1762166858.847040:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765444564096:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.847053:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.847057:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f8ed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ddc expref: 36 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.847067:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f8ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ddc expref: 36 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.847082:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9f8ed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ddc expref: 36 pid: 30818 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.847093:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3900) 00010000:00010000:2.0:1762166858.847098:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f96b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.847104:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f96b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.847110:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f96b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.847128:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166858.847152:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f96b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.847161:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f96b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166858.847172:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444564096:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 138us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.847179:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 881 00010000:00010000:1.0:1762166858.847484:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f96b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.847495:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f96b lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.847516:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f96b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.847522:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166858.847527:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f96b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.847536:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f96b lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.847549:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3900) 00010000:00010000:1.0:1762166858.847552:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166858.847556:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f96b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.847562:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f96b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.847586:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34ada3900) 00010000:00010000:1.0:1762166858.847591:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166858.847598:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9f95d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91df8 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166858.847805:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348213050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49390:x1847765444563968:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2643us (2885us total) trans 8589935126 rc -22/-22 00000100:00100000:1.0:1762166858.847817:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 214 00000100:00100000:3.0:1762166858.849217:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.849279:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444564224 00000100:00100000:0.0:1762166858.849292:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444564224 00000100:00100000:0.0:1762166858.849353:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 494 00000100:00100000:0.0:1762166858.849366:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49390:x1847765444564224:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.849389:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.849432:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f972 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91dff expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.849489:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f972 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dff expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.849503:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f972 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dff expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.849521:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166858.849524:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166858.849528:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199c00, rc 0) 00000100:00100000:0.0:1762166858.849593:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49390:x1847765444564224:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 230us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.849600:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 494 00000100:00100000:2.0:1762166858.851729:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.851875:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444564480 00000100:00100000:0.0:1762166858.851891:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444564480 00000100:00100000:0.0:1762166858.851972:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 495 00000100:00100000:0.0:1762166858.851984:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49390:x1847765444564480:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.852011:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.852038:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f979 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e06 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.852692:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f980 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.852710:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f980 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.852723:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f980 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.852754:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x42:0x0]: returning size 0 00010000:00010000:0.0:1762166858.852861:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9f979 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e06 expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.852884:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f980 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e06 expref: 37 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.852894:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x42:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:0.0:1762166858.852897:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166858.852903:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198800, rc 0) 00000100:00100000:0.0:1762166858.852994:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49390:x1847765444564480:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1011us (1277us total) trans 8589935127 rc 0/0 00000100:00100000:0.0:1762166858.853004:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 495 00000100:00100000:3.0:1762166858.855055:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.855132:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444564736 00000100:00100000:0.0:1762166858.855145:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444564736 00000100:00100000:0.0:1762166858.855205:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 496 00000100:00100000:0.0:1762166858.855218:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49390:x1847765444564736:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.855247:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.855270:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f98e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e0d expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.855383:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f995 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.855400:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f995 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.855428:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f995 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.855455:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166858.855606:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f98e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e0d expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.855628:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f995 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e0d expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.855638:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166858.855641:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166858.855645:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199800, rc 0) 00000100:00100000:0.0:1762166858.855718:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49390:x1847765444564736:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 502us (668us total) trans 8589935128 rc 0/0 00000100:00100000:0.0:1762166858.855726:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 496 00000100:00100000:3.0:1762166858.857297:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.857458:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444564992 00000100:00100000:1.0:1762166858.857470:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444564992 00000100:00100000:1.0:1762166858.857539:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 215 00000100:00100000:1.0:1762166858.857550:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49390:x1847765444564992:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166858.857651:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f995 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e0d expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.857690:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f9a3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.857704:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f972 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dff expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.857712:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f9a3 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.857756:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f972 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dff expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.857811:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f972 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dff expref: 39 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1762166858.857831:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452011008:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.857955:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350438c00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.859107:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452011008:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166858.859136:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f9a3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166858.859309:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.859357:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444565120 00000100:00100000:2.0:1762166858.859366:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444565120 00010000:00010000:2.0:1762166858.859404:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f972 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dff expref: 40 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.859451:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 882 00000100:00100000:2.0:1762166858.859459:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2361:x1847765444565120:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.859474:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.859480:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f972 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dff expref: 40 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.859493:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f972 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dff expref: 40 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.859515:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9f972 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dff expref: 40 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.859532:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:2.0:1762166858.859538:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f9a3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.859556:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f9a3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.859563:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f9a3 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.859593:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166858.859629:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f9a3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.859637:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f9a3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166858.859645:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444565120:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 186us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.859656:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 882 00010000:00010000:1.0:1762166858.859673:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f9aa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.859683:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f980 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e06 expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.859689:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f9aa lrc: 4/0,1 mode: --/EX res: [0x200000404:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.859715:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f980 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e06 expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.859725:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f980 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e06 expref: 38 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1762166858.859736:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452011136:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.859816:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350438c00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.860556:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452011136:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166858.860575:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f9aa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166858.860908:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.860944:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444565248 00000100:00100000:2.0:1762166858.860950:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444565248 00010000:00010000:2.0:1762166858.860970:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f980 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e06 expref: 39 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.861007:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 883 00000100:00100000:2.0:1762166858.861015:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444565248:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.861025:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.861031:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f980 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e06 expref: 39 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.861043:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f980 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e06 expref: 39 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.861058:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f980 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e06 expref: 39 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.861071:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x42:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166858.861076:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f9aa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.861083:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f9aa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.861090:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f9aa lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166858.861112:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166858.861139:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f9aa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x42:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.861146:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f9aa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x42:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166858.861150:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2360:x1847765444565248:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 134us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.861160:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 883 00000100:00100000:1.0:1762166858.861563:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452011264:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166858.861602:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166858.861634:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.861651:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452011264 00000100:00100000:2.0:1762166858.861656:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452011264 00000100:00100000:2.0:1762166858.861687:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1762166858.861695:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30821:x1847765452011264:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166858.861782:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30821:x1847765452011264:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 69us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.861793:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1762166858.861816:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452011264:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1762166858.861853:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935129 00000001:00080000:1.0:1762166858.861914:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935130 00010000:00010000:1.0:1762166858.861935:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f9aa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x42:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.861943:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f9aa lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x42:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.861949:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f9aa lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x42:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.861955:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166858.861958:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f9aa lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x42:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.861965:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f9aa lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x42:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.861975:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x42:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:1.0:1762166858.861978:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166858.861982:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f9aa lrc: 2/0,0 mode: --/EX res: [0x200000404:0x42:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.861987:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26200/0xf915a5bdf3c9f9aa lrc: 0/0,0 mode: --/EX res: [0x200000404:0x42:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.862003:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f9a3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.862008:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f9a3 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.862024:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f9a3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.862029:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166858.862032:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f9a3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.862038:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f9a3 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.862045:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:1.0:1762166858.862047:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166858.862050:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f9a3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.862055:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f9a3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.862066:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:1.0:1762166858.862069:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166858.862074:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9f995 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e0d expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166858.862144:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49390:x1847765444564992:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 4597us (4852us total) trans 8589935131 rc 0/0 00000100:00100000:1.0:1762166858.862150:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 215 00000020:00080000:1.0:1762166858.862153:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166858.863105:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.863171:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444565376 00000100:00100000:0.0:1762166858.863178:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444565376 00000100:00100000:0.0:1762166858.863220:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 497 00000100:00100000:0.0:1762166858.863230:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49390:x1847765444565376:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.863248:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.863265:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f9b1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e14 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.863307:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f9b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e14 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.863320:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f9b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e14 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.863352:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166858.863356:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166858.863358:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199400, rc 0) 00000100:00100000:0.0:1762166858.863402:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49390:x1847765444565376:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 175us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.863421:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 497 00000100:00100000:3.0:1762166858.864536:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.864604:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444565632 00000100:00100000:1.0:1762166858.864618:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444565632 00000100:00100000:1.0:1762166858.864690:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 216 00000100:00100000:1.0:1762166858.864703:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49390:x1847765444565632:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:1.0:1762166858.865284:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x42:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1762166858.865429:0:30821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].18, 64 off9536 00000001:00080000:1.0:1762166858.865441:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935132 00010000:00010000:1.0:1762166858.865496:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f9b8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.865513:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f9b8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.865525:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f9b8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.865534:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f9b8 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.865541:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f9b8 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.865548:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f9b8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166858.865579:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166858.865639:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166858.865651:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f9b8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.865660:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166858.865665:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f9b8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.865674:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f9b8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.865689:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x42:0x0].0x0 (ffff9ee34ada3900) 00010000:00010000:3.0:1762166858.865692:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166858.865696:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f9b8 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.865703:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26800/0xf915a5bdf3c9f9b8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166858.865727:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166858.865732:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166858.865734:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49390:x1847765444565632:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 1027us (1193us total) trans 8589935133 rc 0/0 00010000:00010000:3.0:1762166858.865737:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166858.865748:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 216 00000020:00080000:1.0:1762166858.865755:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166858.866873:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.866922:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444565888 00000100:00100000:1.0:1762166858.866939:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444565888 00000100:00100000:1.0:1762166858.866987:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 217 00000100:00100000:1.0:1762166858.866998:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49390:x1847765444565888:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166858.867246:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49390:x1847765444565888:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 250us (379us total) trans 8589935134 rc 0/0 00000100:00100000:1.0:1762166858.867268:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 217 00000100:00100000:0.0:1762166858.876494:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.876873:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444566016 00000100:00100000:3.0:1762166858.876883:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444566016 00000100:00100000:3.0:1762166858.876940:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 498 00000100:00100000:3.0:1762166858.876950:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49393:x1847765444566016:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:3.0:1762166858.876974:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.877007:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f9bf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e1b expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.877067:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9f9c6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877080:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9f9c6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877091:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9f9c6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877104:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877110:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877117:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877213:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3c9f9d4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877220:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3c9f9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877227:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3c9f9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166858.877256:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:3.0:1762166858.877260:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166858.877276:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3c9f9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877287:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3c9f9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877300:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9f9c6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877306:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9f9c6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877312:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9f9c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877318:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166858.877321:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9f9c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877328:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9f9c6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877340:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:3.0:1762166858.877342:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166858.877346:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9f9c6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877351:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9f9c6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877363:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877369:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9cd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877374:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9cd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877379:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166858.877387:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9cd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877392:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9cd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877399:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee363960100) 00010000:00010000:3.0:1762166858.877401:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166858.877404:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9cd lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877421:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9cd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.877450:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f9bf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e1b expref: 45 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.877460:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3c9f9d4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e1b expref: 44 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.877466:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:3.0:1762166858.877468:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166858.877471:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228e00, rc 0) 00000100:00100000:3.0:1762166858.877532:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49393:x1847765444566016:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 583us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.877540:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 498 00000100:00100000:3.0:1762166858.879168:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.879224:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444566144 00000100:00100000:1.0:1762166858.879231:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444566144 00000100:00100000:1.0:1762166858.879275:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1279 00000100:00100000:1.0:1762166858.879284:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765444566144:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:1.0:1762166858.879297:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.879311:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f9db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e22 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166858.879352:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452011392:192.168.203.35@tcp:106: 00000100:00100000:1.0:1762166858.879406:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c59540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.880282:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452011392:192.168.203.35@tcp:106: 00010000:00010000:1.0:1762166858.880311:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f9db lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e22 expref: 19 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166858.880330:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9f9db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e22 expref: 19 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166858.880342:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a26a00, rc 0) 00000100:00100000:1.0:1762166858.880386:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765444566144:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 1103us (1222us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166858.880394:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1279 00000100:00100000:0.0:1762166858.890500:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.890563:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444566272 00000100:00100000:3.0:1762166858.890573:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444566272 00000100:00100000:3.0:1762166858.890625:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 499 00000100:00100000:3.0:1762166858.890634:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49397:x1847765444566272:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:3.0:1762166858.890723:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9f9e2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.890739:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9f9e2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.890750:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9f9e2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.890798:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f9e9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.890807:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f9e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.890815:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f9e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.890918:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9f0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.890928:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.890934:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166858.890964:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:3.0:1762166858.890968:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166858.890978:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.890989:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9f9e2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891009:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9f9e2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891016:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9f9e2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891022:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166858.891026:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9f9e2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891033:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9f9e2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891044:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:3.0:1762166858.891046:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166858.891051:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9f9e2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891057:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9f9e2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891068:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f9e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891074:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f9e9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891079:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f9e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891084:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166858.891087:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f9e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891102:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f9e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891109:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee363960100) 00010000:00010000:3.0:1762166858.891112:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166858.891114:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f9e9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891120:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9f9e9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891134:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891139:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9f0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891144:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9f0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891149:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166858.891152:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9f0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891157:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9f0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891164:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:3.0:1762166858.891166:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166858.891169:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9f0 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.891174:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9f9f0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166858.891248:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49397:x1847765444566272:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 615us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.891257:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 499 00000100:00100000:3.0:1762166858.900321:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.900392:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444566528 00000100:00100000:0.0:1762166858.900406:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444566528 00000100:00100000:0.0:1762166858.900477:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 500 00000100:00100000:0.0:1762166858.900486:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49399:x1847765444566528:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.900510:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.900534:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f9f7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e29 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.900625:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f9fe lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.900639:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f9fe lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.900650:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f9fe lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.900660:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166858.900809:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9f9f7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e29 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.900845:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f9fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e29 expref: 46 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.900854:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166858.900857:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166858.900860:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198800, rc 0) 00000100:00100000:0.0:1762166858.900911:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49399:x1847765444566528:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 427us (599us total) trans 8589935135 rc 0/0 00000100:00100000:0.0:1762166858.900916:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 500 00000100:00100000:2.0:1762166858.902684:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.902754:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444566656 00000100:00100000:1.0:1762166858.902813:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444566656 00000100:00100000:1.0:1762166858.902897:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1280 00000100:00100000:1.0:1762166858.902925:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765444566656:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762166858.902945:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166858.902967:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9fa0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e30 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166858.903047:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452011520:192.168.203.35@tcp:106: 00000100:00100000:1.0:1762166858.903149:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c59540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.904566:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452011520:192.168.203.35@tcp:106: 00010000:00010000:1.0:1762166858.904600:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9fa0c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e30 expref: 19 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166858.904620:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a26a00/0xf915a5bdf3c9fa0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e30 expref: 19 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166858.904633:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a26a00, rc 0) 00000100:00100000:1.0:1762166858.904696:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765444566656:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1773us (2015us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166858.904705:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1280 00000100:00100000:3.0:1762166858.907456:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.907505:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444566912 00000100:00100000:0.0:1762166858.907518:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444566912 00000100:00100000:0.0:1762166858.907579:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 501 00000100:00100000:0.0:1762166858.907589:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49399:x1847765444566912:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.907614:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.907633:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fa13 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e37 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.907727:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fa1a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.907741:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3c9f9d4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e1b expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.907751:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fa1a lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.907812:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3c9f9d4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e1b expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.907843:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3c9f9d4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e1b expref: 47 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.907856:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f402680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452011648:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166858.907918:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.909068:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f402680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452011648:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166858.909093:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fa1a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166858.909239:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.909289:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444567040 00000100:00100000:2.0:1762166858.909295:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444567040 00010000:00010000:2.0:1762166858.909328:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3c9f9d4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e1b expref: 48 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.909363:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 884 00000100:00100000:2.0:1762166858.909374:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2360:x1847765444567040:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166858.909390:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.909397:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3c9f9d4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e1b expref: 48 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.909421:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3c9f9d4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e1b expref: 48 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.909443:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3c9f9d4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e1b expref: 48 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.909458:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:2.0:1762166858.909462:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fa1a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.909470:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fa1a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.909477:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fa1a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.909500:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166858.909527:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fa1a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.909536:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fa1a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166858.909552:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:2360:x1847765444567040:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 178us (312us total) trans 0 rc 0/0 00000004:00200000:0.0:1762166858.909552:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000100:00100000:2.0:1762166858.909563:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 884 00010000:00010000:0.0:1762166858.909689:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fa13 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e37 expref: 48 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.909704:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fa1a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e37 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.909711:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166858.909713:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166858.909716:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199800, rc 0) 00000100:00100000:0.0:1762166858.909750:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49399:x1847765444566912:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2164us (2301us total) trans 8589935136 rc 0/0 00000100:00100000:0.0:1762166858.909757:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 501 00000100:00100000:3.0:1762166858.911341:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.911391:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444567296 00000100:00100000:0.0:1762166858.911398:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444567296 00000100:00100000:0.0:1762166858.911457:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 502 00000100:00100000:0.0:1762166858.911474:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49399:x1847765444567296:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.911496:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.911512:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fa28 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e3e expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.912035:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fa2f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.912049:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fa2f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.912059:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fa2f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166858.912068:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x43:0x0]: returning size 0 00010000:00010000:0.0:1762166858.912101:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fa28 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e3e expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.912117:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fa2f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e3e expref: 49 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.912125:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x43:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166858.912127:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166858.912130:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199200, rc 0) 00000100:00100000:0.0:1762166858.912179:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49399:x1847765444567296:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 714us (845us total) trans 8589935137 rc 0/0 00000100:00100000:0.0:1762166858.912187:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 502 00000100:00100000:2.0:1762166858.913758:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.913834:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444567552 00000100:00100000:0.0:1762166858.913844:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444567552 00000100:00100000:0.0:1762166858.913892:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 503 00000100:00100000:0.0:1762166858.913903:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49399:x1847765444567552:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.913921:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.913938:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9fa3d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e45 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.914013:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fa44 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.914027:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fa2f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e3e expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.914035:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fa44 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.914064:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fa2f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e3e expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.914076:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fa2f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e3e expref: 50 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.914089:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f402680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452011776:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166858.914160:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.915086:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f402680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452011776:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166858.915106:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fa44 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166858.915441:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.915509:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444567680 00000100:00100000:0.0:1762166858.915523:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444567680 00010000:00010000:0.0:1762166858.915543:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fa2f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e3e expref: 51 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.915566:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 885 00000100:00100000:0.0:1762166858.915572:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444567680:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.915582:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.915586:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fa2f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e3e expref: 51 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.915595:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fa2f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e3e expref: 51 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.915609:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fa2f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e3e expref: 51 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.915620:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x43:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166858.915622:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fa44 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.915629:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fa44 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.915633:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fa44 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.915648:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166858.915674:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fa44 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166858.915682:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2361:x1847765444567680:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 108us (240us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166858.915683:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fa44 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166858.915697:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 885 00000004:00200000:3.0:1762166858.915702:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x43:0x0]: returning size 0 00000004:00080000:3.0:1762166858.916071:0:30817:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x8d:0x0], index 1: 0 00010000:00010000:3.0:1762166858.916199:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fa44 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.916208:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fa44 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.916214:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fa44 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.916219:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166858.916222:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fa44 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.916227:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fa44 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.916242:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x43:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:3.0:1762166858.916244:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166858.916246:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fa44 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.916250:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fa44 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.916290:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9fa3d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e45 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.916299:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:3.0:1762166858.916301:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166858.916304:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9fa3d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e45 expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.916313:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199e00, rc 0) 00000100:00100000:3.0:1762166858.916353:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49399:x1847765444567552:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2453us (2599us total) trans 8589935138 rc 301/301 00000100:00100000:3.0:1762166858.916361:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 503 00000100:00100000:2.0:1762166858.917535:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166858.917614:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444567936 00000100:00100000:1.0:1762166858.917622:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444567936 00000100:00100000:1.0:1762166858.917668:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 218 00000100:00100000:1.0:1762166858.917678:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49399:x1847765444567936:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166858.917934:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49399:x1847765444567936:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 257us (403us total) trans 8589935139 rc 0/0 00000100:00100000:1.0:1762166858.917941:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 218 00000100:00100000:0.0:1762166858.918986:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.919036:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444568064 00000100:00100000:3.0:1762166858.919042:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444568064 00000100:00100000:3.0:1762166858.919081:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 504 00000100:00100000:3.0:1762166858.919090:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49399:x1847765444568064:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.919106:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.919123:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9fa52 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e4c expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.919198:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fa59 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.919213:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fa1a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e37 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.919221:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fa59 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.919250:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fa1a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e37 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.919262:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fa1a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e37 expref: 51 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166858.919276:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452011904:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166858.919336:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262c300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.919893:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f1807908-b95d-4027-b65a-753b7d69e554:3294:1847765452012160:0@lo:400:kworker.0 00000004:00080000:1.0:1762166858.919902:0:30841:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 479712138002ns, next at 480712135736ns, rc = 0 00000100:00100000:2.0:1762166858.919926:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765452012032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762166858.919940:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166858.919954:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765452012288:0@lo:400:kworker.0 00000100:00100000:3.0:1762166858.919960:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1847765452012416:0@lo:400:kworker.0 00000100:00100000:2.0:1762166858.919965:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166858.919990:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1762166858.919994:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166858.920003:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1847765452012544:0@lo:400:kworker.0 00000100:00100000:3.0:1762166858.920017:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166858.920028:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452012032 00000100:00100000:2.0:1762166858.920034:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452012032 00000100:00100000:0.0:1762166858.920041:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452012160 00000100:00100000:0.0:1762166858.920045:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452012160 00000100:00100000:2.0:1762166858.920069:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1762166858.920077:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765452012032:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762166858.920082:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1762166858.920094:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3294:x1847765452012160:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1762166858.920102:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 56033280 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1762166858.920104:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452012288 00000100:00100000:1.0:1762166858.920109:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452012288 00000100:00100000:0.0:1762166858.920147:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3294:x1847765452012160:12345-0@lo:400:kworker.0 Request processed in 55us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.920152:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452012416 00000100:00100000:0.0:1762166858.920157:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1762166858.920158:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452012416 00000100:00100000:2.0:1762166858.920162:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765452012032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.920172:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1762166858.920191:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1762166858.920201:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765452012288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166858.920207:0:31205:0:(service.c:3434:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1762166858.920211:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452011904:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166858.920217:0:31205:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1762166858.920218:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166858.920235:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fa59 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00080000:2.0:1762166858.920241:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762166858.920253:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f1807908-b95d-4027-b65a-753b7d69e554:3294:1847765452012160:0@lo:400:kworker.0 00000100:00100000:1.0:1762166858.920257:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765452012288:12345-0@lo:400:kworker.0 Request processed in 56us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.920259:0:30819:0:(service.c:3434:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1762166858.920270:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452012544 00000100:00100000:1.0:1762166858.920271:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1762166858.920276:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452012544 00000100:00100000:3.0:1762166858.920292:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765452012032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762166858.920299:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1762166858.920307:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1762166858.920312:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1847765452012416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166858.920315:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765452012288:0@lo:400:kworker.0 00000100:00100000:2.0:1762166858.920322:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1847765452012544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166858.920372:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1847765452012416:12345-0@lo:400:kworker.0 Request processed in 65us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.920378:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1847765452012416:0@lo:400:kworker.0 00000100:00100000:1.0:1762166858.920382:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1762166858.920402:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1847765452012544:12345-0@lo:400:kworker.0 Request processed in 84us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.920422:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1762166858.920436:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1847765452012544:0@lo:400:kworker.0 00000100:00100000:1.0:1762166858.920509:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.920558:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444568192 00000100:00100000:0.0:1762166858.920563:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444568192 00010000:00010000:0.0:1762166858.920586:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fa1a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e37 expref: 52 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.920620:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 886 00000100:00100000:0.0:1762166858.920627:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2361:x1847765444568192:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.920636:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.920651:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fa1a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e37 expref: 52 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.920663:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fa1a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e37 expref: 52 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.920681:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fa1a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e37 expref: 52 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.920694:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166858.920699:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fa59 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.920706:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fa59 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.920713:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fa59 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.920736:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166858.920755:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fa59 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166858.920793:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444568192:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 165us (284us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166858.920796:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fa59 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166858.920802:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 886 00000004:00200000:3.0:1762166858.920834:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:3.0:1762166858.920839:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166858.920855:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fa59 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166858.920857:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765452012672:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1762166858.920865:0:30843:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 479713101504ns, next at 480713100331ns, rc = 0 00010000:00010000:3.0:1762166858.920892:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9fa52 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e4c expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.920900:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166858.920914:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fa59 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e4c expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.920924:0:6537:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452012672 00000100:00100000:2.0:1762166858.920928:0:6537:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452012672 00000100:00100000:2.0:1762166858.920954:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1762166858.920959:0:6537:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765452012672:12345-0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1762166858.920971:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:3.0:1762166858.920974:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166858.920977:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348229600, rc 0) 00002000:00000024:2.0:1762166858.920979:0:6537:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 61014016 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1762166858.921014:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49399:x1847765444568064:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1925us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.921022:0:6537:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765452012672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.921024:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 504 00000100:00100000:2.0:1762166858.921034:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1762166858.921064:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765452012672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762166858.922131:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.922176:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444568320 00000100:00100000:2.0:1762166858.922181:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444568320 00000100:00100000:2.0:1762166858.922208:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1281 00000100:00100000:2.0:1762166858.922213:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765444568320:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166858.922222:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.922232:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fa60 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e53 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.922263:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452012800:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166858.922306:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2446a2600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.923055:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452012800:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166858.923076:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fa60 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e53 expref: 19 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.923088:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fa60 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e53 expref: 19 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.923095:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3000, rc 0) 00000100:00100000:2.0:1762166858.923127:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765444568320:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 914us (1000us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166858.923132:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1281 00000100:00100000:0.0:1762166858.924182:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.924238:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444568448 00000100:00100000:3.0:1762166858.924245:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444568448 00000100:00100000:3.0:1762166858.924285:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 505 00000100:00100000:3.0:1762166858.924294:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49399:x1847765444568448:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.924306:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.924323:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fa67 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e5a expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.924387:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9fa6e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.924427:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9fa6e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x43:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.924438:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9fa6e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x43:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166858.924466:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x43:0x0]: returning size 0 00000004:00200000:3.0:1762166858.924469:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166858.924481:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9fa6e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x43:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.924502:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fa67 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e5a expref: 52 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.924513:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9fa6e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x43:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e5a expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.924520:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x43:0x0].0x0 (ffff9ee363960100) 00010000:00010000:3.0:1762166858.924523:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762166858.924526:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348229200, rc 0) 00000100:00100000:3.0:1762166858.924560:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49399:x1847765444568448:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 268us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.924566:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 505 00000100:00100000:1.0:1762166858.925819:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.925865:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444568576 00000100:00100000:2.0:1762166858.925872:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444568576 00000100:00100000:2.0:1762166858.925913:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1282 00000100:00100000:2.0:1762166858.925922:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444568576:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166858.925939:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.925955:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fa75 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e61 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166858.925977:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166858.925992:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.925994:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.926001:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fa75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e61 expref: 28 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.926016:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fa75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e61 expref: 28 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.926026:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3e00, rc 0) 00000100:00100000:2.0:1762166858.926070:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444568576:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 149us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.926077:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1282 00000100:00100000:0.0:1762166858.927330:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.927370:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444568832 00000100:00100000:3.0:1762166858.927377:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444568832 00000100:00100000:3.0:1762166858.927433:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 506 00000100:00100000:3.0:1762166858.927441:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49399:x1847765444568832:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.927455:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.927477:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229000/0xf915a5bdf3c9fa7c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e68 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.927573:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3c9fa83 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.927586:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3c9fa83 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.927595:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3c9fa83 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166858.927607:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:3.0:1762166858.927707:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229000/0xf915a5bdf3c9fa7c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e68 expref: 54 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.927722:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3c9fa83 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e68 expref: 53 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.927730:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:3.0:1762166858.927733:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166858.927736:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228a00, rc 0) 00000100:00100000:3.0:1762166858.927802:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49399:x1847765444568832:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 361us (488us total) trans 8589935140 rc 0/0 00000100:00100000:3.0:1762166858.927809:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 506 00000100:00100000:0.0:1762166858.929179:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.929222:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444568960 00000100:00100000:2.0:1762166858.929229:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444568960 00000100:00100000:2.0:1762166858.929272:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1283 00000100:00100000:2.0:1762166858.929281:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444568960:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166858.929293:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.929305:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fa91 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e6f expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.929349:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452012928:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166858.929400:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2446a2600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.930320:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452012928:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166858.930345:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fa91 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e6f expref: 19 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.930363:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fa91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e6f expref: 19 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.930375:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2400, rc 0) 00000100:00100000:2.0:1762166858.930425:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444568960:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1145us (1250us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166858.930433:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1283 00000100:00100000:0.0:1762166858.931753:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.931821:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444569088 00000100:00100000:2.0:1762166858.931830:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444569088 00000100:00100000:2.0:1762166858.931869:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1284 00000100:00100000:2.0:1762166858.931875:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444569088:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166858.931885:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.931896:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fa98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e76 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.931929:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452013056:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166858.931980:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2446a2600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.932910:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452013056:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762166858.932937:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fa98 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e76 expref: 19 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.932953:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fa98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e76 expref: 19 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.932970:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3a00, rc 0) 00000100:00100000:2.0:1762166858.933007:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444569088:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1131us (1256us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166858.933013:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1284 00000100:00100000:1.0:1762166858.934301:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.934338:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444569216 00000100:00100000:2.0:1762166858.934345:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444569216 00000100:00100000:2.0:1762166858.934397:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1285 00000100:00100000:2.0:1762166858.934419:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765444569216:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166858.934460:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fa9f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.934476:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f8ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dce expref: 18 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.934484:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166858.934486:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166858.934489:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fa9f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.934515:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f8ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dce expref: 18 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.934528:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f8ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dce expref: 18 pid: 26444 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.934540:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452013184:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166858.934602:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2446a2600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.935352:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765452013184:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166858.935367:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fa9f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166858.935639:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.935678:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444569344 00000100:00100000:0.0:1762166858.935696:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444569344 00010000:00010000:0.0:1762166858.935719:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f8ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dce expref: 19 pid: 26444 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.935750:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 887 00000100:00100000:0.0:1762166858.935759:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765444569344:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.935797:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.935816:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f8ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dce expref: 19 pid: 26444 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.935830:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f8ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dce expref: 19 pid: 26444 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.935848:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27600/0xf915a5bdf3c9f8ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dce expref: 19 pid: 26444 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1762166858.935860:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.935862:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.935865:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fa9f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.935871:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fa9f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.935895:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166858.935913:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fa9f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.935924:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fa9f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.935935:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765444569344:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 178us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.935941:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 887 00010000:00010000:2.0:1762166858.935946:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fa9f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.935957:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fa9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.935965:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fa9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.935971:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166858.935975:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fa9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.935982:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fa9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.936001:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fa9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.936009:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fa9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.936066:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444569216:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 1655us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.936074:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1285 00000100:00100000:0.0:1762166858.937398:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.937449:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444569472 00000100:00100000:2.0:1762166858.937456:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444569472 00000100:00100000:2.0:1762166858.937499:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1286 00000100:00100000:2.0:1762166858.937507:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444569472:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166858.937519:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166858.937533:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9faa6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e7d expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166858.937550:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x8d:0x0] initial LVB size: 0, mtime: 0x69088847, atime: 0x69088847, ctime: 0x6908884b, blocks: 0x1 00010000:00010000:2.0:1762166858.937563:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.937565:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166858.937571:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9faa6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e7d expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.937584:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9faa6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e7d expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166858.937599:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2000, rc 0) 00000100:00100000:2.0:1762166858.937637:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765444569472:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 131us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.937643:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1286 00000100:00100000:1.0:1762166858.962117:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.962170:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444569600 00000100:00100000:3.0:1762166858.962179:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444569600 00000100:00100000:3.0:1762166858.962224:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 507 00000100:00100000:3.0:1762166858.962231:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49399:x1847765444569600:12345-192.168.203.35@tcp:44:lfs.0 00000004:00080000:3.0:1762166858.974676:0:32137:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000001:00080000:2.0:1762166858.974678:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935137 is committed 00000004:00080000:3.0:1762166858.974699:0:32137:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00000020:00080000:2.0:1762166858.974712:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969128 batchid updated 00000001:00080000:3.0:1762166858.974726:0:32137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935139 is committed 00000020:00080000:3.0:1762166858.974756:0:32137:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee350438d80 refcount 2 committed 0 result 0 batchid 4294969129 00000020:00080000:3.0:1762166858.974801:0:32137:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee3436b7300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3504380c0 00000020:00080000:3.0:1762166858.974806:0:32137:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee3436b7f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee36e032000 00000001:00080000:2.0:1762166858.974889:0:32137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935140 is committed 00000100:00100000:2.0:1762166858.974975:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765452013312:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166858.975001:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765452013440:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762166858.975058:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166858.975085:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765452013568:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1762166858.975115:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969129 committed batchid 4294969128 00000100:00100000:3.0:1762166858.975131:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452013312 00000100:00100000:1.0:1762166858.975138:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166858.975143:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452013312 00000100:00100000:2.0:1762166858.975181:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452013568 00000100:00100000:2.0:1762166858.975188:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452013568 00000100:00100000:1.0:1762166858.975195:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762166858.975205:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765452013696:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166858.975215:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:3.0:1762166858.975228:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3295:x1847765452013312:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762166858.975239:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:1.0:1762166858.975243:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1762166858.975254:0:6533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:139 count 1 00000100:00100000:2.0:1762166858.975258:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3293:x1847765452013568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1762166858.975276:0:6532:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:140 count 1 00010000:00010000:3.0:1762166858.975277:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee348229000/0xf915a5bdf3c9faad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.975293:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fab4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.975295:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c5b expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166858.975310:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452013696 00010000:00010000:3.0:1762166858.975316:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166858.975319:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166858.975319:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f8d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dd5 expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166858.975321:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452013696 00010000:00010000:3.0:1762166858.975324:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348229000/0xf915a5bdf3c9faad lrc: 4/0,1 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.975344:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166858.975347:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166858.975350:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fab4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.975369:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c5b expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.975377:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f8d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dd5 expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00000020:00080000:0.0:1762166858.975384:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969128 00010000:00010000:3.0:1762166858.975387:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c5b expref: 27 pid: 26444 timeout: 579 lvb_type: 0 00010000:00010000:2.0:1762166858.975393:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f8d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dd5 expref: 27 pid: 26444 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1762166858.975401:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:3.0:1762166858.975403:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765452013824:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.975435:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765452013696:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762166858.975436:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765452013952:192.168.203.35@tcp:104: 00002000:00080000:1.0:1762166858.975474:0:12402:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:140 count 1 00010000:00010000:1.0:1762166858.975504:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fabb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166858.975510:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3482d79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.975511:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2446a2d80 going to sleep for 11 seconds 00010000:00010000:1.0:1762166858.975534:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f6e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d18 expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.975546:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166858.975549:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166858.975553:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fabb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.975586:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f6e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d18 expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.975599:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f6e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d18 expref: 17 pid: 26444 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1762166858.975630:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765452014080:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166858.975696:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c59600 going to sleep for 11 seconds 00000100:00100000:1.0:1762166858.975730:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166858.975810:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452013440 00000100:00100000:2.0:1762166858.975815:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452013440 00000100:00100000:2.0:1762166858.975862:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:2.0:1762166858.975873:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765452013440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1762166858.975890:0:12400:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:139 count 1 00010000:00010000:2.0:1762166858.975906:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fac2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.975921:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9f2f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b9e expref: 17 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.975930:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166858.975932:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166858.975936:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fac2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.975949:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49399:x1847765444569600:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 13709us (13832us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.975961:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 507 00010000:00010000:2.0:1762166858.975968:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9f2f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b9e expref: 17 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.975983:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9f2f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b9e expref: 17 pid: 6532 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.976010:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765452014208:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166858.976060:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2446a29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166858.977214:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765452014208:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166858.977251:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765452013824:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166858.977256:0:12400:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fac2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166858.977259:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765452014080:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166858.977280:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee348229000/0xf915a5bdf3c9faad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.977296:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fabb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.977313:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166858.977326:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765452013952:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166858.977353:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fab4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.977366:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.977403:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.977405:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444569728 00000100:00100000:3.0:1762166858.977422:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444569728 00000100:00100000:1.0:1762166858.977430:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444570112 00000100:00100000:1.0:1762166858.977437:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444570112 00000100:00100000:0.0:1762166858.977448:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166858.977453:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c5b expref: 28 pid: 26444 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1762166858.977460:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f6e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d18 expref: 18 pid: 26444 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.977468:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444569856 00000100:00100000:2.0:1762166858.977478:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444569856 00000100:00100000:1.0:1762166858.977505:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444569984 00000100:00100000:1.0:1762166858.977510:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444569984 00000100:00100000:0.0:1762166858.977515:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.977521:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 888 00010000:00010000:1.0:1762166858.977527:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f8d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dd5 expref: 30 pid: 26444 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166858.977539:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765444570112:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166858.977556:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166858.977557:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444570240 00000100:00100000:2.0:1762166858.977558:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1291 00000100:00100000:1.0:1762166858.977565:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444570240 00010000:00010000:3.0:1762166858.977570:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f6e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d18 expref: 18 pid: 26444 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.977571:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 889 00000100:00100000:2.0:1762166858.977582:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765444569856:12345-192.168.203.35@tcp:16:lfs.0 00010000:00010000:1.0:1762166858.977590:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9f2f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b9e expref: 19 pid: 6532 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.977595:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f6e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d18 expref: 19 pid: 26444 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166858.977609:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765444569728:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166858.977624:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 890 00010000:00010000:0.0:1762166858.977628:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166858.977633:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765444569984:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.977639:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c5b expref: 30 pid: 26444 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.977640:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9f6e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91d18 expref: 19 pid: 26444 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1762166858.977645:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166858.977665:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f8d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dd5 expref: 30 pid: 26444 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.977673:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.977675:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c5b expref: 30 pid: 26444 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.977678:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166858.977682:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f8d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dd5 expref: 30 pid: 26444 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.977686:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fabb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.977709:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198400/0xf915a5bdf3c9f4e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91c5b expref: 30 pid: 26444 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.977710:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765444569856:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 132us (301us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166858.977721:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a27800/0xf915a5bdf3c9f8d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91dd5 expref: 30 pid: 26444 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166858.977741:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1291 00010000:00010000:3.0:1762166858.977809:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fabb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.977815:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.977820:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166858.977821:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.977826:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166858.977828:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fab4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.977833:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee348229000/0xf915a5bdf3c9faad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.977842:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fab4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.977855:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166858.977860:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348229000/0xf915a5bdf3c9faad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.977872:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166858.977890:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166858.977903:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765444570112:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 368us (537us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166858.977903:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fabb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166858.977914:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444569984:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 275us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.977932:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444569728:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 338us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.977937:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 888 00000100:00100000:1.0:1762166858.977952:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 890 00010000:00010000:2.0:1762166858.977955:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fabb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.977967:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 889 00010000:00010000:2.0:1762166858.977974:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fabb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166858.977982:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 891 00010000:00010000:2.0:1762166858.977998:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fabb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166858.978008:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765444570240:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166858.978023:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166858.978027:0:12402:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166858.978032:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9f2f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b9e expref: 17 pid: 6532 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.978042:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9f2f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b9e expref: 17 pid: 6532 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.978052:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee382044200/0xf915a5bdf3c9f2f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91b9e expref: 17 pid: 6532 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166858.978071:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.978073:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.978076:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978081:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fac2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978122:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166858.978143:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fab4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.978153:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fab4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166858.978159:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765444570240:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 158us (649us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166858.978170:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fab4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166858.978175:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 891 00010000:00010000:1.0:1762166858.978189:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fab4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.978201:0:12400:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166858.978209:0:6532:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1762166858.978213:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.978223:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.978231:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fac2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.978250:0:12400:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1762166858.978281:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1762166858.978290:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fabb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978301:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a27a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166858.978305:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fabb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978315:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fabb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978331:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fabb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978339:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fabb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978370:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1762166858.978375:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fab4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978382:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166858.978445:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fab4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978456:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fab4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978471:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fab4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978480:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fab4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978503:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166858.978506:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fac2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978513:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166858.978517:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fac2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978526:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fac2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978542:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fac2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978550:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fac2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166858.978553:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765452013696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3123us (3309us total) trans 21474836801 rc 0/0 00000100:00100000:2.0:1762166858.978579:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00010000:00010000:3.0:1762166858.978604:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166858.978609:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166858.978610:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166858.978616:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166858.978634:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee348229000/0xf915a5bdf3c9faad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978642:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee348229000/0xf915a5bdf3c9faad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978650:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee348229000/0xf915a5bdf3c9faad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978658:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348229000/0xf915a5bdf3c9faad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.978681:0:6533:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166858.978705:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166858.978712:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee348229000/0xf915a5bdf3c9faad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.978721:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166858.978724:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348229000/0xf915a5bdf3c9faad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.978732:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348229000/0xf915a5bdf3c9faad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.978747:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee348229000/0xf915a5bdf3c9faad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.978751:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee348229000/0xf915a5bdf3c9faad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166858.978820:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166858.978825:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166858.978827:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166858.978886:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765452013568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3631us (3749us total) trans 17179869471 rc 0/0 00000100:00100000:1.0:1762166858.978896:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:0.0:1762166858.978909:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765452013440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3036us (3176us total) trans 21474836802 rc 0/0 00000100:00100000:0.0:1762166858.978921:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00010000:00010000:0.0:1762166858.978954:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1762166858.978962:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dc31c00/2, rc 0, transno 21474836802 00000004:00080000:1.0:1762166858.978966:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dc33100/2, rc 0, transno 21474836801 00000100:00100000:2.0:1762166858.978975:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765452013440:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166858.978976:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765452013696:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1762166858.979009:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de00000/2, rc 0, transno 17179869471 00000100:00100000:1.0:1762166858.979015:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765452013568:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166858.979162:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3295:x1847765452013312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3938us (4105us total) trans 17179869472 rc 0/0 00000100:00100000:3.0:1762166858.979170:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000004:00080000:2.0:1762166858.979215:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de02680/2, rc 0, transno 17179869472 00000100:00100000:2.0:1762166858.979224:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765452013312:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762166858.984897:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.984954:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444570368 00000100:00100000:3.0:1762166858.984964:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444570368 00000100:00100000:3.0:1762166858.985012:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1292 00000100:00100000:3.0:1762166858.985021:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444570368:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762166858.985073:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fac9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.985088:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.985107:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.985112:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fac9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.985127:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fac9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.985156:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fac9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.985164:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fac9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.985170:0:6533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fac9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.985175:0:6533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166858.985178:0:6533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fac9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.985184:0:6533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fac9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.985196:0:6533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fac9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.985203:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fac9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166858.985284:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444570368:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 263us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.985292:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1292 00000100:00100000:0.0:1762166858.986422:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.986478:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444570624 00000100:00100000:3.0:1762166858.986484:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444570624 00000100:00100000:3.0:1762166858.986528:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 508 00000100:00100000:3.0:1762166858.986537:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49399:x1847765444570624:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166858.986580:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166858.986612:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9fa6e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x43:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e5a expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.986625:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x43:0x0].0x0 (ffff9ee363960100) 00010000:00010000:3.0:1762166858.986633:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166858.986656:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9fad0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.986664:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9fad0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.986669:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9fad0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:3.0:1762166858.986843:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000ca21b5c reply state 000000007ed633e5 transno 8589935141 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9fad0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166858.986850:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166858.986915:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49399:x1847765444570624:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 378us (507us total) trans 8589935141 rc 0/0 00000100:00100000:3.0:1762166858.986931:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 508 00010000:00010000:0.0:1762166858.987670:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9fad0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.987679:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9fad0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.987683:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9fad0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.987686:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166858.987689:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9fad0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.987693:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9fad0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.987701:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x43:0x0].0x0 (ffff9ee363960f00) 00010000:00010000:0.0:1762166858.987703:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166858.987705:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9fad0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166858.987708:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3c9fad0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166858.987855:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.987893:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444570752 00000100:00100000:3.0:1762166858.987899:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444570752 00000100:00100000:3.0:1762166858.987967:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 509 00000100:00100000:3.0:1762166858.987976:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49399:x1847765444570752:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.987990:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.988002:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fad7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e84 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.988038:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fad7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e84 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.988049:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fad7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e84 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.988063:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x43:0x0].0x0 (ffff9ee363960200) 00010000:00010000:3.0:1762166858.988067:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166858.988070:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228200, rc 0) 00000100:00100000:3.0:1762166858.988105:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49399:x1847765444570752:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 131us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.988109:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 509 00000100:00100000:1.0:1762166858.989137:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.989214:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444570880 00000100:00100000:3.0:1762166858.989223:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444570880 00000100:00100000:3.0:1762166858.989270:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1293 00000100:00100000:3.0:1762166858.989278:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49399:x1847765444570880:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166858.989294:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166858.989325:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fade lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e8b expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.989355:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fa75 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e61 expref: 27 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166858.989364:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.989366:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.989370:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fade lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e8b expref: 27 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.989429:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fa75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e61 expref: 27 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166858.989450:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fa75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e61 expref: 27 pid: 26444 timeout: 579 lvb_type: 1 00000100:00100000:3.0:1762166858.989466:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765452014336:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166858.989562:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3482d7000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166858.990643:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765452014336:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166858.990679:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fade lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e8b expref: 27 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.990699:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348229800, rc 0) 00000100:00100000:1.0:1762166858.990705:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.990755:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444571008 00000100:00100000:0.0:1762166858.990785:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444571008 00010000:00010000:0.0:1762166858.990823:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fa75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e61 expref: 28 pid: 26444 timeout: 579 lvb_type: 1 00000100:00100000:3.0:1762166858.990824:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49399:x1847765444570880:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1543us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.990844:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1293 00000100:00100000:0.0:1762166858.990874:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 892 00000100:00100000:0.0:1762166858.990886:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444571008:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166858.990912:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166858.990936:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fa75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e61 expref: 27 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:0.0:1762166858.990949:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fa75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e61 expref: 27 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:0.0:1762166858.990972:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fa75 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e61 expref: 27 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:0.0:1762166858.990984:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.990986:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.990992:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fade lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e8b expref: 26 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.991002:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fade lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e8b expref: 26 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.991037:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fade lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e8b expref: 26 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166858.991050:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765452014464:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762166858.991122:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.992331:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765452014464:192.168.203.35@tcp:105: 00010000:00010000:0.0:1762166858.992347:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166858.992354:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.992392:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444571008:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1507us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.992393:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444571136 00000100:00100000:3.0:1762166858.992399:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444571136 00000100:00100000:0.0:1762166858.992424:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 892 00000100:00100000:0.0:1762166858.992505:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1294 00000100:00100000:0.0:1762166858.992517:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765444571136:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166858.992742:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x8d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166858.992745:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x8d:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:0.0:1762166858.992747:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x8d:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:0.0:1762166858.992748:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8d:0x0] updating lvb ctime from disk: 0 -> 1762166859 00002000:00010000:0.0:1762166858.992749:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x8d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166858.992790:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444571136:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 277us (440us total) trans 17179869473 rc 0/0 00000100:00100000:0.0:1762166858.992795:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1294 00000100:00100000:2.0:1762166858.993801:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166858.993830:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444571392 00000100:00100000:3.0:1762166858.993848:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444571392 00000100:00100000:3.0:1762166858.993890:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 510 00000100:00100000:3.0:1762166858.993896:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49399:x1847765444571392:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166858.993933:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166858.993950:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fa59 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e4c expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.993963:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:3.0:1762166858.993965:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166858.993995:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3c9fae5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.994007:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3c9fae5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166858.994016:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3c9fae5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:3.0:1762166858.994109:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e78bac87 reply state 0000000014877dd0 transno 8589935142 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3c9fae5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166858.994115:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166858.994170:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49399:x1847765444571392:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 274us (408us total) trans 8589935142 rc 0/0 00000100:00100000:3.0:1762166858.994174:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 510 00010000:00010000:2.0:1762166858.995287:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3c9fae5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.995296:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3c9fae5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.995301:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3c9fae5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.995305:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166858.995308:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3c9fae5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.995312:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3c9fae5 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.995322:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:2.0:1762166858.995325:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166858.995327:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3c9fae5 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166858.995332:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3c9fae5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166858.995347:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.995420:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444571520 00000100:00100000:0.0:1762166858.995428:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444571520 00000100:00100000:0.0:1762166858.995471:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1295 00000100:00100000:0.0:1762166858.995478:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:49399:x1847765444571520:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166858.995489:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166858.995499:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9faec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e92 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.995523:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9faa6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e7d expref: 17 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.995532:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.995535:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166858.995539:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9faec lrc: 4/0,0 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e92 expref: 17 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.995590:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9faa6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e7d expref: 17 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166858.995604:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9faa6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e7d expref: 17 pid: 26444 timeout: 579 lvb_type: 1 00000100:00100000:0.0:1762166858.995618:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765452014592:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166858.995673:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166858.996943:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765452014592:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166858.996972:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9faec lrc: 3/0,0 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e92 expref: 17 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166858.996989:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198a00, rc 0) 00000100:00100000:1.0:1762166858.997003:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.997042:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:49399:x1847765444571520:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1559us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.997051:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1295 00000100:00100000:3.0:1762166858.997117:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444571648 00000100:00100000:3.0:1762166858.997124:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444571648 00010000:00010000:3.0:1762166858.997189:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9faa6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e7d expref: 17 pid: 26444 timeout: 579 lvb_type: 1 00000100:00100000:3.0:1762166858.997234:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 893 00000100:00100000:3.0:1762166858.997242:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765444571648:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166858.997255:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166858.997274:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9faa6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e7d expref: 17 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:3.0:1762166858.997287:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9faa6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e7d expref: 17 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:3.0:1762166858.997308:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9faa6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e7d expref: 17 pid: 26444 timeout: 579 lvb_type: 1 00010000:00010000:3.0:1762166858.997319:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.997322:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166858.997326:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9faec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e92 expref: 16 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.997336:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9faec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e92 expref: 16 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166858.997364:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9faec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e92 expref: 16 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166858.997375:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765452014720:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762166858.997447:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3482d7000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166858.998456:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765452014720:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762166858.998469:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166858.998504:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444571648:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1262us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.998513:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 893 00000100:00100000:2.0:1762166858.998547:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166858.998628:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444571776 00000100:00100000:0.0:1762166858.998634:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444571776 00000100:00100000:0.0:1762166858.998669:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1296 00000100:00100000:0.0:1762166858.998678:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444571776:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762166858.998887:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x8d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166858.998890:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x8d:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166858.998893:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x8d:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:0.0:1762166858.998896:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x8d:0x0] updating lvb ctime from disk: 1762166859 -> 1762166859 00002000:00010000:0.0:1762166858.998907:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x8d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166858.998947:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765444571776:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 270us (402us total) trans 21474836803 rc 0/0 00000100:00100000:0.0:1762166858.998954:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1296 00000100:00100000:2.0:1762166859.000345:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166859.000483:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444572032 00000100:00100000:1.0:1762166859.000490:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444572032 00000100:00100000:1.0:1762166859.000539:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 219 00000100:00100000:1.0:1762166859.000549:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348213450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49399:x1847765444572032:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166859.000610:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3c9fa83 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e68 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.000643:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9faf3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.000670:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f9b1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e14 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.000677:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f9fe lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e29 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.000684:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9faf3 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.000714:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f9fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e29 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.000724:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f9fe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e29 expref: 27 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1762166859.000734:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452014848:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166859.000830:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f9b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e14 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.000839:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f9b1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e14 expref: 27 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1762166859.000848:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc29180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452014976:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166859.000871:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c596c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166859.001880:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452014848:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166859.001896:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc29180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452014976:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166859.001920:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9faf3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166859.001977:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.002013:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444572416 00000100:00100000:0.0:1762166859.002019:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444572416 00000100:00100000:0.0:1762166859.002057:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 220 00000100:00100000:0.0:1762166859.002066:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:43349:x1847765444572416:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1762166859.002160:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.002188:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444572160 00000100:00100000:3.0:1762166859.002194:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444572160 00010000:00010000:3.0:1762166859.002218:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f9b1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e14 expref: 30 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166859.002235:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:43349:x1847765444572416:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 170us (259us total) trans 8589935143 rc 0/0 00000100:00100000:0.0:1762166859.002244:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 220 00000100:00100000:3.0:1762166859.002254:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 894 00000100:00100000:3.0:1762166859.002265:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444572160:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.002275:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.002281:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f9b1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e14 expref: 29 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.002291:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f9b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e14 expref: 29 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.002305:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9f9b1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e14 expref: 29 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.002332:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:3.0:1762166859.002337:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9faf3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.002346:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9faf3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.002366:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166859.002386:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444572160:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 124us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166859.002391:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 894 00000100:00100000:2.0:1762166859.003370:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.003676:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444572544 00000100:00100000:3.0:1762166859.003681:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444572544 00010000:00010000:3.0:1762166859.003698:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f9fe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e29 expref: 28 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166859.003722:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 895 00000100:00100000:3.0:1762166859.003727:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444572544:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.003744:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.003749:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f9fe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e29 expref: 28 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.003790:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f9fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e29 expref: 28 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.003808:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9f9fe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e29 expref: 28 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.003821:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:3.0:1762166859.003825:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9faf3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.003832:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9faf3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.003851:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9faf3 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.003877:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166859.003902:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9faf3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.003910:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9faf3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166859.003919:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444572544:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 190us (552us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166859.003926:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fafa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166859.003928:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 895 00010000:00010000:0.0:1762166859.003939:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fad7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e84 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.003945:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fafa lrc: 4/0,1 mode: --/EX res: [0x200000404:0x43:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.003974:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fad7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e84 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.003984:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fad7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e84 expref: 26 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166859.003994:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452015104:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166859.004053:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166859.005172:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452015104:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166859.005189:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fafa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x43:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:2.0:1762166859.005294:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.005335:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444572672 00000100:00100000:3.0:1762166859.005341:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444572672 00010000:00010000:3.0:1762166859.005402:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fad7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e84 expref: 27 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166859.005443:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 896 00000100:00100000:3.0:1762166859.005453:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444572672:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.005463:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.005468:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fad7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e84 expref: 27 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.005478:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fad7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e84 expref: 27 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.005491:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fad7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x43:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e84 expref: 27 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.005502:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x43:0x0].0x0 (ffff9ee363960200) 00010000:00010000:3.0:1762166859.005505:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fafa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x43:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.005524:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fafa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x43:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.005530:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fafa lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x43:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.005551:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166859.005577:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fafa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.005586:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fafa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166859.005592:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444572672:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 139us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166859.005600:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 896 00000100:00100000:0.0:1762166859.005966:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452015232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166859.006000:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166859.006023:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166859.006038:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452015232 00000100:00100000:2.0:1762166859.006043:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452015232 00000100:00100000:2.0:1762166859.006106:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1762166859.006106:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166859.006118:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30821:x1847765452015232:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166859.006187:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30821:x1847765452015232:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 71us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.006195:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1762166859.006213:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452015232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166859.006262:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452015360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166859.006286:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166859.006306:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166859.006322:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452015360 00000100:00100000:2.0:1762166859.006327:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452015360 00000100:00080000:0.0:1762166859.006351:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166859.006362:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1762166859.006370:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:30821:x1847765452015360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166859.006444:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:30821:x1847765452015360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 76us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.006450:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1762166859.006489:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452015360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1762166859.006650:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935144 00000100:00100000:0.0:1762166859.006699:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452015488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166859.006724:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166859.006752:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166859.006818:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452015488 00000100:00100000:2.0:1762166859.006824:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452015488 00000100:00100000:2.0:1762166859.006858:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1762166859.006866:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:30821:x1847765452015488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166859.007013:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:30821:x1847765452015488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 142us (282us total) trans 17179869474 rc 0/0 00000100:00100000:2.0:1762166859.007020:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1762166859.007299:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452015488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1762166859.007367:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935145 00010000:00010000:0.0:1762166859.007394:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fafa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.007403:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fafa lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.007422:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fafa lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.007428:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166859.007432:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fafa lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.007440:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fafa lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.007453:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x43:0x0].0x0 (ffff9ee363960200) 00010000:00010000:0.0:1762166859.007456:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166859.007460:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fafa lrc: 2/0,0 mode: --/EX res: [0x200000404:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.007466:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fafa lrc: 0/0,0 mode: --/EX res: [0x200000404:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.007484:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9faf3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.007497:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9faf3 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.007502:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9faf3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.007507:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a27000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166859.007510:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9faf3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.007516:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9faf3 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.007524:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166859.007526:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166859.007529:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9faf3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.007535:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9faf3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.007546:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166859.007549:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166859.007555:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3c9fa83 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e68 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166859.007630:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348213450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49399:x1847765444572032:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 7083us (7287us total) trans 8589935146 rc 0/0 00000100:00100000:0.0:1762166859.007639:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 219 00000020:00080000:0.0:1762166859.007643:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166859.008721:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.008785:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444572800 00000100:00100000:3.0:1762166859.008793:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444572800 00000100:00100000:3.0:1762166859.008861:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 511 00000100:00100000:3.0:1762166859.008870:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49399:x1847765444572800:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.008908:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.008931:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fb01 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91e99 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.008980:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fb01 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e99 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.008989:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fb01 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e99 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.009000:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166859.009002:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166859.009004:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2600, rc 0) 00000100:00100000:2.0:1762166859.009041:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49399:x1847765444572800:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 173us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.009045:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 511 00000100:00100000:1.0:1762166859.010230:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.010378:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444573056 00000100:00100000:0.0:1762166859.010395:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444573056 00000100:00100000:0.0:1762166859.010457:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 221 00000100:00100000:0.0:1762166859.010468:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49399:x1847765444573056:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166859.010668:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49399:x1847765444573056:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 192us (431us total) trans 8589935147 rc 0/0 00000100:00100000:0.0:1762166859.010680:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 221 00000100:00100000:1.0:1762166859.011627:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.011673:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444573312 00000100:00100000:0.0:1762166859.011678:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444573312 00000100:00100000:0.0:1762166859.011706:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 222 00000100:00100000:0.0:1762166859.011711:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49399:x1847765444573312:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:0.0:1762166859.011928:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x43:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166859.012072:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb08 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.012087:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb08 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.012098:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb08 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.012107:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb08 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.012113:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb08 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.012119:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb08 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.012138:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166859.012170:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166859.012177:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb08 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166859.012183:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166859.012187:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb08 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166859.012192:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb08 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166859.012201:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x43:0x0].0x0 (ffff9ee34bdb4000) 00010000:00010000:2.0:1762166859.012204:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166859.012207:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb08 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166859.012210:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb08 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166859.012218:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49399:x1847765444573312:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 503us (591us total) trans 8589935148 rc 0/0 00010000:00010000:2.0:1762166859.012226:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166859.012229:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166859.012233:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166859.012237:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 222 00000100:00100000:2.0:1762166859.020899:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.020972:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444573440 00000100:00100000:0.0:1762166859.020983:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444573440 00000100:00100000:0.0:1762166859.021039:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 512 00000100:00100000:0.0:1762166859.021049:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49401:x1847765444573440:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166859.021071:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166859.021093:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb0f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ea0 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.021153:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb16 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021163:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb16 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021172:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb16 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021182:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb1d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021186:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb1d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021197:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb1d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021305:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9fb24 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021313:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9fb24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021332:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9fb24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166859.021362:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166859.021366:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166859.021383:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9fb24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021394:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9fb24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021399:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb16 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021403:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb16 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021420:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb16 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021424:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166859.021427:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb16 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021432:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb16 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021440:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166859.021442:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166859.021445:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb16 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021449:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb16 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021464:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb1d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021470:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb1d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021475:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb1d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021480:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166859.021483:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb1d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021488:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb1d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021496:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166859.021498:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166859.021501:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb1d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021506:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb1d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.021540:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb0f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ea0 expref: 32 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.021553:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9fb24 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ea0 expref: 31 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.021560:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:0.0:1762166859.021566:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166859.021569:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198800, rc 0) 00000100:00100000:0.0:1762166859.021621:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49401:x1847765444573440:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 575us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166859.021626:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 512 00000100:00100000:1.0:1762166859.041274:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.041590:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444573568 00000100:00100000:0.0:1762166859.041604:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444573568 00000100:00100000:0.0:1762166859.041671:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 513 00000100:00100000:0.0:1762166859.041683:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49405:x1847765444573568:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:0.0:1762166859.041790:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb2b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.041807:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb2b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.041819:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb2b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.041834:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb32 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.041842:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.041848:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.041955:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb39 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.041964:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb39 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.041988:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb39 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166859.042020:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1762166859.042025:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762166859.042036:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb39 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042048:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb2b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042055:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb2b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042062:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb2b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042068:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166859.042072:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb2b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042084:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb2b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042096:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:0.0:1762166859.042099:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166859.042103:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb2b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042109:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb2b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042121:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042132:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb32 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042138:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb32 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042143:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166859.042147:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb32 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042153:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb32 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042160:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166859.042163:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166859.042166:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb32 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042171:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb32 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042185:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb39 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042191:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb39 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042196:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb39 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042201:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166859.042204:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb39 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042215:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb39 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042223:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:0.0:1762166859.042225:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166859.042228:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb39 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.042233:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb39 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166859.042312:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49405:x1847765444573568:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 631us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166859.042320:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 513 00000100:00100000:1.0:1762166859.052389:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.052471:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444573824 00000100:00100000:0.0:1762166859.052483:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444573824 00000100:00100000:0.0:1762166859.052553:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 514 00000100:00100000:0.0:1762166859.052566:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49407:x1847765444573824:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166859.052594:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166859.052617:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb40 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ea7 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.052732:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb47 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.052747:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb47 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.052804:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb47 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166859.052845:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166859.053001:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb40 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ea7 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.053016:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb47 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ea7 expref: 33 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.053022:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:0.0:1762166859.053024:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166859.053028:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199c00, rc 0) 00000100:00100000:0.0:1762166859.053096:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49407:x1847765444573824:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 532us (717us total) trans 8589935149 rc 0/0 00000100:00100000:0.0:1762166859.053104:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 514 00000100:00100000:2.0:1762166859.055433:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.055502:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444574080 00000100:00100000:0.0:1762166859.055512:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444574080 00000100:00100000:0.0:1762166859.055560:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 515 00000100:00100000:0.0:1762166859.055569:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49407:x1847765444574080:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166859.055589:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166859.055611:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb55 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91eae expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.055690:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb5c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.055704:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9fb24 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ea0 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.055713:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb5c lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.055785:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9fb24 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ea0 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.055800:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9fb24 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ea0 expref: 34 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166859.055816:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452015616:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166859.055897:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166859.057126:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.057134:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765452015616:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166859.057168:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb5c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166859.057238:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444574208 00000100:00100000:3.0:1762166859.057246:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444574208 00010000:00010000:3.0:1762166859.057281:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9fb24 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ea0 expref: 35 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166859.057317:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 897 00000100:00100000:3.0:1762166859.057327:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444574208:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.057341:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.057348:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9fb24 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ea0 expref: 35 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.057359:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9fb24 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ea0 expref: 35 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.057391:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198800/0xf915a5bdf3c9fb24 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ea0 expref: 35 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.057401:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:3.0:1762166859.057404:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb5c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166859.057422:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb5c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166859.057427:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb5c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166859.057446:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166859.057471:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb5c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.057481:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb5c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762166859.057492:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765444574208:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 167us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166859.057498:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 897 00000004:00200000:0.0:1762166859.057499:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166859.057647:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb55 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91eae expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.057661:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb5c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91eae expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.057666:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:0.0:1762166859.057668:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166859.057670:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198600, rc 0) 00000100:00100000:0.0:1762166859.057713:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49407:x1847765444574080:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2144us (2287us total) trans 8589935150 rc 0/0 00000100:00100000:0.0:1762166859.057721:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 515 00000100:00100000:1.0:1762166859.058969:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.059014:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444574336 00000100:00100000:0.0:1762166859.059020:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444574336 00000100:00100000:0.0:1762166859.059059:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 223 00000100:00100000:0.0:1762166859.059065:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49407:x1847765444574336:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:0.0:1762166859.059181:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49407:x1847765444574336:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 115us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166859.059188:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 223 00000100:00100000:1.0:1762166859.060570:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.060635:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444574592 00000100:00100000:0.0:1762166859.060645:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444574592 00000100:00100000:0.0:1762166859.060709:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 224 00000100:00100000:0.0:1762166859.060721:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49407:x1847765444574592:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166859.061023:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49407:x1847765444574592:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 304us (462us total) trans 8589935151 rc 0/0 00000100:00100000:0.0:1762166859.061033:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 224 00000100:00100000:2.0:1762166859.062132:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.062189:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444574848 00000100:00100000:0.0:1762166859.062201:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444574848 00000100:00100000:0.0:1762166859.062249:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 516 00000100:00100000:0.0:1762166859.062259:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49407:x1847765444574848:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166859.062281:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166859.062284:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166859.062308:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fb5c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91eae expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.062358:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fb47 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ea7 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.062368:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:0.0:1762166859.062372:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166859.062385:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb6a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91eb5 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.062489:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9fb71 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.062498:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9fb71 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166859.062505:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9fb71 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762166859.062512:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1762166859.062600:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fb6a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91eb5 expref: 36 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.062609:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9fb71 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91eb5 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.062614:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:0.0:1762166859.062616:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166859.062617:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199400, rc 0) 00000100:00100000:0.0:1762166859.062660:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49407:x1847765444574848:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 404us (535us total) trans 8589935152 rc 0/0 00000100:00100000:0.0:1762166859.062671:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 516 00000100:00100000:1.0:1762166859.063756:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.063833:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444575104 00000100:00100000:0.0:1762166859.063841:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444575104 00000100:00100000:0.0:1762166859.063875:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 225 00000100:00100000:0.0:1762166859.063882:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358650450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49407:x1847765444575104:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166859.063922:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9fb71 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91eb5 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.063940:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb7f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.063948:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fb01 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e99 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.063953:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb7f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.063978:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fb01 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e99 expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.063990:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fb01 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e99 expref: 35 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166859.064003:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452015744:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166859.064083:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166859.064999:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452015744:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166859.065020:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb7f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166859.065205:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.065302:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444575232 00000100:00100000:3.0:1762166859.065315:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444575232 00010000:00010000:3.0:1762166859.065346:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fb01 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e99 expref: 36 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166859.065382:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 898 00000100:00100000:3.0:1762166859.065392:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765444575232:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.065419:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.065426:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fb01 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e99 expref: 36 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.065451:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fb01 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e99 expref: 36 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.065467:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fb01 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e99 expref: 36 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.065480:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:3.0:1762166859.065485:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb7f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.065492:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb7f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.065499:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb7f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.065522:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166859.065555:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb7f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166859.065559:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444575232:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 167us (351us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166859.065569:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb7f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166859.065574:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 898 00010000:00010000:0.0:1762166859.065813:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb7f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.065822:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb7f lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.065830:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb7f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.065836:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166859.065840:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb7f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.065847:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb7f lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.065856:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:0.0:1762166859.065859:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166859.065863:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb7f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.065869:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fb7f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.065878:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:0.0:1762166859.065881:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166859.065891:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9fb71 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91eb5 expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166859.066007:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358650450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49407:x1847765444575104:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2124us (2255us total) trans 8589935153 rc -22/-22 00000100:00100000:0.0:1762166859.066015:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 225 00000100:00100000:1.0:1762166859.066821:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.066856:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444575360 00000100:00100000:0.0:1762166859.066862:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444575360 00000100:00100000:0.0:1762166859.066898:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 517 00000100:00100000:0.0:1762166859.066904:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3819b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49407:x1847765444575360:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166859.066918:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166859.066930:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9fb86 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ebc expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.066960:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9fb86 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ebc expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.066969:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9fb86 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ebc expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.066989:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166859.066993:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166859.066995:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199e00, rc 0) 00000100:00100000:0.0:1762166859.067034:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3819b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49407:x1847765444575360:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 129us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166859.067040:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 517 00000100:00100000:1.0:1762166859.068343:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.068397:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444575616 00000100:00100000:2.0:1762166859.068403:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444575616 00000100:00100000:2.0:1762166859.068445:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 518 00000100:00100000:2.0:1762166859.068452:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49407:x1847765444575616:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.068463:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.068474:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fb8d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ec3 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.068904:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fb94 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.068922:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fb94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.068932:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fb94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166859.068942:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x44:0x0]: returning size 0 00010000:00010000:2.0:1762166859.068974:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fb8d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ec3 expref: 38 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.068986:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fb94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ec3 expref: 37 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.068995:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x44:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166859.068997:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166859.068998:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3e00, rc 0) 00000100:00100000:2.0:1762166859.069037:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49407:x1847765444575616:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 585us (696us total) trans 8589935154 rc 0/0 00000100:00100000:2.0:1762166859.069043:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 518 00000100:00100000:1.0:1762166859.070222:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.070259:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444575872 00000100:00100000:2.0:1762166859.070264:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444575872 00000100:00100000:2.0:1762166859.070298:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 519 00000100:00100000:2.0:1762166859.070304:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49407:x1847765444575872:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.070317:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.070327:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fba2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91eca expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.070376:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fba9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.070384:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fba9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.070389:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fba9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166859.070397:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166859.070469:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fba2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91eca expref: 40 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.070484:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fba9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91eca expref: 39 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.070490:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:2.0:1762166859.070492:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166859.070494:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3a00, rc 0) 00000100:00100000:2.0:1762166859.070524:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49407:x1847765444575872:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 221us (307us total) trans 8589935155 rc 0/0 00000100:00100000:2.0:1762166859.070528:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 519 00000100:00100000:1.0:1762166859.071431:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.071465:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444576128 00000100:00100000:0.0:1762166859.071470:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444576128 00000100:00100000:0.0:1762166859.071508:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 226 00000100:00100000:0.0:1762166859.071514:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49407:x1847765444576128:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166859.071548:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fba9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91eca expref: 39 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.071566:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fbb7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.071574:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9fb86 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ebc expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.071579:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fbb7 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.071601:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9fb86 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ebc expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.071609:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9fb86 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ebc expref: 39 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166859.071618:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452015872:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166859.071676:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166859.072531:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452015872:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166859.072548:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fbb7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166859.072731:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.072818:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444576256 00000100:00100000:3.0:1762166859.072824:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444576256 00010000:00010000:3.0:1762166859.072846:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9fb86 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ebc expref: 40 pid: 30817 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166859.072875:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 899 00000100:00100000:3.0:1762166859.072882:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2361:x1847765444576256:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.072893:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.072906:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9fb86 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ebc expref: 40 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.072916:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9fb86 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ebc expref: 40 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.072932:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9fb86 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ebc expref: 40 pid: 30817 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.072948:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:3.0:1762166859.072952:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fbb7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.072961:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fbb7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.072967:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fbb7 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.072986:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166859.073020:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444576256:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 136us (288us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166859.073021:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fbb7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.073033:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fbb7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166859.073034:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 899 00010000:00010000:0.0:1762166859.073051:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fbbe lrc: 3/0,1 mode: --/EX res: [0x200000404:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.073060:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fb94 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ec3 expref: 38 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.073065:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fbbe lrc: 4/0,1 mode: --/EX res: [0x200000404:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.073082:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fb94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ec3 expref: 38 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.073089:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fb94 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ec3 expref: 38 pid: 32138 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166859.073097:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452016000:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166859.073148:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166859.074122:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452016000:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166859.074137:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fbbe lrc: 3/0,1 mode: --/EX res: [0x200000404:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166859.074280:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.074321:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444576384 00000100:00100000:3.0:1762166859.074327:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444576384 00010000:00010000:3.0:1762166859.074386:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fb94 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ec3 expref: 39 pid: 32138 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166859.074426:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 900 00000100:00100000:3.0:1762166859.074434:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444576384:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.074455:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.074461:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fb94 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ec3 expref: 39 pid: 32138 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.074471:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fb94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ec3 expref: 39 pid: 32138 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.074485:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fb94 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ec3 expref: 39 pid: 32138 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.074498:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x44:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:3.0:1762166859.074502:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fbbe lrc: 3/0,1 mode: --/EX res: [0x200000404:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.074509:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fbbe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.074515:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fbbe lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.074536:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166859.074558:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fbbe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x44:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.074566:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fbbe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x44:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166859.074577:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2361:x1847765444576384:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 143us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166859.074585:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 900 00000100:00100000:0.0:1762166859.075038:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452016128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166859.075077:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166859.075111:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166859.075120:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452016128 00000100:00100000:2.0:1762166859.075126:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452016128 00000100:00100000:2.0:1762166859.075154:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1762166859.075159:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:30821:x1847765452016128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166859.075229:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:30821:x1847765452016128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 68us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.075236:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1762166859.075261:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452016128:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1762166859.075301:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935156 00000001:00080000:0.0:1762166859.075359:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935157 00010000:00010000:0.0:1762166859.075381:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fbbe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x44:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.075390:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fbbe lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x44:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.075396:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fbbe lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x44:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.075403:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166859.075421:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fbbe lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x44:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.075428:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fbbe lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x44:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.075438:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x44:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:0.0:1762166859.075441:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166859.075445:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fbbe lrc: 2/0,0 mode: --/EX res: [0x200000404:0x44:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.075451:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fbbe lrc: 0/0,0 mode: --/EX res: [0x200000404:0x44:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.075468:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fbb7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.075474:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fbb7 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.075489:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fbb7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.075494:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166859.075497:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fbb7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.075502:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fbb7 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.075510:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166859.075513:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166859.075515:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fbb7 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.075521:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fbb7 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.075531:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee34bdb4900) 00010000:00010000:0.0:1762166859.075533:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166859.075538:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fba9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91eca expref: 40 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166859.075607:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49407:x1847765444576128:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 4092us (4179us total) trans 8589935158 rc 0/0 00000100:00100000:0.0:1762166859.075616:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 226 00000020:00080000:0.0:1762166859.075619:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166859.076745:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.076806:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444576512 00000100:00100000:2.0:1762166859.076814:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444576512 00000100:00100000:2.0:1762166859.076856:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 520 00000100:00100000:2.0:1762166859.076865:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49407:x1847765444576512:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.076882:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.076900:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fbc5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ed1 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.076946:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fbc5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ed1 expref: 40 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.076959:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fbc5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ed1 expref: 40 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.076990:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01600) 00010000:00010000:2.0:1762166859.076994:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166859.076997:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3000, rc 0) 00000100:00100000:2.0:1762166859.077042:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49407:x1847765444576512:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 178us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.077050:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 520 00000100:00100000:1.0:1762166859.078177:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.078218:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444576768 00000100:00100000:0.0:1762166859.078224:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444576768 00000100:00100000:0.0:1762166859.078262:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 227 00000100:00100000:0.0:1762166859.078271:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49407:x1847765444576768:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:0.0:1762166859.078682:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x44:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1762166859.078809:0:30821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].20, 64 off9664 00000001:00080000:0.0:1762166859.078824:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935159 00010000:00010000:0.0:1762166859.078870:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9fbcc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.078884:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9fbcc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.078894:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9fbcc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.078902:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9fbcc lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.078909:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9fbcc lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.078915:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9fbcc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.078942:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1762166859.079044:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49407:x1847765444576768:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 774us (870us total) trans 8589935160 rc 0/0 00000100:00100000:0.0:1762166859.079053:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 227 00000020:00080000:0.0:1762166859.079058:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762166859.079095:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166859.079103:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9fbcc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.079110:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166859.079114:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9fbcc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.079131:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9fbcc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.079144:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x44:0x0].0x0 (ffff9ee34bdb4400) 00010000:00010000:3.0:1762166859.079148:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166859.079151:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9fbcc lrc: 1/0,0 mode: --/PW res: [0x200000404:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.079155:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199400/0xf915a5bdf3c9fbcc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.079168:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166859.079169:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166859.079171:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166859.080245:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.080299:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444577024 00000100:00100000:0.0:1762166859.080307:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444577024 00000100:00100000:0.0:1762166859.080353:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 228 00000100:00100000:0.0:1762166859.080362:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49407:x1847765444577024:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166859.080607:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49407:x1847765444577024:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 245us (373us total) trans 8589935161 rc 0/0 00000100:00100000:0.0:1762166859.080614:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 228 00000100:00100000:1.0:1762166859.089850:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.089898:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444577152 00000100:00100000:2.0:1762166859.089907:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444577152 00000100:00100000:2.0:1762166859.089951:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 521 00000100:00100000:2.0:1762166859.089959:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49409:x1847765444577152:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166859.089980:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.089997:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fbd3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ed8 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.090044:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fbda lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090053:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fbda lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090061:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fbda lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090069:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbe1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090073:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090094:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090193:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9fbe8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090199:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9fbe8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090204:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9fbe8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166859.090229:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166859.090232:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166859.090243:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9fbe8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090251:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9fbe8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090256:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fbda lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090260:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fbda lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090264:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fbda lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090267:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166859.090270:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fbda lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090275:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fbda lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090282:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166859.090284:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166859.090288:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fbda lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090291:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fbda lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090299:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090302:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbe1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090306:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbe1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090309:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166859.090310:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbe1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090314:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbe1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090320:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01500) 00010000:00010000:2.0:1762166859.090321:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166859.090324:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbe1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090329:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbe1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.090358:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fbd3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ed8 expref: 45 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.090386:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9fbe8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ed8 expref: 44 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.090392:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01600) 00010000:00010000:2.0:1762166859.090395:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166859.090397:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2c00, rc 0) 00000100:00100000:2.0:1762166859.090466:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49409:x1847765444577152:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 507us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.090473:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 521 00000100:00100000:1.0:1762166859.091846:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.091897:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444577280 00000100:00100000:0.0:1762166859.091911:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444577280 00000100:00100000:0.0:1762166859.091971:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1297 00000100:00100000:0.0:1762166859.091980:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444577280:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:0.0:1762166859.091999:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166859.092015:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fbef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91edf expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166859.092071:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765452016256:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166859.092160:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166859.092951:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765452016256:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166859.092978:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fbef lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91edf expref: 28 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166859.092994:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fbef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91edf expref: 28 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166859.093003:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199200, rc 0) 00000100:00100000:0.0:1762166859.093047:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444577280:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 1069us (1204us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166859.093053:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1297 00000100:00100000:1.0:1762166859.104171:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.104226:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444577408 00000100:00100000:2.0:1762166859.104236:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444577408 00000100:00100000:2.0:1762166859.104294:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 522 00000100:00100000:2.0:1762166859.104305:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49413:x1847765444577408:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166859.104369:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fbf6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104385:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fbf6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104395:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fbf6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104425:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbfd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104432:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbfd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104438:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbfd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104536:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fc04 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104544:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fc04 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104551:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fc04 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166859.104581:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166859.104585:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166859.104595:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fc04 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104607:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fbf6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104613:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fbf6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104620:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fbf6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104625:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166859.104629:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fbf6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104636:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fbf6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104649:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166859.104653:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166859.104657:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fbf6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104663:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fbf6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104675:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbfd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104681:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbfd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104687:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbfd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104692:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166859.104694:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbfd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104700:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbfd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104708:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01500) 00010000:00010000:2.0:1762166859.104711:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166859.104714:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbfd lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104718:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fbfd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104732:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fc04 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104739:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fc04 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104749:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fc04 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104754:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166859.104757:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fc04 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104794:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fc04 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104802:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01600) 00010000:00010000:2.0:1762166859.104805:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166859.104808:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fc04 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.104815:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fc04 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762166859.104894:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49413:x1847765444577408:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 591us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.104903:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 522 00000100:00100000:1.0:1762166859.113857:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.113915:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444577664 00000100:00100000:2.0:1762166859.113925:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444577664 00000100:00100000:2.0:1762166859.113968:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 523 00000100:00100000:2.0:1762166859.113976:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49415:x1847765444577664:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.113993:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.114010:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fc0b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ee6 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.114091:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fc12 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.114102:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fc12 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.114110:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fc12 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166859.114116:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166859.114212:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fc0b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ee6 expref: 47 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.114225:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fc12 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ee6 expref: 46 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.114231:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01600) 00010000:00010000:2.0:1762166859.114233:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166859.114247:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3200, rc 0) 00000100:00100000:2.0:1762166859.114306:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49415:x1847765444577664:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 330us (458us total) trans 8589935162 rc 0/0 00000100:00100000:2.0:1762166859.114313:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 523 00000100:00100000:1.0:1762166859.115846:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.115908:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444577792 00000100:00100000:0.0:1762166859.115915:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444577792 00000100:00100000:0.0:1762166859.115968:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1298 00000100:00100000:0.0:1762166859.115978:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444577792:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166859.115992:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166859.116006:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fc20 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91eed expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166859.116057:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765452016384:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166859.116128:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166859.117130:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765452016384:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166859.117167:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fc20 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91eed expref: 28 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166859.117194:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fc20 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91eed expref: 28 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166859.117209:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199200, rc 0) 00000100:00100000:0.0:1762166859.117263:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444577792:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1286us (1418us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166859.117272:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1298 00000100:00100000:1.0:1762166859.118632:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.118690:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444578048 00000100:00100000:2.0:1762166859.118698:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444578048 00000100:00100000:2.0:1762166859.118751:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 524 00000100:00100000:2.0:1762166859.118759:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:49415:x1847765444578048:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.118824:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.118845:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fc27 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ef4 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.118955:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fc2e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.118969:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9fbe8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ed8 expref: 47 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.118976:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fc2e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.119008:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9fbe8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ed8 expref: 47 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.119020:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9fbe8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ed8 expref: 47 pid: 32138 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166859.119036:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765452016512:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166859.119116:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2446a2240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166859.120049:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765452016512:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166859.120068:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fc2e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762166859.120266:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.120375:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444578176 00000100:00100000:3.0:1762166859.120382:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444578176 00010000:00010000:3.0:1762166859.120417:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9fbe8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ed8 expref: 48 pid: 32138 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166859.120450:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 901 00000100:00100000:3.0:1762166859.120456:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:2361:x1847765444578176:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.120466:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.120471:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9fbe8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ed8 expref: 48 pid: 32138 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.120480:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9fbe8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ed8 expref: 48 pid: 32138 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.120495:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9fbe8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ed8 expref: 48 pid: 32138 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.120526:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01600) 00010000:00010000:3.0:1762166859.120530:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fc2e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.120535:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fc2e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.120540:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fc2e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.120558:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166859.120586:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:2361:x1847765444578176:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 130us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166859.120591:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 901 00010000:00010000:2.0:1762166859.120592:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fc2e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.120602:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fc2e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166859.120617:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166859.120798:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fc27 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ef4 expref: 48 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.120814:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fc2e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ef4 expref: 47 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.120823:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01600) 00010000:00010000:2.0:1762166859.120826:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166859.120828:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3c00, rc 0) 00000100:00100000:2.0:1762166859.120865:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49415:x1847765444578048:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2106us (2238us total) trans 8589935163 rc 0/0 00000100:00100000:2.0:1762166859.120875:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 524 00000100:00100000:1.0:1762166859.122300:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.122367:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444578432 00000100:00100000:2.0:1762166859.122374:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444578432 00000100:00100000:2.0:1762166859.122429:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 525 00000100:00100000:2.0:1762166859.122439:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:49415:x1847765444578432:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.122458:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.122470:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fc3c lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91efb expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.122953:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fc43 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.122965:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fc43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.122975:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fc43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166859.122985:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x45:0x0]: returning size 0 00010000:00010000:2.0:1762166859.123020:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fc3c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91efb expref: 50 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.123037:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fc43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91efb expref: 49 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.123045:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x45:0x0].0x0 (ffff9ee359d01500) 00010000:00010000:2.0:1762166859.123049:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166859.123052:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3800, rc 0) 00000100:00100000:2.0:1762166859.123099:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49415:x1847765444578432:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 662us (801us total) trans 8589935164 rc 0/0 00000100:00100000:2.0:1762166859.123106:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 525 00000100:00100000:1.0:1762166859.124346:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.124394:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444578688 00000100:00100000:2.0:1762166859.124402:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444578688 00000100:00100000:2.0:1762166859.124455:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 526 00000100:00100000:2.0:1762166859.124466:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49415:x1847765444578688:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.124485:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.124498:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fc51 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f02 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.124558:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc58 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.124569:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fc43 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91efb expref: 50 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.124577:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc58 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.124613:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fc43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91efb expref: 50 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.124628:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fc43 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91efb expref: 50 pid: 32138 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166859.124648:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765452016640:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166859.124727:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2446a20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166859.125728:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765452016640:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166859.125749:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc58 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762166859.125911:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.126041:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444578816 00000100:00100000:3.0:1762166859.126048:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444578816 00010000:00010000:3.0:1762166859.126076:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fc43 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91efb expref: 51 pid: 32138 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166859.126111:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 902 00000100:00100000:3.0:1762166859.126119:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2361:x1847765444578816:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.126132:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.126138:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fc43 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91efb expref: 51 pid: 32138 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.126149:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fc43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91efb expref: 51 pid: 32138 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.126197:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fc43 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91efb expref: 51 pid: 32138 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.126213:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x45:0x0].0x0 (ffff9ee359d01500) 00010000:00010000:3.0:1762166859.126217:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc58 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.126224:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc58 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.126231:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc58 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.126257:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166859.126284:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc58 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.126294:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc58 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762166859.126307:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2361:x1847765444578816:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 187us (395us total) trans 0 rc 0/0 00000004:00200000:2.0:1762166859.126310:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x45:0x0]: returning size 0 00000100:00100000:3.0:1762166859.126319:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 902 00000004:00080000:2.0:1762166859.126671:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x8e:0x0], index 0: 0 00010000:00010000:2.0:1762166859.126848:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc58 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.126858:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc58 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.126865:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc58 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.126872:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166859.126877:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc58 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.126885:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc58 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.126896:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x45:0x0].0x0 (ffff9ee359d01500) 00010000:00010000:2.0:1762166859.126901:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166859.126905:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc58 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.126911:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc58 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.126965:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fc51 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f02 expref: 50 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.126975:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166859.126977:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166859.126981:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fc51 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f02 expref: 50 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.126990:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2e00, rc 0) 00000100:00100000:2.0:1762166859.127032:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49415:x1847765444578688:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2568us (2695us total) trans 8589935165 rc 301/301 00000100:00100000:2.0:1762166859.127040:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 526 00000100:00100000:1.0:1762166859.128017:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.128084:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444579072 00000100:00100000:0.0:1762166859.128092:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444579072 00000100:00100000:0.0:1762166859.128144:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 229 00000100:00100000:0.0:1762166859.128154:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:49415:x1847765444579072:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166859.128383:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49415:x1847765444579072:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 230us (366us total) trans 8589935166 rc 0/0 00000100:00100000:0.0:1762166859.128392:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 229 00000100:00100000:1.0:1762166859.129284:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.129349:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444579200 00000100:00100000:2.0:1762166859.129359:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444579200 00000100:00100000:2.0:1762166859.129426:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 527 00000100:00100000:2.0:1762166859.129437:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49415:x1847765444579200:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.129461:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.129480:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fc66 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f09 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.129551:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fc6d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.129570:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fc2e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ef4 expref: 51 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.129578:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fc6d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.129609:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fc2e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ef4 expref: 51 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.129622:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fc2e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ef4 expref: 51 pid: 32138 timeout: 579 lvb_type: 0 00000100:00100000:2.0:1762166859.129636:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765452016768:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166859.129708:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2446a2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166859.130630:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765452016768:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166859.130648:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fc6d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762166859.130755:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.130888:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444579328 00000100:00100000:3.0:1762166859.130894:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444579328 00010000:00010000:3.0:1762166859.130923:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fc2e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ef4 expref: 52 pid: 32138 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166859.130956:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 903 00000100:00100000:3.0:1762166859.130963:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:2360:x1847765444579328:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.130971:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.130976:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fc2e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ef4 expref: 52 pid: 32138 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.130995:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fc2e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ef4 expref: 52 pid: 32138 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.131010:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fc2e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ef4 expref: 52 pid: 32138 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.131022:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01600) 00010000:00010000:3.0:1762166859.131025:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fc6d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.131030:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fc6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.131034:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fc6d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.131051:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166859.131073:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fc6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762166859.131084:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:2360:x1847765444579328:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 119us (328us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166859.131086:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fc6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762166859.131099:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 903 00000004:00200000:2.0:1762166859.131128:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166859.131133:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166859.131153:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fc6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.131181:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fc66 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f09 expref: 51 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.131197:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fc6d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f09 expref: 50 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.131205:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01600) 00010000:00010000:2.0:1762166859.131208:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166859.131211:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2600, rc 0) 00000100:00100000:2.0:1762166859.131250:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49415:x1847765444579200:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1815us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.131258:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 527 00000100:00100000:1.0:1762166859.132232:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.132298:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444579456 00000100:00100000:0.0:1762166859.132304:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444579456 00000100:00100000:0.0:1762166859.132343:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1299 00000100:00100000:0.0:1762166859.132351:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765444579456:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166859.132364:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166859.132377:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fc74 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f10 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166859.132430:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765452016896:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166859.132488:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166859.133255:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765452016896:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166859.133278:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fc74 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f10 expref: 28 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166859.133293:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fc74 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f10 expref: 28 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166859.133303:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199200, rc 0) 00000100:00100000:0.0:1762166859.133339:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765444579456:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 989us (1109us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166859.133346:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1299 00000100:00100000:1.0:1762166859.134274:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.134310:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444579584 00000100:00100000:2.0:1762166859.134315:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444579584 00000100:00100000:2.0:1762166859.134348:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 528 00000100:00100000:2.0:1762166859.134354:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:49415:x1847765444579584:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.134365:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.134380:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fc7b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f17 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.134439:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fc82 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.134448:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fc82 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x45:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.134455:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fc82 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x45:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166859.134479:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x45:0x0]: returning size 0 00000004:00200000:2.0:1762166859.134482:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166859.134491:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fc82 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x45:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.134506:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fc7b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x45:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f17 expref: 52 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.134516:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fc82 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x45:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f17 expref: 51 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.134521:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x45:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166859.134523:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166859.134525:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2400, rc 0) 00000100:00100000:2.0:1762166859.134553:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49415:x1847765444579584:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 199us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.134557:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 528 00000100:00100000:1.0:1762166859.135548:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.135587:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444579712 00000100:00100000:0.0:1762166859.135593:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444579712 00000100:00100000:0.0:1762166859.135630:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1300 00000100:00100000:0.0:1762166859.135640:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765444579712:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166859.135651:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166859.135664:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fc89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f1e expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166859.135683:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166859.135696:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166859.135698:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166859.135705:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fc89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f1e expref: 18 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166859.135719:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fc89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f1e expref: 18 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166859.135728:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199a00, rc 0) 00000100:00100000:0.0:1762166859.135783:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765444579712:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 124us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166859.135792:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1300 00000100:00100000:1.0:1762166859.136877:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.136908:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444579968 00000100:00100000:2.0:1762166859.136913:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444579968 00000100:00100000:2.0:1762166859.136941:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 529 00000100:00100000:2.0:1762166859.136959:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:49415:x1847765444579968:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.136971:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.136984:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fc90 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f25 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.137049:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc97 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.137058:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc97 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.137067:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc97 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166859.137080:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166859.137185:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fc90 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f25 expref: 54 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.137197:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc97 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f25 expref: 53 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.137202:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01600) 00010000:00010000:2.0:1762166859.137204:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166859.137206:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3a00, rc 0) 00000100:00100000:2.0:1762166859.137235:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49415:x1847765444579968:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 289us (362us total) trans 8589935167 rc 0/0 00000100:00100000:2.0:1762166859.137239:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 529 00000100:00100000:1.0:1762166859.138337:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.138366:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444580096 00000100:00100000:0.0:1762166859.138371:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444580096 00000100:00100000:0.0:1762166859.138399:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1301 00000100:00100000:0.0:1762166859.138404:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765444580096:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166859.138422:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166859.138431:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fca5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f2c expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166859.138471:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765452017024:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166859.138519:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166859.139299:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765452017024:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166859.139319:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fca5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f2c expref: 28 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166859.139333:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198000/0xf915a5bdf3c9fca5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f2c expref: 28 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166859.139341:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198000, rc 0) 00000100:00100000:0.0:1762166859.139372:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765444580096:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 967us (1036us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166859.139378:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1301 00000100:00100000:1.0:1762166859.140353:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.140383:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444580224 00000100:00100000:0.0:1762166859.140388:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444580224 00000100:00100000:0.0:1762166859.140424:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1302 00000100:00100000:0.0:1762166859.140432:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765444580224:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166859.140444:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166859.140451:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fcac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f33 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166859.140486:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765452017152:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762166859.140535:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166859.141233:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765452017152:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166859.141251:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fcac lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f33 expref: 28 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166859.141265:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199200/0xf915a5bdf3c9fcac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f33 expref: 28 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166859.141276:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199200, rc 0) 00000100:00100000:0.0:1762166859.141310:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765444580224:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 878us (957us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166859.141318:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1302 00000100:00100000:1.0:1762166859.142091:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.142120:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444580352 00000100:00100000:0.0:1762166859.142125:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444580352 00000100:00100000:0.0:1762166859.142156:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1303 00000100:00100000:0.0:1762166859.142161:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765444580352:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762166859.142182:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fcb3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.142193:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fade lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e8b expref: 27 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.142198:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166859.142199:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166859.142202:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fcb3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.142216:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fade lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e8b expref: 27 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.142224:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fade lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e8b expref: 27 pid: 6533 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1762166859.142232:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765452017280:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166859.142271:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166859.142984:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765452017280:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166859.142994:0:12400:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fcb3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166859.143247:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.143348:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444580480 00000100:00100000:3.0:1762166859.143353:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444580480 00010000:00010000:3.0:1762166859.143376:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fade lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e8b expref: 28 pid: 6533 timeout: 579 lvb_type: 0 00000100:00100000:3.0:1762166859.143404:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 904 00000100:00100000:3.0:1762166859.143426:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444580480:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.143436:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.143461:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fade lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e8b expref: 28 pid: 6533 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.143471:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fade lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e8b expref: 28 pid: 6533 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.143502:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fade lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e8b expref: 28 pid: 6533 timeout: 579 lvb_type: 0 00010000:00010000:3.0:1762166859.143514:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166859.143516:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166859.143519:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fcb3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166859.143528:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fcb3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166859.143551:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166859.143566:0:12400:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fcb3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.143574:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fcb3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166859.143586:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444580480:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 161us (340us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166859.143592:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fcb3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166859.143598:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 904 00010000:00010000:0.0:1762166859.143605:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fcb3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.143611:0:12400:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fcb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.143616:0:12400:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166859.143619:0:12400:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fcb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.143624:0:12400:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fcb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.143636:0:12400:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fcb3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166859.143640:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347199c00/0xf915a5bdf3c9fcb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166859.143685:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765444580352:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 1524us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166859.143691:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1303 00000100:00100000:1.0:1762166859.144736:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.144795:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444580608 00000100:00100000:0.0:1762166859.144801:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444580608 00000100:00100000:0.0:1762166859.144834:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1304 00000100:00100000:0.0:1762166859.144843:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2358:x1847765444580608:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166859.144856:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166859.144870:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fcba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f3a expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166859.144886:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x8d:0x0] initial LVB size: 0, mtime: 0x69088847, atime: 0x69088847, ctime: 0x6908884b, blocks: 0x1 00010000:00010000:0.0:1762166859.144900:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166859.144902:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166859.144908:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fcba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f3a expref: 27 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166859.144922:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fcba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f3a expref: 27 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166859.144939:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198600, rc 0) 00000100:00100000:0.0:1762166859.144972:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765444580608:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 131us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166859.144979:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1304 00000100:00100000:1.0:1762166859.169754:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.169836:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444580736 00000100:00100000:2.0:1762166859.169847:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444580736 00000100:00100000:2.0:1762166859.169908:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 530 00000100:00100000:2.0:1762166859.169921:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:49415:x1847765444580736:12345-192.168.203.35@tcp:44:lfs.0 00010000:00010000:2.0:1762166859.176062:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1762166859.183963:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935166 is committed 00000001:00080000:3.0:1762166859.183996:0:32137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935167 is committed 00000100:00100000:2.0:1762166859.184114:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:49415:x1847765444580736:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 14187us (14359us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.184134:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 530 00000020:00080000:1.0:1762166859.184134:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee3479d7b40 refcount 2 committed 0 result 0 batchid 4294969130 00000020:00080000:1.0:1762166859.184147:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee241fa8b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3479d79c0 00000020:00080000:1.0:1762166859.184153:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee241fa8600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee36e364c00 00000020:00080000:1.0:1762166859.184203:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969129 batchid updated 00000020:00080000:3.0:1762166859.184257:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969130 committed batchid 4294969129 00000020:00080000:3.0:1762166859.184618:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969129 00000100:00100000:1.0:1762166859.185751:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166859.185838:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444580864 00000100:00100000:0.0:1762166859.185856:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444580864 00000100:00100000:0.0:1762166859.185918:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1305 00000100:00100000:0.0:1762166859.185930:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765444580864:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:0.0:1762166859.186031:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765444580864:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 103us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166859.186039:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1305 00000100:00100000:0.0:1762166859.193391:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.193494:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444580992 00000100:00100000:2.0:1762166859.193510:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444580992 00000100:00100000:2.0:1762166859.193566:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1306 00000100:00100000:2.0:1762166859.193575:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765444580992:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166859.193632:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fcc1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.193651:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166859.193653:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166859.193659:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fcc1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.193672:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fcc1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.193706:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fcc1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.193715:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fcc1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.193723:0:12400:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fcc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.193731:0:12400:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166859.193735:0:12400:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fcc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.193743:0:12400:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fcc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.193756:0:12400:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fcc1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.193801:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fcc1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166859.193899:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765444580992:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 323us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.193909:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1306 00000100:00100000:1.0:1762166859.195484:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.195563:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444581248 00000100:00100000:2.0:1762166859.195578:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444581248 00000100:00100000:2.0:1762166859.195649:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 531 00000100:00100000:2.0:1762166859.195663:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49415:x1847765444581248:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762166859.195745:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166859.195814:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fc82 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x45:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f17 expref: 26 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.195839:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x45:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166859.195855:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166859.195905:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fcc8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.195921:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fcc8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.195933:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fcc8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00010000:2.0:1762166859.196191:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003fe65b5d reply state 000000003bbf32c6 transno 8589935168 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fcc8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762166859.196206:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166859.196323:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49415:x1847765444581248:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 663us (854us total) trans 8589935168 rc 0/0 00000100:00100000:2.0:1762166859.196330:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 531 00010000:00010000:0.0:1762166859.197291:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fcc8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166859.197304:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fcc8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166859.197311:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fcc8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166859.197318:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166859.197323:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fcc8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166859.197332:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fcc8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166859.197349:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x45:0x0].0x0 (ffff9ee359d01a00) 00010000:00010000:0.0:1762166859.197353:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166859.197356:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fcc8 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166859.197361:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fcc8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762166859.197695:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.197852:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444581376 00000100:00100000:2.0:1762166859.197867:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444581376 00000100:00100000:2.0:1762166859.197945:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 532 00000100:00100000:2.0:1762166859.197959:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:49415:x1847765444581376:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.197987:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.198017:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fccf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f41 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.198074:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fccf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f41 expref: 27 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.198087:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fccf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f41 expref: 27 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.198103:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x45:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166859.198107:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166859.198110:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3e00, rc 0) 00000100:00100000:2.0:1762166859.198182:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49415:x1847765444581376:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 225us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.198189:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 532 00000100:00100000:1.0:1762166859.199396:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.199462:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444581504 00000100:00100000:2.0:1762166859.199470:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444581504 00000100:00100000:2.0:1762166859.199526:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1307 00000100:00100000:2.0:1762166859.199535:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:49415:x1847765444581504:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.199546:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.199560:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9fcd6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f48 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.199587:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fc89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f1e expref: 19 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166859.199595:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166859.199597:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166859.199601:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9fcd6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f48 expref: 19 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.199638:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fc89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f1e expref: 19 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166859.199651:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fc89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f1e expref: 19 pid: 12400 timeout: 579 lvb_type: 1 00000100:00100000:2.0:1762166859.199663:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765452017408:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166859.199743:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2446a20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166859.201946:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.202008:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765452017408:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166859.202019:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444581632 00000100:00100000:3.0:1762166859.202027:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444581632 00010000:00010000:2.0:1762166859.202041:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9fcd6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f48 expref: 20 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166859.202058:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fc89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f1e expref: 20 pid: 12400 timeout: 579 lvb_type: 1 00010000:00010000:2.0:1762166859.202073:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2000, rc 0) 00000100:00100000:3.0:1762166859.202125:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 905 00000100:00100000:3.0:1762166859.202138:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765444581632:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166859.202139:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:49415:x1847765444581504:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2602us (2747us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.202152:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1307 00010000:00010000:3.0:1762166859.202158:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.202181:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fc89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f1e expref: 19 pid: 12400 timeout: 579 lvb_type: 1 00010000:00010000:3.0:1762166859.202197:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fc89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f1e expref: 19 pid: 12400 timeout: 579 lvb_type: 1 00010000:00010000:3.0:1762166859.202220:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fc89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f1e expref: 19 pid: 12400 timeout: 579 lvb_type: 1 00010000:00010000:3.0:1762166859.202237:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166859.202239:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166859.202245:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9fcd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f48 expref: 18 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166859.202256:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9fcd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f48 expref: 18 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166859.202293:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d2000/0xf915a5bdf3c9fcd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f48 expref: 18 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166859.202308:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765452017536:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762166859.202430:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3482d79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166859.203857:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765452017536:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762166859.203915:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166859.203953:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.203958:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765444581632:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1822us (2022us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166859.203966:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 905 00000100:00100000:2.0:1762166859.204006:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444581760 00000100:00100000:2.0:1762166859.204014:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444581760 00000100:00100000:2.0:1762166859.204058:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1308 00000100:00100000:2.0:1762166859.204067:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765444581760:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166859.204292:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x8e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166859.204295:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x8e:0x0] updating lvb mtime from disk: 0 -> 1762166855 00002000:00010000:2.0:1762166859.204298:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x8e:0x0] updating lvb atime from disk: 0 -> 1762166855 00002000:00010000:2.0:1762166859.204300:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x8e:0x0] updating lvb ctime from disk: 0 -> 1762166859 00002000:00010000:2.0:1762166859.204303:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x8e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166859.204336:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765444581760:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 270us (385us total) trans 21474836804 rc 0/0 00000100:00100000:2.0:1762166859.204343:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1308 00000100:00100000:0.0:1762166859.205595:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.205658:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444582016 00000100:00100000:2.0:1762166859.205664:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444582016 00000100:00100000:2.0:1762166859.205710:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 533 00000100:00100000:2.0:1762166859.205718:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49415:x1847765444582016:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762166859.205791:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166859.205815:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fc6d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f09 expref: 27 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.205833:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01600) 00010000:00010000:2.0:1762166859.205837:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166859.205883:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcdd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.205900:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcdd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.205909:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcdd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00010000:2.0:1762166859.206020:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000068aaa23a reply state 000000000588efe3 transno 8589935169 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcdd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762166859.206030:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166859.206098:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49415:x1847765444582016:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 381us (505us total) trans 8589935169 rc 0/0 00000100:00100000:2.0:1762166859.206103:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 533 00010000:00010000:2.0:1762166859.206823:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcdd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.206834:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcdd lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.206841:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcdd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.206847:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166859.206851:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcdd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.206858:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcdd lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.206868:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01600) 00010000:00010000:2.0:1762166859.206871:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166859.206874:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcdd lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.206881:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcdd lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762166859.207193:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.207244:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444582144 00000100:00100000:2.0:1762166859.207250:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444582144 00000100:00100000:2.0:1762166859.207288:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1309 00000100:00100000:2.0:1762166859.207297:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49415:x1847765444582144:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.207313:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.207326:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fce4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f4f expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.207348:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fcba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f3a expref: 28 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166859.207356:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166859.207358:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166859.207361:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fce4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f4f expref: 28 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.207390:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fcba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f3a expref: 28 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166859.207404:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fcba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f3a expref: 28 pid: 12400 timeout: 579 lvb_type: 1 00000100:00100000:2.0:1762166859.207435:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765452017664:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166859.207498:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2446a20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166859.208463:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765452017664:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166859.208484:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fce4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f4f expref: 28 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.208499:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2e00, rc 0) 00000100:00100000:2.0:1762166859.208548:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49415:x1847765444582144:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1251us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.208555:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1309 00000100:00100000:0.0:1762166859.208620:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.208675:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444582272 00000100:00100000:3.0:1762166859.208684:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444582272 00010000:00010000:3.0:1762166859.208751:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fcba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f3a expref: 28 pid: 12400 timeout: 579 lvb_type: 1 00000100:00100000:3.0:1762166859.208860:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 906 00000100:00100000:3.0:1762166859.208869:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444582272:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.208880:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.208905:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fcba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f3a expref: 28 pid: 12400 timeout: 579 lvb_type: 1 00010000:00010000:3.0:1762166859.208916:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fcba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f3a expref: 28 pid: 12400 timeout: 579 lvb_type: 1 00010000:00010000:3.0:1762166859.208937:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fcba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f3a expref: 28 pid: 12400 timeout: 579 lvb_type: 1 00010000:00010000:3.0:1762166859.208948:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166859.208950:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166859.208955:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f4f expref: 27 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166859.208985:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fce4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f4f expref: 27 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166859.209013:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fce4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f4f expref: 27 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166859.209024:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765452017792:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762166859.209078:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3482d79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166859.210271:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.210324:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444582400 00000100:00100000:2.0:1762166859.210331:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444582400 00000100:00100000:3.0:1762166859.210346:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765452017792:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762166859.210363:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166859.210381:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1310 00000100:00100000:2.0:1762166859.210392:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444582400:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762166859.210418:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444582272:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1540us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166859.210428:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 906 00002000:00010000:2.0:1762166859.210586:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x8d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166859.210590:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x8d:0x0] updating lvb mtime from disk: 1762166855 -> 1762166855 00002000:00010000:2.0:1762166859.210593:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x8d:0x0] updating lvb atime from disk: 1762166855 -> 1762166855 00002000:00010000:2.0:1762166859.210595:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8d:0x0] updating lvb ctime from disk: 1762166859 -> 1762166859 00002000:00010000:2.0:1762166859.210597:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x8d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166859.210632:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765444582400:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 242us (365us total) trans 17179869475 rc 0/0 00000100:00100000:2.0:1762166859.210639:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1310 00000100:00100000:0.0:1762166859.211676:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166859.211725:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444582656 00000100:00100000:1.0:1762166859.211731:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444582656 00000100:00100000:1.0:1762166859.211827:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 230 00000100:00100000:1.0:1762166859.211839:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358653450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49415:x1847765444582656:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166859.211909:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc97 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f25 expref: 27 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.211958:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fceb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.211972:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fbc5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ed1 expref: 27 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.211980:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fc12 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ee6 expref: 27 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.211988:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fceb lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.212015:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fc12 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ee6 expref: 27 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.212025:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fc12 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ee6 expref: 27 pid: 32138 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1762166859.212043:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f623480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452017920:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166859.212107:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fbc5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ed1 expref: 27 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.212117:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fbc5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ed1 expref: 27 pid: 32138 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1762166859.212128:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f620e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452018048:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166859.212152:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c596c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166859.212983:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f623480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452017920:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166859.212998:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f620e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452018048:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166859.213022:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fceb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166859.213048:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.213096:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444582912 00000100:00100000:2.0:1762166859.213102:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444582912 00000100:00100000:2.0:1762166859.213134:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 231 00000100:00100000:2.0:1762166859.213146:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49238:x1847765444582912:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166859.213302:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49238:x1847765444582912:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 157us (256us total) trans 8589935170 rc 0/0 00000100:00100000:2.0:1762166859.213312:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 231 00000100:00100000:0.0:1762166859.213323:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.213389:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444583040 00000100:00100000:3.0:1762166859.213395:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444583040 00010000:00010000:3.0:1762166859.213464:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fbc5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ed1 expref: 29 pid: 32138 timeout: 580 lvb_type: 0 00000100:00100000:3.0:1762166859.213492:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 907 00000100:00100000:3.0:1762166859.213501:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765444583040:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.213512:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.213519:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fbc5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ed1 expref: 29 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.213529:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fbc5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ed1 expref: 29 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.213554:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fbc5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ed1 expref: 29 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.213565:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01600) 00010000:00010000:3.0:1762166859.213568:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fceb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.213573:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fceb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.213576:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166859.213599:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444583040:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 101us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166859.213604:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 907 00000100:00100000:0.0:1762166859.214756:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.214814:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444583168 00000100:00100000:3.0:1762166859.214824:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444583168 00010000:00010000:3.0:1762166859.214845:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fc12 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ee6 expref: 28 pid: 32138 timeout: 580 lvb_type: 0 00000100:00100000:3.0:1762166859.214873:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 908 00000100:00100000:3.0:1762166859.214881:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444583168:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.214891:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.214896:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fc12 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ee6 expref: 28 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.214908:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fc12 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ee6 expref: 28 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.214938:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fc12 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ee6 expref: 28 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.214952:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01600) 00010000:00010000:3.0:1762166859.214956:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fceb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.214964:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fceb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.214971:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fceb lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.214995:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166859.215037:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444583168:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 156us (282us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166859.215044:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fceb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166859.215048:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 908 00010000:00010000:1.0:1762166859.215063:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fceb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.215096:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fcf2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.215112:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fccf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f41 expref: 26 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.215133:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fcf2 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x45:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.215182:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fccf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f41 expref: 26 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.215197:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fccf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f41 expref: 26 pid: 32138 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1762166859.215214:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f620e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452018176:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166859.215319:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c596c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166859.216120:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f620e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452018176:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166859.216142:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fcf2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x45:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166859.216396:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.216438:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444583296 00000100:00100000:3.0:1762166859.216444:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444583296 00010000:00010000:3.0:1762166859.216509:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fccf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f41 expref: 27 pid: 32138 timeout: 580 lvb_type: 0 00000100:00100000:3.0:1762166859.216539:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 909 00000100:00100000:3.0:1762166859.216548:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444583296:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.216559:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.216564:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fccf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f41 expref: 27 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.216589:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fccf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f41 expref: 27 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.216604:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fccf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x45:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f41 expref: 27 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.216616:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x45:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:3.0:1762166859.216621:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fcf2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x45:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.216629:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fcf2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x45:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.216636:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fcf2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x45:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.216663:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166859.216704:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444583296:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 156us (309us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166859.216708:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fcf2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166859.216715:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 909 00010000:00010000:1.0:1762166859.216720:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fcf2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:1.0:1762166859.217082:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f620e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452018304:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166859.217125:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166859.217153:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c596c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166859.217174:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452018304 00000100:00100000:2.0:1762166859.217181:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452018304 00000100:00100000:2.0:1762166859.217217:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1762166859.217225:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:30821:x1847765452018304:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166859.217283:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:30821:x1847765452018304:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 61us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.217288:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1762166859.217321:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f620e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452018304:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166859.217354:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f620e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452018432:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166859.217381:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166859.217402:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3489aa840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166859.217429:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452018432 00000100:00100000:2.0:1762166859.217434:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452018432 00000100:00100000:2.0:1762166859.217461:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1762166859.217469:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30821:x1847765452018432:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166859.217520:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30821:x1847765452018432:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 53us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.217525:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1762166859.217557:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f620e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452018432:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1762166859.217698:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935171 00000100:00100000:1.0:1762166859.217745:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f620e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452018560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166859.217811:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166859.217832:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c59600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166859.217847:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452018560 00000100:00100000:2.0:1762166859.217850:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452018560 00000100:00100000:2.0:1762166859.217871:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1762166859.217875:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30821:x1847765452018560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166859.217972:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30821:x1847765452018560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 96us (162us total) trans 21474836805 rc 0/0 00000100:00100000:2.0:1762166859.217976:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1762166859.218007:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f620e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452018560:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1762166859.218065:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935172 00010000:00010000:1.0:1762166859.218104:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fcf2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.218113:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fcf2 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.218120:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fcf2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.218134:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166859.218138:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fcf2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.218146:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fcf2 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.218156:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x45:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:1.0:1762166859.218159:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166859.218163:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fcf2 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.218168:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fcf2 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.218185:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fceb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.218191:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fceb lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.218196:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fceb lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.218201:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a27a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166859.218203:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fceb lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.218209:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fceb lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.218215:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01600) 00010000:00010000:1.0:1762166859.218218:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166859.218227:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fceb lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.218233:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fceb lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.218244:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01600) 00010000:00010000:1.0:1762166859.218247:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166859.218264:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fc97 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f25 expref: 28 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166859.218350:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358653450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49415:x1847765444582656:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 6514us (6672us total) trans 8589935173 rc 0/0 00000100:00100000:1.0:1762166859.218360:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 230 00000020:00080000:1.0:1762166859.218365:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166859.219435:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.219480:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444583424 00000100:00100000:2.0:1762166859.219486:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444583424 00000100:00100000:2.0:1762166859.219520:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 534 00000100:00100000:2.0:1762166859.219528:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49415:x1847765444583424:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.219545:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.219563:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcf9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f56 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.219605:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcf9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f56 expref: 28 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.219615:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcf9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f56 expref: 28 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.219626:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166859.219628:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166859.219630:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2400, rc 0) 00000100:00100000:2.0:1762166859.219660:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49415:x1847765444583424:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 133us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.219667:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 534 00000100:00100000:0.0:1762166859.221164:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166859.221237:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444583680 00000100:00100000:1.0:1762166859.221250:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444583680 00000100:00100000:1.0:1762166859.221312:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 232 00000100:00100000:1.0:1762166859.221319:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:49415:x1847765444583680:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166859.221602:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49415:x1847765444583680:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 283us (440us total) trans 8589935174 rc 0/0 00000100:00100000:1.0:1762166859.221608:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 232 00000100:00100000:0.0:1762166859.222693:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166859.222757:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444583936 00000100:00100000:1.0:1762166859.222800:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444583936 00000100:00100000:1.0:1762166859.222859:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 233 00000100:00100000:1.0:1762166859.222870:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49415:x1847765444583936:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:1.0:1762166859.223158:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x45:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1762166859.223274:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9fd00 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.223309:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9fd00 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.223324:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9fd00 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.223334:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9fd00 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.223341:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9fd00 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.223347:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9fd00 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.223371:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166859.223420:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166859.223429:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9fd00 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.223437:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a27000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762166859.223440:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9fd00 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.223448:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9fd00 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.223462:0:32135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x45:0x0].0x0 (ffff9ee34ada3c00) 00010000:00010000:0.0:1762166859.223465:0:32135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166859.223469:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9fd00 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.223473:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9fd00 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:0.0:1762166859.223494:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166859.223496:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166859.223498:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166859.223506:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49415:x1847765444583936:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 635us (816us total) trans 8589935175 rc 0/0 00000100:00100000:1.0:1762166859.223516:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 233 00000100:00100000:0.0:1762166859.233147:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.233210:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444584064 00000100:00100000:2.0:1762166859.233222:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444584064 00000100:00100000:2.0:1762166859.233282:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 535 00000100:00100000:2.0:1762166859.233292:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49417:x1847765444584064:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166859.233313:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.233331:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9fd07 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f5d expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.233436:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fd0e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233449:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fd0e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233460:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fd0e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233472:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fd15 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233477:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fd15 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233481:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fd15 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233577:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fd1c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233586:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fd1c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233593:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fd1c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166859.233621:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166859.233625:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166859.233641:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fd1c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233652:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fd1c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233660:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fd0e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233666:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fd0e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233676:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fd0e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233682:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166859.233686:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fd0e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233693:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fd0e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233704:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166859.233707:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166859.233711:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fd0e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233716:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fd0e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233729:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fd15 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233734:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fd15 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233739:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fd15 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233744:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166859.233746:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fd15 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233751:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fd15 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233758:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01500) 00010000:00010000:2.0:1762166859.233808:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166859.233813:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fd15 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233819:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fd15 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.233855:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9fd07 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f5d expref: 32 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.233867:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fd1c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f5d expref: 31 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.233874:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166859.233876:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166859.233878:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3a00, rc 0) 00000100:00100000:2.0:1762166859.233936:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49417:x1847765444584064:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 645us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.233944:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 535 00000100:00100000:2.0:1762166859.246931:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.246986:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444584192 00000100:00100000:3.0:1762166859.246996:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444584192 00000100:00100000:3.0:1762166859.247049:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 536 00000100:00100000:3.0:1762166859.247057:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49421:x1847765444584192:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:3.0:1762166859.247117:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fd23 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247128:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fd23 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247150:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fd23 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247159:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fd2a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247164:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fd2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247167:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fd2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247258:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fd31 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247263:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fd31 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247266:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fd31 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762166859.247289:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:3.0:1762166859.247292:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166859.247299:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fd31 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247308:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fd23 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247311:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fd23 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247316:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fd23 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247326:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166859.247329:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fd23 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247334:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fd23 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247342:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:3.0:1762166859.247344:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166859.247347:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fd23 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247351:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fd23 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247359:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fd2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247362:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fd2a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247365:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fd2a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247368:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166859.247370:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fd2a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247373:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fd2a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247376:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee363960100) 00010000:00010000:3.0:1762166859.247380:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166859.247382:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fd2a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247386:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fd2a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247395:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fd31 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247398:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fd31 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247401:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fd31 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247404:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166859.247418:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fd31 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247424:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fd31 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247429:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:3.0:1762166859.247431:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166859.247432:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fd31 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.247436:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fd31 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762166859.247490:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49421:x1847765444584192:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 434us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166859.247495:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 536 00000100:00100000:0.0:1762166859.256132:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.256184:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444584448 00000100:00100000:3.0:1762166859.256195:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444584448 00000100:00100000:3.0:1762166859.256241:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 537 00000100:00100000:3.0:1762166859.256251:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:49423:x1847765444584448:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166859.256273:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166859.256291:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fd38 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f64 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166859.256389:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fd3f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.256401:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fd3f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.256423:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fd3f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762166859.256433:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:3.0:1762166859.256552:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fd38 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f64 expref: 34 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166859.256569:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fd3f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f64 expref: 33 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166859.256576:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:3.0:1762166859.256579:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166859.256582:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228200, rc 0) 00000100:00100000:3.0:1762166859.256634:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49423:x1847765444584448:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 385us (511us total) trans 8589935176 rc 0/0 00000100:00100000:3.0:1762166859.256641:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 537 00000100:00100000:0.0:1762166859.258364:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.258404:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444584704 00000100:00100000:3.0:1762166859.258420:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444584704 00000100:00100000:3.0:1762166859.258459:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 538 00000100:00100000:3.0:1762166859.258464:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:49423:x1847765444584704:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166859.258483:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166859.258495:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fd4d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f6b expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166859.258558:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9fd54 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.258567:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fd1c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f5d expref: 34 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166859.258572:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9fd54 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.258595:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fd1c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f5d expref: 34 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166859.258603:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fd1c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f5d expref: 34 pid: 32138 timeout: 580 lvb_type: 0 00000100:00100000:3.0:1762166859.258613:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765452018688:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166859.258668:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166859.259537:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765452018688:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166859.259555:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9fd54 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762166859.259832:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.259904:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444584832 00000100:00100000:3.0:1762166859.259915:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444584832 00010000:00010000:3.0:1762166859.259933:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fd1c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f5d expref: 35 pid: 32138 timeout: 580 lvb_type: 0 00000100:00100000:3.0:1762166859.259955:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 910 00000100:00100000:3.0:1762166859.259960:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765444584832:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.259967:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.259971:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fd1c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f5d expref: 35 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.259979:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fd1c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f5d expref: 35 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.259991:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fd1c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f5d expref: 35 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.260001:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:3.0:1762166859.260003:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9fd54 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.260012:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9fd54 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.260017:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9fd54 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166859.260031:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166859.260057:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765444584832:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 97us (226us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166859.260062:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9fd54 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762166859.260063:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 910 00010000:00010000:2.0:1762166859.260072:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9fd54 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166859.260084:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166859.260183:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3c9fd4d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f6b expref: 35 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.260203:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9fd54 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f6b expref: 34 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.260210:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166859.260212:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166859.260215:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348229200, rc 0) 00000100:00100000:2.0:1762166859.260250:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49423:x1847765444584704:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1785us (1889us total) trans 8589935177 rc 0/0 00000100:00100000:2.0:1762166859.260258:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 538 00000100:00100000:0.0:1762166859.261078:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166859.261129:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444584960 00000100:00100000:1.0:1762166859.261133:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444584960 00000100:00100000:1.0:1762166859.261160:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 234 00000100:00100000:1.0:1762166859.261166:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49423:x1847765444584960:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:1.0:1762166859.261233:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49423:x1847765444584960:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 68us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166859.261238:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 234 00000100:00100000:0.0:1762166859.261893:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166859.261932:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444585216 00000100:00100000:1.0:1762166859.261938:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444585216 00000100:00100000:1.0:1762166859.261969:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 235 00000100:00100000:1.0:1762166859.261977:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49423:x1847765444585216:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166859.262111:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49423:x1847765444585216:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 134us (218us total) trans 8589935178 rc 0/0 00000100:00100000:1.0:1762166859.262118:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 235 00000100:00100000:0.0:1762166859.262908:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.262945:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444585472 00000100:00100000:2.0:1762166859.262950:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444585472 00000100:00100000:2.0:1762166859.262983:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 539 00000100:00100000:2.0:1762166859.262991:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49423:x1847765444585472:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.263005:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.263008:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762166859.263025:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3c9fd54 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f6b expref: 35 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.263040:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3c9fd3f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f64 expref: 34 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.263047:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166859.263050:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166859.263058:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fd62 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f72 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.263118:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fd69 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.263129:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fd69 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.263137:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fd69 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166859.263147:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166859.263218:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fd62 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f72 expref: 36 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.263231:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fd69 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f72 expref: 35 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.263248:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166859.263253:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166859.263255:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2800, rc 0) 00000100:00100000:2.0:1762166859.263292:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49423:x1847765444585472:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 301us (384us total) trans 8589935179 rc 0/0 00000100:00100000:2.0:1762166859.263299:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 539 00000100:00100000:0.0:1762166859.264285:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166859.264331:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444585728 00000100:00100000:1.0:1762166859.264336:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444585728 00000100:00100000:1.0:1762166859.264372:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 236 00000100:00100000:1.0:1762166859.264381:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358651c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49423:x1847765444585728:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166859.264432:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fd69 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f72 expref: 35 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.264453:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fd77 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.264464:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcf9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f56 expref: 35 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.264471:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fd77 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.264498:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcf9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f56 expref: 35 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.264506:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcf9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f56 expref: 35 pid: 32138 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1762166859.264516:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f620380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452018816:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166859.264567:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c596c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166859.265365:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f620380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452018816:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166859.265394:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fd77 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166859.265604:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.265640:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444585856 00000100:00100000:3.0:1762166859.265646:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444585856 00010000:00010000:3.0:1762166859.265703:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcf9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f56 expref: 36 pid: 32138 timeout: 580 lvb_type: 0 00000100:00100000:3.0:1762166859.265731:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 911 00000100:00100000:3.0:1762166859.265740:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765444585856:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.265751:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.265757:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcf9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f56 expref: 36 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.265789:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcf9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f56 expref: 36 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.265807:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fcf9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f56 expref: 36 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.265820:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:3.0:1762166859.265824:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fd77 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.265832:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fd77 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.265839:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fd77 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.265860:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166859.265880:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fd77 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.265891:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fd77 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166859.265899:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444585856:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 159us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166859.265916:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 911 00010000:00010000:1.0:1762166859.266095:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fd77 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.266103:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fd77 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.266110:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fd77 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.266116:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a27a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166859.266120:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fd77 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.266127:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fd77 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.266136:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:1.0:1762166859.266139:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166859.266142:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fd77 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.266147:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fd77 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.266157:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01c00) 00010000:00010000:1.0:1762166859.266165:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166859.266170:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fd69 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f72 expref: 34 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166859.266269:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358651c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49423:x1847765444585728:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 1889us (1987us total) trans 8589935180 rc -22/-22 00000100:00100000:1.0:1762166859.266278:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 236 00000100:00100000:0.0:1762166859.266980:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.267019:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444585984 00000100:00100000:2.0:1762166859.267025:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444585984 00000100:00100000:2.0:1762166859.267061:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 540 00000100:00100000:2.0:1762166859.267069:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:49423:x1847765444585984:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.267084:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.267099:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fd7e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f79 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.267134:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fd7e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f79 expref: 35 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.267147:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fd7e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f79 expref: 35 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.267161:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01500) 00010000:00010000:2.0:1762166859.267164:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166859.267167:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3e00, rc 0) 00000100:00100000:2.0:1762166859.267202:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49423:x1847765444585984:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 134us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.267209:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 540 00000100:00100000:0.0:1762166859.268435:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.268468:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444586240 00000100:00100000:2.0:1762166859.268474:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444586240 00000100:00100000:2.0:1762166859.268516:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 541 00000100:00100000:2.0:1762166859.268521:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:49423:x1847765444586240:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.268530:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.268538:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fd85 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f80 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.268956:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fd8c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.268965:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fd8c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.268971:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fd8c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166859.268981:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x46:0x0]: returning size 0 00010000:00010000:2.0:1762166859.269010:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fd85 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f80 expref: 38 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.269020:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fd8c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f80 expref: 37 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.269025:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x46:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166859.269027:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166859.269029:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3000, rc 0) 00000100:00100000:2.0:1762166859.269062:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49423:x1847765444586240:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 541us (629us total) trans 8589935181 rc 0/0 00000100:00100000:2.0:1762166859.269069:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 541 00000100:00100000:0.0:1762166859.270284:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.270326:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444586496 00000100:00100000:2.0:1762166859.270332:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444586496 00000100:00100000:2.0:1762166859.270369:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 542 00000100:00100000:2.0:1762166859.270378:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:49423:x1847765444586496:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.270394:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.270426:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fd9a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f87 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.270484:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fda1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.270492:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fda1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.270497:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fda1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166859.270505:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1762166859.270567:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fd9a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f87 expref: 40 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.270578:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fda1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f87 expref: 39 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.270584:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01500) 00010000:00010000:2.0:1762166859.270587:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166859.270590:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3c00, rc 0) 00000100:00100000:2.0:1762166859.270631:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49423:x1847765444586496:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 254us (348us total) trans 8589935182 rc 0/0 00000100:00100000:2.0:1762166859.270638:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 542 00000100:00100000:0.0:1762166859.271682:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166859.271730:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444586752 00000100:00100000:1.0:1762166859.271737:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444586752 00000100:00100000:1.0:1762166859.271809:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 237 00000100:00100000:1.0:1762166859.271825:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49423:x1847765444586752:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762166859.271871:0:30821:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fda1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f87 expref: 39 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.271896:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fdaf lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.271906:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fd7e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f79 expref: 39 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.271913:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fdaf lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.271942:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fd7e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f79 expref: 39 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.271951:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fd7e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f79 expref: 39 pid: 32138 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1762166859.271961:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f620380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452018944:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166859.272027:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c59540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166859.273155:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f620380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452018944:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166859.273203:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fdaf lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166859.273221:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.273299:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444586880 00000100:00100000:3.0:1762166859.273307:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444586880 00010000:00010000:3.0:1762166859.273330:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fd7e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f79 expref: 40 pid: 32138 timeout: 580 lvb_type: 0 00000100:00100000:3.0:1762166859.273362:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 912 00000100:00100000:3.0:1762166859.273371:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2361:x1847765444586880:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.273383:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.273389:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fd7e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f79 expref: 40 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.273401:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fd7e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f79 expref: 40 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.273430:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fd7e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f79 expref: 40 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.273444:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01500) 00010000:00010000:3.0:1762166859.273449:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fdaf lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.273457:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fdaf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.273462:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fdaf lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.273486:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166859.273535:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765444586880:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 165us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166859.273542:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 912 00010000:00010000:1.0:1762166859.273576:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fdaf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.273586:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fdaf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.273615:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9fdb6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.273629:0:30821:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fd8c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f80 expref: 38 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.273638:0:30821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9fdb6 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x46:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.273689:0:30821:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fd8c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f80 expref: 38 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166859.273703:0:30821:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fd8c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f80 expref: 38 pid: 32138 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1762166859.273717:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f620380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452019072:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166859.273868:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c59540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166859.274844:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f620380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:30821:1847765452019072:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762166859.274867:0:30821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9fdb6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x46:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:0.0:1762166859.274961:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166859.275049:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444587008 00000100:00100000:3.0:1762166859.275055:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444587008 00010000:00010000:3.0:1762166859.275088:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fd8c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f80 expref: 39 pid: 32138 timeout: 580 lvb_type: 0 00000100:00100000:3.0:1762166859.275124:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 913 00000100:00100000:3.0:1762166859.275132:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765444587008:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166859.275143:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166859.275149:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fd8c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f80 expref: 39 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.275160:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fd8c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f80 expref: 39 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.275175:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fd8c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f80 expref: 39 pid: 32138 timeout: 580 lvb_type: 0 00010000:00010000:3.0:1762166859.275187:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x46:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:3.0:1762166859.275191:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9fdb6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x46:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.275199:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9fdb6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x46:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.275205:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9fdb6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x46:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30821 initiator: MDT0 00010000:00010000:3.0:1762166859.275239:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166859.275265:0:30821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9fdb6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x46:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.275272:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9fdb6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x46:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30821 initiator: MDT0 00000100:00100000:3.0:1762166859.275282:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2360:x1847765444587008:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 149us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166859.275291:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 913 00000100:00100000:1.0:1762166859.275821:0:30821:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f620380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452019200:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166859.275880:0:30821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166859.275916:0:30821:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2435c13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166859.275945:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452019200 00000100:00100000:2.0:1762166859.275953:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452019200 00000100:00100000:2.0:1762166859.276004:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1762166859.276015:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30821:x1847765452019200:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166859.276093:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30821:x1847765452019200:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 82us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.276101:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1762166859.276138:0:30821:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f620380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30821:1847765452019200:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1762166859.276181:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935183 00000001:00080000:1.0:1762166859.276243:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935184 00010000:00010000:1.0:1762166859.276264:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9fdb6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x46:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.276272:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9fdb6 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x46:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.276280:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9fdb6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x46:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.276287:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166859.276292:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9fdb6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x46:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.276301:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9fdb6 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x46:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.276315:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x46:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:1.0:1762166859.276318:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166859.276330:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9fdb6 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x46:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.276337:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9fdb6 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x46:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.276358:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fdaf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.276364:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fdaf lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.276369:0:30821:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fdaf lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.276374:0:30821:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166859.276377:0:30821:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fdaf lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.276383:0:30821:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fdaf lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.276390:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01500) 00010000:00010000:1.0:1762166859.276392:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166859.276396:0:30821:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fdaf lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.276401:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9fdaf lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.276425:0:30821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01500) 00010000:00010000:1.0:1762166859.276428:0:30821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166859.276433:0:30821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fda1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f87 expref: 40 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166859.276535:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49423:x1847765444586752:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 4715us (4856us total) trans 8589935185 rc 0/0 00000100:00100000:1.0:1762166859.276545:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 237 00000020:00080000:1.0:1762166859.276550:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166859.277470:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.277519:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444587136 00000100:00100000:2.0:1762166859.277525:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444587136 00000100:00100000:2.0:1762166859.277562:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 543 00000100:00100000:2.0:1762166859.277569:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:49423:x1847765444587136:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166859.277586:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.277603:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9fdbd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f8e expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.277649:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9fdbd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f8e expref: 40 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.277670:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9fdbd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f8e expref: 40 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.277687:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01000) 00010000:00010000:2.0:1762166859.277690:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166859.277693:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2c00, rc 0) 00000100:00100000:2.0:1762166859.277745:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49423:x1847765444587136:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 175us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.277752:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 543 00000100:00100000:0.0:1762166859.279115:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166859.279173:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444587392 00000100:00100000:1.0:1762166859.279180:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444587392 00000100:00100000:1.0:1762166859.279220:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 238 00000100:00100000:1.0:1762166859.279229:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:49423:x1847765444587392:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:1.0:1762166859.279631:0:30821:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x46:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1762166859.279726:0:30821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].19, 64 off9600 00000001:00080000:1.0:1762166859.279738:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935186 00010000:00010000:1.0:1762166859.279809:0:30821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fdc4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.279823:0:30821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fdc4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.279834:0:30821:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fdc4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.279842:0:30821:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fdc4 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.279849:0:30821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fdc4 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.279855:0:30821:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fdc4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30821 initiator: MDT0 00010000:00010000:1.0:1762166859.279875:0:30821:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166859.279908:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166859.279916:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fdc4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166859.279924:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a27a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166859.279929:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fdc4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166859.279936:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fdc4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166859.279947:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x46:0x0].0x0 (ffff9ee34ada3b00) 00010000:00010000:2.0:1762166859.279951:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166859.279955:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fdc4 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166859.279961:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9fdc4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30821 initiator: MDT0 00010000:00010000:2.0:1762166859.279979:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166859.279981:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166859.279982:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166859.279993:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49423:x1847765444587392:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 764us (879us total) trans 8589935187 rc 0/0 00000100:00100000:1.0:1762166859.280002:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 238 00000020:00080000:1.0:1762166859.280007:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166859.281083:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166859.281130:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444587648 00000100:00100000:1.0:1762166859.281138:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444587648 00000100:00100000:1.0:1762166859.281183:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 239 00000100:00100000:1.0:1762166859.281193:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:49423:x1847765444587648:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166859.281464:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49423:x1847765444587648:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 272us (384us total) trans 8589935188 rc 0/0 00000100:00100000:1.0:1762166859.281472:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 239 00000100:00100000:0.0:1762166859.288912:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.288976:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444587776 00000100:00100000:2.0:1762166859.288987:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444587776 00000100:00100000:2.0:1762166859.289045:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 544 00000100:00100000:2.0:1762166859.289055:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:49425:x1847765444587776:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166859.289079:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.289097:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fdcb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f95 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.289146:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdd2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289156:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdd2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289163:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdd2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289173:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdd9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289177:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdd9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289181:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdd9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289261:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fde0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289272:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fde0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289279:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fde0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166859.289308:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166859.289312:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166859.289328:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fde0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289339:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fde0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289347:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdd2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289352:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdd2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289358:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdd2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289363:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166859.289367:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdd2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289374:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdd2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289385:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166859.289389:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166859.289392:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdd2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289399:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdd2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289425:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdd9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289431:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdd9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289437:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdd9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289442:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166859.289445:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdd9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289450:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdd9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289457:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01d00) 00010000:00010000:2.0:1762166859.289459:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166859.289462:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdd9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289467:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdd9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.289497:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fdcb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f95 expref: 45 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.289510:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fde0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f95 expref: 44 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166859.289523:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01000) 00010000:00010000:2.0:1762166859.289525:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166859.289527:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3e00, rc 0) 00000100:00100000:2.0:1762166859.289581:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49425:x1847765444587776:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 528us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.289586:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 544 00000100:00100000:0.0:1762166859.291226:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.291275:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444587904 00000100:00100000:2.0:1762166859.291282:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444587904 00000100:00100000:2.0:1762166859.291322:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1311 00000100:00100000:2.0:1762166859.291331:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765444587904:12345-192.168.203.35@tcp:101:getfattr.0 00010000:00010000:2.0:1762166859.291344:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166859.291357:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fde7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91f9c expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166859.291418:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765452019328:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762166859.291472:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2446a29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166859.292364:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765452019328:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762166859.292392:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fde7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f9c expref: 20 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166859.292425:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fde7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f9c expref: 20 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166859.292437:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3c00, rc 0) 00000100:00100000:0.0:1762166859.292480:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765444587904:12345-192.168.203.35@tcp:101:getfattr.0 Request processed in 1149us (1258us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166859.292488:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1311 00000100:00100000:0.0:1762166859.305138:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166859.305208:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444588032 00000100:00100000:2.0:1762166859.305218:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444588032 00000100:00100000:2.0:1762166859.305273:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 545 00000100:00100000:2.0:1762166859.305287:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49429:x1847765444588032:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762166859.305360:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fdee lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305374:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fdee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305385:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fdee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305400:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdf5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305418:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdf5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305425:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdf5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305525:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdfc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305533:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdfc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305540:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdfc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166859.305569:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1762166859.305573:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166859.305583:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdfc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305594:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fdee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305599:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fdee lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305604:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fdee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305610:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166859.305614:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fdee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305620:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fdee lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305630:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:2.0:1762166859.305633:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166859.305641:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fdee lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305647:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fdee lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305660:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdf5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305666:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdf5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305671:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdf5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305675:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166859.305678:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdf5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305683:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdf5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305689:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0xe488ae23 (ffff9ee359d01d00) 00010000:00010000:2.0:1762166859.305691:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166859.305694:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdf5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305698:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fdf5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305713:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdfc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305719:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdfc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305724:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdfc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305728:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166859.305731:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdfc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305735:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdfc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305741:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01000) 00010000:00010000:2.0:1762166859.305743:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166859.305745:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdfc lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166859.305750:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fdfc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762166859.305869:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:49429:x1847765444588032:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 584us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166859.305877:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 545 00010000:00010000:3.0:1762166860.200838:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1762166860.474039:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869473 is committed 00000001:00080000:2.0:1762166860.474056:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869469 is committed 00000001:00080000:2.0:1762166860.474099:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869471 is committed 00000001:00080000:2.0:1762166860.474112:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869475 is committed 00000001:00080000:2.0:1762166860.474123:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869474 is committed 00010000:00010000:0.0:1762166861.223922:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1762166861.476592:0:32322:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 61a: mirror extend and migrate preserve timestamps ========================================================== 05:47:41 (1762166861) 00010000:00010000:0.0:1762166862.247901:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166862.261364:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166862.261422:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444588288 00000100:00100000:3.0:1762166862.261432:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444588288 00000100:00080000:1.0:1762166862.261499:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166862.261517:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 546 00000100:00100000:3.0:1762166862.261530:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:50075:x1847765444588288:12345-192.168.203.35@tcp:36:mkdir.0 00010000:00010000:3.0:1762166862.261582:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166862.261613:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bee00/0xf915a5bdf3c9d57d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910a7 expref: 44 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.261630:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee34bdb4f00) 00010000:00010000:3.0:1762166862.261640:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166862.261741:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fe03 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.261756:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fe03 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.261801:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fe03 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.261822:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fe0a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.261832:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fe0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.261849:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fe0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762166862.262643:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x47:0x0]: returning size 512 00010000:00010000:3.0:1762166862.262651:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fe03 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.262657:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fe03 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.262662:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fe03 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.262666:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166862.262670:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fe03 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.262676:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fe03 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.262683:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:3.0:1762166862.262685:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166862.262688:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fe03 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.262691:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3c9fe03 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000004:00010000:3.0:1762166862.262708:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000571ab2f4 reply state 00000000d66a1e65 transno 8589935189 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fe0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762166862.262713:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166862.262822:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+45:50075:x1847765444588288:12345-192.168.203.35@tcp:36:mkdir.0 Request processed in 1297us (1464us total) trans 8589935189 rc 0/0 00000100:00100000:3.0:1762166862.262841:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 546 00010000:00010000:3.0:1762166862.263553:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fe0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.263562:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fe0a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.263568:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fe0a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.263572:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166862.263574:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fe0a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.263578:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fe0a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.263584:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x159f6f8a (ffff9ee363960d00) 00010000:00010000:3.0:1762166862.263586:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166862.263588:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fe0a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.263591:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9fe0a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762166862.268335:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.268424:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444588416 00000100:00100000:2.0:1762166862.268440:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444588416 00000100:00100000:2.0:1762166862.268512:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 547 00000100:00100000:2.0:1762166862.268527:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:50076:x1847765444588416:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166862.268557:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166862.268585:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9fe11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91fa3 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.268662:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fe18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.268679:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fe18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.268692:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fe18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166862.268758:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:2.0:1762166862.268790:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 26 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166862.268820:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fe18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.268842:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9fe11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fa3 expref: 46 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.268856:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fe18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fa3 expref: 45 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.268863:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee359d01f00) 00010000:00010000:2.0:1762166862.268866:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762166862.268871:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2600, rc 0) 00000100:00100000:2.0:1762166862.268946:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+45:50076:x1847765444588416:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 423us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.268955:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 547 00000100:00100000:0.0:1762166862.269743:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.269806:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444588544 00000100:00100000:2.0:1762166862.269814:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444588544 00000100:00100000:2.0:1762166862.269851:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 548 00000100:00100000:2.0:1762166862.269861:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+45:50076:x1847765444588544:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166862.269870:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166862.269879:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fe1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91faa expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.269926:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fe26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.269933:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fe26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.269939:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fe26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.269950:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fe2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.269956:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fe2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.269962:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fe2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.270056:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fe34 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.270064:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fe34 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.270069:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fe34 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166862.270083:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x47:0x0]: returning size 512 00000004:00200000:2.0:1762166862.270085:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166862.270093:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fe34 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.270101:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fe26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.270105:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fe26 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.270110:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fe26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.270114:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166862.270116:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fe26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.270121:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fe26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.270130:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee359d01f00) 00010000:00010000:2.0:1762166862.270132:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166862.270136:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fe26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.270140:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9fe26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.270151:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fe2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.270157:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fe2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.270162:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fe2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.270167:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166862.270170:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fe2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.270175:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fe2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.270182:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x159f6f8a (ffff9ee359d01d00) 00010000:00010000:2.0:1762166862.270185:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166862.270187:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fe2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.270193:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fe2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.270218:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9fe1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91faa expref: 47 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.270232:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fe34 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91faa expref: 46 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.270238:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166862.270241:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1762166862.270244:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3800, rc 0) 00000100:00100000:2.0:1762166862.270294:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:50076:x1847765444588544:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 437us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.270300:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 548 00000100:00100000:0.0:1762166862.271035:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.271084:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444588672 00000100:00100000:2.0:1762166862.271091:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444588672 00000100:00100000:2.0:1762166862.271128:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 549 00000100:00100000:2.0:1762166862.271139:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:50076:x1847765444588672:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166862.271150:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166862.271162:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fe3b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91fb1 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.271197:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fe42 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271205:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fe42 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271212:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fe42 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271222:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fe49 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271226:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fe49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271231:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fe49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271273:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fe42 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271278:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fe42 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271283:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fe42 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271287:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166862.271290:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fe42 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271294:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fe42 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271300:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166862.271302:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166862.271304:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fe42 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271308:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9fe42 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271315:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fe49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271318:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fe49 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271322:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fe49 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271326:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166862.271327:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fe49 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271333:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fe49 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271337:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0xd5143738 (ffff9ee359d01400) 00010000:00010000:2.0:1762166862.271339:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166862.271340:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fe49 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271343:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9fe49 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.271359:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fe3b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fb1 expref: 47 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.271365:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166862.271366:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166862.271368:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9fe3b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fb1 expref: 47 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.271372:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3400, rc 0) 00000100:00100000:2.0:1762166862.271425:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:50076:x1847765444588672:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 289us (392us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166862.271431:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 549 00000100:00100000:0.0:1762166862.272352:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.272417:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444588928 00000100:00100000:2.0:1762166862.272425:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444588928 00000100:00100000:2.0:1762166862.272476:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 550 00000100:00100000:2.0:1762166862.272488:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:50076:x1847765444588928:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166862.272498:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166862.272509:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fe50 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91fb8 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.272610:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9fe57 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.272623:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9fe57 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.272634:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9fe57 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.272652:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9fe5e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x47:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.272658:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9fe5e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.272663:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9fe5e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.273225:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9fe65 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.273235:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9fe65 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.273244:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9fe65 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762166862.273256:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 0 00010000:00010000:2.0:1762166862.273284:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9fe57 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.273291:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9fe57 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.273296:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9fe57 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.273300:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166862.273303:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9fe57 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.273307:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9fe57 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.273318:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166862.273320:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166862.273322:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9fe57 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.273326:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9fe57 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000004:00010000:2.0:1762166862.273335:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ecabdff0 reply state 0000000007ef8e96 transno 8589935190 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9fe5e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762166862.273340:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166862.273363:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9fe50 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fb8 expref: 49 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.273374:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9fe65 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fb8 expref: 48 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.273379:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166862.273381:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166862.273383:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159200, rc 0) 00000100:00100000:2.0:1762166862.273450:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:50076:x1847765444588928:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 966us (1102us total) trans 8589935190 rc 0/0 00000100:00100000:2.0:1762166862.273460:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 550 00010000:00010000:2.0:1762166862.274011:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9fe5e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.274018:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9fe5e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.274021:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9fe5e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.274024:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166862.274026:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9fe5e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.274030:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9fe5e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.274036:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0xd5143738 (ffff9ee359d01500) 00010000:00010000:2.0:1762166862.274038:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166862.274041:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9fe5e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.274044:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9fe5e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762166862.274567:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.274611:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444589184 00000100:00100000:2.0:1762166862.274618:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444589184 00000100:00100000:2.0:1762166862.274656:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 551 00000100:00100000:2.0:1762166862.274662:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:50076:x1847765444589184:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166862.274677:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166862.274685:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9fe73 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91fbf expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.274735:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9fe7a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.274744:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9fe65 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fb8 expref: 49 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.274750:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9fe7a lrc: 4/0,1 mode: --/EX res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.274841:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9fe65 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fb8 expref: 49 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.274852:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9fe65 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fb8 expref: 49 pid: 32138 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1762166862.274864:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765452019456:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166862.274945:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166862.275683:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765452019456:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166862.275706:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9fe7a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762166862.275874:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.275913:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444589312 00000100:00100000:2.0:1762166862.275918:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444589312 00010000:00010000:2.0:1762166862.275939:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9fe65 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fb8 expref: 50 pid: 32138 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1762166862.275970:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 914 00000100:00100000:2.0:1762166862.275982:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:2360:x1847765444589312:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166862.275992:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166862.275997:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9fe65 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fb8 expref: 50 pid: 32138 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1762166862.276006:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9fe65 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fb8 expref: 50 pid: 32138 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1762166862.276026:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9fe65 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fb8 expref: 50 pid: 32138 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1762166862.276036:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:2.0:1762166862.276039:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9fe7a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.276045:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9fe7a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.276049:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9fe7a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762166862.276076:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166862.276120:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9fe7a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762166862.276127:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:2360:x1847765444589312:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 145us (252us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166862.276153:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9fe7a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762166862.276153:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 914 00000004:00200000:3.0:1762166862.276184:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 0 00000004:00080000:3.0:1762166862.276549:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x8e:0x0], index 1: 0 00010000:00010000:3.0:1762166862.276698:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9fe7a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.276707:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9fe7a lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.276715:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9fe7a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.276721:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166862.276725:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9fe7a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.276732:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9fe7a lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.276747:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01b00) 00010000:00010000:3.0:1762166862.276750:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166862.276754:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9fe7a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.276760:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9fe7a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.276840:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9fe73 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fbf expref: 49 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.276851:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:3.0:1762166862.276855:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166862.276880:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9fe73 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fbf expref: 49 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.276891:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158000, rc 0) 00000100:00100000:3.0:1762166862.276950:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:50076:x1847765444589184:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2287us (2386us total) trans 8589935191 rc 301/301 00000100:00100000:3.0:1762166862.276960:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 551 00000100:00100000:3.0:1762166862.278044:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166862.278096:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444589568 00000100:00100000:1.0:1762166862.278104:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444589568 00000100:00100000:1.0:1762166862.278148:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 240 00000100:00100000:1.0:1762166862.278156:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+48:50076:x1847765444589568:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166862.278407:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:50076:x1847765444589568:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 251us (364us total) trans 8589935192 rc 0/0 00000100:00100000:1.0:1762166862.278415:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 240 00000100:00100000:2.0:1762166862.279238:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166862.279296:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444589824 00000100:00100000:1.0:1762166862.279304:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444589824 00000100:00100000:1.0:1762166862.279344:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 241 00000100:00100000:1.0:1762166862.279353:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358652050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:50076:x1847765444589824:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166862.279501:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358652050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:50076:x1847765444589824:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 145us (266us total) trans 8589935193 rc 0/0 00000100:00100000:1.0:1762166862.279521:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 241 00000100:00100000:3.0:1762166862.286137:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166862.286212:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444589952 00000100:00100000:0.0:1762166862.286224:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444589952 00000100:00100000:0.0:1762166862.286281:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 552 00000100:00100000:0.0:1762166862.286293:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:50077:x1847765444589952:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166862.286328:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166862.286349:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fe88 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91fc6 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.286428:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9fe8f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286441:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9fe8f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286452:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9fe8f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286471:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9fe96 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286479:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9fe96 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286485:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9fe96 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286562:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9fe8f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286570:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9fe8f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286576:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9fe8f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286581:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166862.286585:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9fe8f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286593:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9fe8f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286609:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:0.0:1762166862.286612:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166862.286617:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9fe8f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286623:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198400/0xf915a5bdf3c9fe8f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286638:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9fe96 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286642:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9fe96 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286646:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9fe96 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286651:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166862.286654:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9fe96 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286658:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9fe96 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286666:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x363df604 (ffff9ee34bdb4600) 00010000:00010000:0.0:1762166862.286669:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166862.286671:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9fe96 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286675:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198200/0xf915a5bdf3c9fe96 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.286726:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fe88 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fc6 expref: 51 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.286738:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:0.0:1762166862.286740:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166862.286745:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198600/0xf915a5bdf3c9fe88 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fc6 expref: 51 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.286757:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198600, rc 0) 00000100:00100000:0.0:1762166862.286878:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:50077:x1847765444589952:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 587us (755us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166862.286891:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 552 00000100:00100000:3.0:1762166862.288314:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166862.288354:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444590208 00000100:00100000:0.0:1762166862.288362:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444590208 00000100:00100000:0.0:1762166862.288406:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 553 00000100:00100000:0.0:1762166862.288414:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:50077:x1847765444590208:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166862.288425:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166862.288437:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9fe9d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91fcd expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.288515:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9fea4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.288527:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9fea4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.288536:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9fea4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.288549:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9feab lrc: 3/0,1 mode: --/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.288559:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9feab lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.288565:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9feab lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.288979:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9feb2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.288986:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9feb2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.288991:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9feb2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762166862.288998:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x49:0x0]: returning size 0 00010000:00010000:0.0:1762166862.289014:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9fea4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.289018:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9fea4 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.289022:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9fea4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.289025:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166862.289027:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9fea4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.289031:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9fea4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.289037:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:0.0:1762166862.289040:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166862.289043:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9fea4 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.289046:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199000/0xf915a5bdf3c9fea4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000004:00010000:0.0:1762166862.289054:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d5b647ff reply state 000000006c700d9d transno 8589935194 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9feab lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762166862.289059:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762166862.289075:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3c9fe9d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fcd expref: 53 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.289084:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9feb2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fcd expref: 52 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.289088:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee34bdb4f00) 00010000:00010000:0.0:1762166862.289090:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166862.289091:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198e00, rc 0) 00000100:00100000:0.0:1762166862.289155:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:50077:x1847765444590208:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 742us (846us total) trans 8589935194 rc 0/0 00000100:00100000:0.0:1762166862.289162:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 553 00010000:00010000:0.0:1762166862.289967:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9feab lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.289978:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9feab lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.289984:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9feab lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.289995:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166862.289998:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9feab lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.290005:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9feab lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.290018:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x363df604 (ffff9ee34bdb4a00) 00010000:00010000:0.0:1762166862.290021:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166862.290024:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9feab lrc: 2/0,0 mode: --/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.290030:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9feab lrc: 0/0,0 mode: --/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762166862.290641:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166862.290690:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444590464 00000100:00100000:0.0:1762166862.290697:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444590464 00000100:00100000:0.0:1762166862.290742:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 554 00000100:00100000:0.0:1762166862.290752:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:50077:x1847765444590464:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166862.290795:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166862.290808:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fec0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91fd4 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.290889:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fec7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.290901:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9feb2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fcd expref: 53 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.290909:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fec7 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.290941:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9feb2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fcd expref: 53 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.290954:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9feb2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fcd expref: 53 pid: 32138 timeout: 583 lvb_type: 0 00000100:00100000:0.0:1762166862.290968:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765452019584:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166862.291043:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34821db40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166862.291993:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765452019584:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166862.292012:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fec7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762166862.292261:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166862.292316:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444590592 00000100:00100000:0.0:1762166862.292323:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444590592 00010000:00010000:0.0:1762166862.292348:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9feb2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fcd expref: 54 pid: 32138 timeout: 583 lvb_type: 0 00000100:00100000:0.0:1762166862.292374:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 915 00000100:00100000:0.0:1762166862.292383:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+54:2361:x1847765444590592:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166862.292407:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166862.292414:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9feb2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fcd expref: 54 pid: 32138 timeout: 583 lvb_type: 0 00010000:00010000:0.0:1762166862.292426:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9feb2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fcd expref: 54 pid: 32138 timeout: 583 lvb_type: 0 00010000:00010000:0.0:1762166862.292443:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9feb2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fcd expref: 54 pid: 32138 timeout: 583 lvb_type: 0 00010000:00010000:0.0:1762166862.292462:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee34bdb4f00) 00010000:00010000:0.0:1762166862.292466:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fec7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.292474:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fec7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.292480:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fec7 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762166862.292503:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166862.292532:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fec7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.292542:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fec7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762166862.292552:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:2361:x1847765444590592:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 170us (291us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166862.292556:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x49:0x0]: returning size 0 00000100:00100000:0.0:1762166862.292561:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 915 00000004:00080000:3.0:1762166862.292801:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x8f:0x0], index 0: 0 00010000:00010000:3.0:1762166862.292954:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fec7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.292962:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fec7 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.292968:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fec7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.292973:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166862.292977:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fec7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.292990:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fec7 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.293000:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee34bdb4f00) 00010000:00010000:3.0:1762166862.293002:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166862.293006:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fec7 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.293012:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3c9fec7 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762166862.293057:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fec0 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fd4 expref: 53 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.293063:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:3.0:1762166862.293064:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166862.293067:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3c9fec0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fd4 expref: 53 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.293072:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199a00, rc 0) 00000100:00100000:3.0:1762166862.293108:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:50077:x1847765444590464:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2358us (2470us total) trans 8589935195 rc 301/301 00000100:00100000:3.0:1762166862.293116:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 554 00000100:00100000:3.0:1762166862.294149:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166862.294201:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444590848 00000100:00100000:1.0:1762166862.294207:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444590848 00000100:00100000:1.0:1762166862.294250:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 242 00000100:00100000:1.0:1762166862.294258:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:50077:x1847765444590848:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166862.294523:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:50077:x1847765444590848:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 265us (376us total) trans 8589935196 rc 0/0 00000100:00100000:1.0:1762166862.294532:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 242 00000100:00100000:0.0:1762166862.295347:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166862.295405:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444591104 00000100:00100000:1.0:1762166862.295411:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444591104 00000100:00100000:1.0:1762166862.295456:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 243 00000100:00100000:1.0:1762166862.295466:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+53:50077:x1847765444591104:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762166862.295588:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+54:50077:x1847765444591104:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 123us (244us total) trans 8589935197 rc 0/0 00000100:00100000:1.0:1762166862.295595:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 243 00000100:00100000:0.0:1762166862.297989:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.298179:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444591360 00000100:00100000:2.0:1762166862.298189:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444591360 00000100:00100000:2.0:1762166862.298246:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 555 00000100:00100000:2.0:1762166862.298256:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+54:49855:x1847765444591360:12345-192.168.203.35@tcp:101:bash.0 00010000:00010000:2.0:1762166862.298281:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166862.298302:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9fed5 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91fdb expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.298467:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9fedc lrc: 3/1,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.298482:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9fedc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.298495:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9fedc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.298509:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9fee3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.298516:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9fee3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.298522:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9fee3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.298606:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9feea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.298614:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9feea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.298622:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9feea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166862.298632:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 0 00010000:00010000:2.0:1762166862.298724:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9fedc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.298737:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9fedc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.298744:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9fedc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.298750:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166862.298755:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9fedc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.298981:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9fedc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.298995:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166862.298998:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166862.299003:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9fedc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.299010:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9fedc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.299021:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9fee3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.299028:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9fee3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.299034:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9fee3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.299041:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166862.299044:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9fee3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.299055:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9fee3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.299063:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0xd5143738 (ffff9ee359d01500) 00010000:00010000:2.0:1762166862.299066:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166862.299069:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9fee3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.299075:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9fee3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.299135:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9fed5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fdb expref: 57 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.299150:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9feea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fdb expref: 56 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.299158:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:2.0:1762166862.299160:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166862.299163:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159200, rc 0) 00000100:00100000:2.0:1762166862.299222:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+56:49855:x1847765444591360:12345-192.168.203.35@tcp:101:bash.0 Request processed in 968us (1239us total) trans 8589935198 rc 0/0 00000100:00100000:2.0:1762166862.299231:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 555 00000100:00100000:2.0:1762166862.300668:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166862.300741:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444591616 00000100:00100000:0.0:1762166862.300749:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444591616 00000100:00100000:0.0:1762166862.300817:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 556 00000100:00100000:0.0:1762166862.300827:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+56:49855:x1847765444591616:12345-192.168.203.35@tcp:36:bash.0 00010000:00010000:0.0:1762166862.300885:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166862.300905:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9feea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fdb expref: 56 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.300919:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01400) 00010000:00010000:0.0:1762166862.300928:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166862.301117:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9fef8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166862.301130:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9fef8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166862.301138:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9fef8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:0.0:1762166862.301198:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935199 00000004:00010000:0.0:1762166862.301221:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000e3a7286 reply state 00000000e2bf7423 transno 8589935200 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9fef8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166862.301227:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166862.301302:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+58:49855:x1847765444591616:12345-192.168.203.35@tcp:36:bash.0 Request processed in 476us (637us total) trans 8589935200 rc 0/0 00000100:00100000:0.0:1762166862.301308:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 556 00000020:00080000:0.0:1762166862.301312:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762166862.301968:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9fef8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.301976:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9fef8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.301984:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9fef8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.301988:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166862.301991:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9fef8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.301995:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9fef8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.302003:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee34bdb4a00) 00010000:00010000:2.0:1762166862.302005:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166862.302008:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9fef8 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.302012:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3c9fef8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166862.302173:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.302438:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444591744 00000100:00100000:2.0:1762166862.302445:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444591744 00000100:00100000:2.0:1762166862.302490:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 557 00000100:00100000:2.0:1762166862.302500:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+57:49855:x1847765444591744:12345-192.168.203.35@tcp:101:bash.0 00010000:00010000:2.0:1762166862.302516:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166862.302529:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9feff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91fe2 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.302559:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9feff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fe2 expref: 58 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.302570:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9feff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fe2 expref: 58 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.302580:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01d00) 00010000:00010000:2.0:1762166862.302582:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166862.302584:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159800, rc 0) 00000100:00100000:2.0:1762166862.302619:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+58:49855:x1847765444591744:12345-192.168.203.35@tcp:101:bash.0 Request processed in 123us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.302624:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 557 00000100:00100000:2.0:1762166862.303587:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166862.303629:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444591872 00000100:00100000:0.0:1762166862.303634:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444591872 00000100:00080000:2.0:1762166862.303676:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166862.303676:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1312 00000100:00100000:0.0:1762166862.303686:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:49855:x1847765444591872:12345-192.168.203.35@tcp:101:bash.0 00010000:00010000:0.0:1762166862.303695:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166862.303705:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ff06 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91fe9 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166862.303721:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166862.303732:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166862.303734:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166862.303738:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ff06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fe9 expref: 11 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.303752:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ff06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fe9 expref: 11 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.303759:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198c00, rc 0) 00000100:00100000:0.0:1762166862.303813:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:49855:x1847765444591872:12345-192.168.203.35@tcp:101:bash.0 Request processed in 129us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166862.303820:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1312 00000100:00100000:3.0:1762166862.304616:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.304664:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444592000 00000100:00100000:2.0:1762166862.304669:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444592000 00002000:00010000:2.0:1762166862.304693:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/142 (0->18446744073709551615) 00002000:00100000:2.0:1762166862.304717:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce5c00 with x1847765444592000 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166862.304724:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dce5c00. 00000100:00100000:2.0:1762166862.304748:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 983 00000100:00100000:2.0:1762166862.304756:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444592000:12345-192.168.203.35@tcp:10:bash.0 00002000:00010000:2.0:1762166862.305055:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166862.305058:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb mtime from disk: 0 -> 1762166862 00002000:00010000:2.0:1762166862.305059:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166862.305061:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb ctime from disk: 0 -> 1762166862 00002000:00010000:2.0:1762166862.305062:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166862.305092:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444592000:12345-192.168.203.35@tcp:10:bash.0 Request processed in 338us (478us total) trans 17179869476 rc 0/0 00000100:00100000:2.0:1762166862.305099:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 983 00002000:00010000:2.0:1762166862.305101:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/142 (0->18446744073709551615) 00002000:00100000:2.0:1762166862.305103:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce5c00 with x1847765444592000 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166862.305107:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dce5c00. 00000100:00100000:2.0:1762166862.306339:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166862.306400:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444592256 00000100:00100000:0.0:1762166862.306407:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444592256 00000100:00100000:0.0:1762166862.306448:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 244 00000100:00100000:0.0:1762166862.306458:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+58:49855:x1847765444592256:12345-192.168.203.35@tcp:35:bash.0 00000100:00100000:0.0:1762166862.306734:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+59:49855:x1847765444592256:12345-192.168.203.35@tcp:35:bash.0 Request processed in 276us (396us total) trans 8589935201 rc 0/0 00000100:00100000:0.0:1762166862.306743:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 244 00000100:00100000:3.0:1762166862.316036:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.316085:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444592384 00000100:00100000:2.0:1762166862.316096:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444592384 00000100:00100000:2.0:1762166862.316153:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 558 00000100:00100000:2.0:1762166862.316164:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+59:50078:x1847765444592384:12345-192.168.203.35@tcp:101:chown.0 00010000:00010000:2.0:1762166862.316188:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166862.316209:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ff0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ff0 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.316264:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ff14 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.316275:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ff14 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.316282:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ff14 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166862.316328:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x47:0x0]: returning size 512 00000004:00200000:2.0:1762166862.316331:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166862.316356:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ff14 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.316375:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ff0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ff0 expref: 61 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.316410:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ff14 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ff0 expref: 60 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.316419:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166862.316422:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762166862.316425:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159e00, rc 0) 00000100:00100000:2.0:1762166862.316483:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+60:50078:x1847765444592384:12345-192.168.203.35@tcp:101:chown.0 Request processed in 322us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.316490:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 558 00000100:00100000:3.0:1762166862.317742:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.317803:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444592640 00000100:00100000:2.0:1762166862.317810:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444592640 00000100:00100000:2.0:1762166862.317858:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 559 00000100:00100000:2.0:1762166862.317866:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+60:50078:x1847765444592640:12345-192.168.203.35@tcp:36:chown.0 00010000:00010000:2.0:1762166862.317900:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1762166862.317918:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ff14 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ff0 expref: 60 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.317930:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fe34 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91faa expref: 59 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.317937:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166862.317944:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166862.317958:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff1b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.317965:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff1b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x47:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.317973:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff1b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x47:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:3.0:1762166862.329437:0:32137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935201 is committed 00000004:00010000:2.0:1762166862.329447:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cec3fe1b reply state 0000000028f8b611 transno 8589935202 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff1b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x47:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166862.329460:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1762166862.329489:0:32137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935202 is committed 00000020:00080000:1.0:1762166862.329497:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee3489aa840 refcount 2 committed 0 result 0 batchid 4294969131 00000004:00200000:2.0:1762166862.329499:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x47:0x0]: returning size 11776 00000020:00080000:1.0:1762166862.329507:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee3436b7f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3489aa9c0 00000020:00080000:1.0:1762166862.329512:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee3436b7700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee242d40400 00000020:00080000:0.0:1762166862.329544:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969131 committed batchid 4294969129 00000020:00080000:1.0:1762166862.329559:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969130 batchid updated 00010000:00080000:2.0:1762166862.329593:0:30817:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1762166862.329620:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:50078:x1847765444592640:12345-192.168.203.35@tcp:36:chown.0 Request processed in 11749us (11875us total) trans 8589935202 rc 0/0 00000100:00100000:2.0:1762166862.329629:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 559 00010000:00010000:1.0:1762166862.329640:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff1b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x47:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166862.329648:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff1b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x47:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166862.329653:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff1b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x47:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166862.329664:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166862.329667:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff1b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x47:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166862.329674:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff1b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x47:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166862.329696:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01500) 00010000:00010000:1.0:1762166862.329700:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1762166862.329704:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff1b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x47:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166862.329711:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff1b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x47:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000020:00080000:0.0:1762166862.329721:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969130 00000100:00100000:3.0:1762166862.330975:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.331071:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444592768 00000100:00100000:2.0:1762166862.331079:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444592768 00000100:00100000:2.0:1762166862.331124:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 560 00000100:00100000:2.0:1762166862.331136:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:50078:x1847765444592768:12345-192.168.203.35@tcp:101:chown.0 00010000:00010000:2.0:1762166862.331155:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166862.331171:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ff22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ff7 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.331220:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ff29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331232:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ff29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331242:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ff29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331255:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ff30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331267:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ff30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331274:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ff30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331375:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ff37 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331383:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ff37 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331406:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ff37 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166862.331451:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x47:0x0]: returning size 11776 00000004:00200000:2.0:1762166862.331455:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166862.331488:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ff37 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331499:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ff29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331505:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ff29 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331511:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ff29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331517:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166862.331520:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ff29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331527:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ff29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331538:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee359d01f00) 00010000:00010000:2.0:1762166862.331542:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166862.331546:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ff29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331551:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159a00/0xf915a5bdf3c9ff29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331561:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ff30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331567:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ff30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331572:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ff30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331577:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166862.331580:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ff30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331586:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ff30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331592:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x159f6f8a (ffff9ee359d01600) 00010000:00010000:2.0:1762166862.331594:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166862.331597:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ff30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331602:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3c9ff30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.331627:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3c9ff22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ff7 expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.331639:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ff37 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ff7 expref: 25 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.331645:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166862.331648:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1762166862.331650:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159200, rc 0) 00000100:00100000:2.0:1762166862.331701:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:50078:x1847765444592768:12345-192.168.203.35@tcp:101:chown.0 Request processed in 568us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.331708:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 560 00000100:00100000:0.0:1762166862.332708:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166862.332749:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444592896 00000100:00100000:1.0:1762166862.332755:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444592896 00000100:00100000:1.0:1762166862.332798:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 245 00000100:00100000:1.0:1762166862.332806:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:50078:x1847765444592896:12345-192.168.203.35@tcp:49:chown.0 00000100:00100000:1.0:1762166862.332877:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:50078:x1847765444592896:12345-192.168.203.35@tcp:49:chown.0 Request processed in 68us (168us total) trans 0 rc -61/-61 00000100:00100000:1.0:1762166862.332884:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 245 00000100:00100000:3.0:1762166862.333577:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.333617:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444593024 00000100:00100000:2.0:1762166862.333623:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444593024 00000100:00100000:2.0:1762166862.333659:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 561 00000100:00100000:2.0:1762166862.333668:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:50078:x1847765444593024:12345-192.168.203.35@tcp:101:chown.0 00010000:00010000:2.0:1762166862.333680:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166862.333693:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ff3e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f91ffe expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.333787:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ff45 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.333799:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ff45 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.333810:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ff45 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.333824:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff4c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.333836:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff4c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.333843:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff4c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.333956:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9ff53 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.333964:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9ff53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.333971:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9ff53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166862.333996:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 4 00000004:00200000:2.0:1762166862.333999:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166862.334011:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9ff53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.334020:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9ff53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.334026:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ff45 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.334031:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ff45 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.334036:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ff45 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.334041:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166862.334044:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ff45 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.334050:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ff45 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.334059:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166862.334062:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166862.334066:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ff45 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.334072:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3c9ff45 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.334081:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff4c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.334087:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff4c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.334092:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff4c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.334097:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166862.334099:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff4c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.334105:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff4c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.334112:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0xd5143738 (ffff9ee359d01c00) 00010000:00010000:2.0:1762166862.334114:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166862.334117:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff4c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.334122:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3c9ff4c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.334147:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3c9ff3e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ffe expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.334158:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9ff53 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ffe expref: 26 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.334165:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01d00) 00010000:00010000:2.0:1762166862.334167:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166862.334169:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3800, rc 0) 00000100:00100000:2.0:1762166862.334199:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:50078:x1847765444593024:12345-192.168.203.35@tcp:101:chown.0 Request processed in 534us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.334204:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 561 00000100:00100000:0.0:1762166862.335478:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.335552:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444593152 00000100:00100000:2.0:1762166862.335559:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444593152 00000100:00100000:2.0:1762166862.335603:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 562 00000100:00100000:2.0:1762166862.335611:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:50078:x1847765444593152:12345-192.168.203.35@tcp:101:chown.0 00010000:00010000:2.0:1762166862.335624:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166862.335636:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ff5a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92005 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.335663:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ff61 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.335671:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ff61 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.335680:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ff61 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.335749:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ff5a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92005 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.335789:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ff61 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92005 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.335797:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01d00) 00010000:00010000:2.0:1762166862.335800:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166862.335802:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3400, rc 0) 00000100:00100000:2.0:1762166862.335845:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:50078:x1847765444593152:12345-192.168.203.35@tcp:101:chown.0 Request processed in 234us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.335852:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 562 00000100:00100000:0.0:1762166862.336866:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.336915:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444593408 00000100:00100000:2.0:1762166862.336921:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444593408 00000100:00100000:2.0:1762166862.336958:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 563 00000100:00100000:2.0:1762166862.336968:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:50078:x1847765444593408:12345-192.168.203.35@tcp:36:chown.0 00010000:00010000:2.0:1762166862.337001:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166862.337020:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9ff53 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ffe expref: 27 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.337033:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01d00) 00010000:00010000:2.0:1762166862.337037:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166862.337057:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9ff68 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.337068:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9ff68 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166862.337079:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9ff68 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000040:00080000:2.0:1762166862.337354:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].20, 88 off9688 00000004:00080000:2.0:1762166862.337365:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 483129601572ns, next at 484129599302ns, rc = 0 00000004:00010000:2.0:1762166862.337486:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fdbcf664 reply state 0000000052a39b5e transno 8589935203 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9ff68 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166862.337496:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166862.337564:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:50078:x1847765444593408:12345-192.168.203.35@tcp:36:chown.0 Request processed in 598us (700us total) trans 8589935203 rc 0/0 00000100:00100000:2.0:1762166862.337572:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 563 00010000:00010000:1.0:1762166862.338263:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9ff68 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166862.338273:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9ff68 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166862.338279:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9ff68 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166862.338300:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166862.338303:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9ff68 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166862.338311:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9ff68 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166862.338322:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01d00) 00010000:00010000:1.0:1762166862.338325:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1762166862.338328:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9ff68 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762166862.338334:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3c9ff68 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166862.338495:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.338550:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444593536 00000100:00100000:2.0:1762166862.338556:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444593536 00000100:00100000:2.0:1762166862.338592:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1313 00000100:00100000:2.0:1762166862.338601:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2358:x1847765444593536:12345-192.168.203.35@tcp:2:chown.0 00002000:00010000:2.0:1762166862.338734:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166862.338737:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb mtime from disk: 1762166862 -> 1762166862 00002000:00010000:2.0:1762166862.338740:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166862.338742:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb ctime from disk: 1762166862 -> 1762166862 00002000:00010000:2.0:1762166862.338743:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166862.338814:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2358:x1847765444593536:12345-192.168.203.35@tcp:2:chown.0 Request processed in 214us (318us total) trans 17179869477 rc 0/0 00000100:00100000:2.0:1762166862.338822:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1313 00000001:00080000:1.0:1762166862.516052:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836803 is committed 00000001:00080000:1.0:1762166862.516068:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836802 is committed 00000001:00080000:1.0:1762166862.516102:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836805 is committed 00000001:00080000:1.0:1762166862.516109:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836804 is committed 00000100:00100000:3.0:1762166862.948020:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166862.948089:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.948097:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444593792 00000100:00100000:2.0:1762166862.948108:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444593792 00000100:00100000:3.0:1762166862.948126:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.948162:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 12 00000100:00100000:3.0:1762166862.948168:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166862.948178:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444593792:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:1.0:1762166862.948195:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444593920 00000100:00100000:1.0:1762166862.948201:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444593920 00000100:00100000:3.0:1762166862.948203:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444594048 00000100:00100000:3.0:1762166862.948209:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444594048 00000100:00100000:0.0:1762166862.948235:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444593664 00000100:00100000:0.0:1762166862.948244:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444593664 00000100:00100000:3.0:1762166862.948253:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 201 00000100:00100000:2.0:1762166862.948259:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765444593792:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 83us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166862.948269:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765444594048:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:1.0:1762166862.948270:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 202 00000100:00100000:2.0:1762166862.948271:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 12 00000100:00100000:0.0:1762166862.948278:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 63 00000100:00100000:1.0:1762166862.948289:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444593920:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:0.0:1762166862.948289:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2361:x1847765444593664:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762166862.948311:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765444594048:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 48us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166862.948319:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 201 00000100:00100000:0.0:1762166862.948335:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2361:x1847765444593664:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 49us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166862.948345:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444593920:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 61us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166862.948345:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 63 00000100:00100000:1.0:1762166862.948359:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 202 00000100:00080000:3.0:1762166862.948369:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1762166863.271954:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166864.039956:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f1807908-b95d-4027-b65a-753b7d69e554:3296:1847765452019840:0@lo:400:kworker.0 00000100:00100000:2.0:1762166864.039973:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765452019712:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1762166864.040002:0:30843:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 484832235691ns, next at 485832226868ns, rc = 0 00000100:00100000:0.0:1762166864.040016:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1847765452020096:0@lo:400:kworker.0 00000100:00100000:3.0:1762166864.040049:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166864.040049:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166864.040066:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762166864.040110:0:30841:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 484832346118ns, next at 485832343686ns, rc = 0 00000100:00100000:2.0:1762166864.040115:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765452020224:0@lo:400:kworker.0 00000100:00100000:3.0:1762166864.040128:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765452020352:0@lo:400:kworker.0 00000100:00100000:0.0:1762166864.040129:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765452020608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1762166864.040149:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166864.040150:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765452019968:0@lo:400:kworker.0 00000100:00100000:0.0:1762166864.040189:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166864.040192:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166864.040193:0:6537:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452019712 00000100:00100000:2.0:1762166864.040201:0:6537:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452019712 00000100:00080000:3.0:1762166864.040247:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166864.040247:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452020608 00000100:00100000:1.0:1762166864.040256:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166864.040259:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452020608 00000100:00100000:2.0:1762166864.040276:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1762166864.040292:0:6537:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1847765452019712:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166864.040294:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452020096 00000100:00100000:3.0:1762166864.040301:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452020096 00000100:00100000:1.0:1762166864.040301:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1847765452020480:0@lo:400:kworker.0 00000100:00100000:0.0:1762166864.040315:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1762166864.040335:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1847765452020608:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762166864.040345:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1762166864.040353:0:6537:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 61014016 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1762166864.040356:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452019968 00000100:00100000:3.0:1762166864.040362:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452019968 00002000:00000024:0.0:1762166864.040369:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 56033280 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1762166864.040435:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452020480 00000100:00100000:1.0:1762166864.040435:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452020224 00000100:00100000:1.0:1762166864.040444:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452020224 00000100:00100000:3.0:1762166864.040445:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452020480 00000100:00100000:2.0:1762166864.040457:0:6537:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1847765452019712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166864.040458:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1847765452020608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166864.040475:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1762166864.040487:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1762166864.040514:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1762166864.040522:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452020352 00000100:00100000:1.0:1762166864.040527:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452020352 00000100:00100000:3.0:1762166864.040530:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1847765452020096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166864.040544:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1762166864.040551:0:3294:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836805 gen 2 00000004:00080000:0.0:1762166864.040559:0:3294:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836788 committed transno 21474836805 00000100:00100000:1.0:1762166864.040565:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1762166864.040566:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1847765452019968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166864.040585:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1847765452020224:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1762166864.040590:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34371b100, transno 21474836790 00000100:00100000:3.0:1762166864.040594:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1847765452020096:12345-0@lo:400:kworker.0 Request processed in 63us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166864.040611:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1847765452019968:12345-0@lo:400:kworker.0 Request processed in 56us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166864.040618:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1762166864.040620:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34371ad80, transno 21474836791 00000004:00080000:0.0:1762166864.040630:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee343719880, transno 21474836792 00000100:00100000:3.0:1762166864.040632:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:0.0:1762166864.040642:0:3294:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836794 committed transno 21474836805 00000100:00100000:2.0:1762166864.040655:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1762166864.040661:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1847765452020224:12345-0@lo:400:kworker.0 Request processed in 83us (516us total) trans 0 rc 0/0 00000004:00080000:0.0:1762166864.040664:0:3294:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836797 committed transno 21474836805 00000100:00100000:2.0:1762166864.040670:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1847765452020480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166864.040676:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000004:00080000:0.0:1762166864.040684:0:3294:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836800 committed transno 21474836805 00000100:00100000:1.0:1762166864.040699:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1762166864.040708:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765452020352:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1762166864.040708:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dc33100, transno 21474836801 00000004:00080000:0.0:1762166864.040721:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dc31c00, transno 21474836802 00000004:00080000:0.0:1762166864.040731:0:3294:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836805 committed transno 21474836805 00000100:00100000:2.0:1762166864.040732:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1847765452020480:12345-0@lo:400:kworker.0 Request processed in 65us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166864.040744:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1762166864.040818:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765452020352:12345-0@lo:400:kworker.0 Request processed in 109us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166864.040821:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765452020608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1762166864.040826:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765452020224:0@lo:400:kworker.0 00000100:00100000:1.0:1762166864.040843:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1762166864.040856:0:3295:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869474 gen 2 00000100:00100000:0.0:1762166864.040858:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1847765452020096:0@lo:400:kworker.0 00000004:00080000:2.0:1762166864.040864:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f400a80, transno 17179869440 00000004:00080000:2.0:1762166864.040882:0:3295:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869442 committed transno 17179869474 00000100:00100000:1.0:1762166864.040925:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765452019968:0@lo:400:kworker.0 00000004:00080000:2.0:1762166864.040926:0:3295:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869445 committed transno 17179869474 00000004:00080000:2.0:1762166864.040958:0:3295:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869448 committed transno 17179869474 00000100:00100000:1.0:1762166864.040965:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1847765452020480:0@lo:400:kworker.0 00000100:00080000:0.0:1762166864.040966:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1762166864.040971:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce4000, transno 17179869450 00000100:00080000:0.0:1762166864.040975:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1762166864.040979:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee35047ca80, transno 17179869451 00000004:00080000:2.0:1762166864.040993:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce6680, transno 17179869452 00000004:00080000:2.0:1762166864.040997:0:3295:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869454 committed transno 17179869474 00000100:00100000:0.0:1762166864.041010:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452019840 00000100:00100000:0.0:1762166864.041016:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452019840 00000004:00080000:2.0:1762166864.041035:0:3295:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869457 committed transno 17179869474 00000004:00080000:3.0:1762166864.041041:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 2 in progress, 0 in flight, 3 done 00000004:00080000:2.0:1762166864.041055:0:3295:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869460 committed transno 17179869474 00000100:00100000:0.0:1762166864.041059:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1762166864.041069:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+18:3296:x1847765452019840:12345-0@lo:400:kworker.0 00000004:00080000:2.0:1762166864.041071:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317dc00, transno 17179869462 00000004:00080000:2.0:1762166864.041077:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317ed80, transno 17179869463 00000004:00080000:2.0:1762166864.041087:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317fb80, transno 17179869464 00000004:00080000:2.0:1762166864.041091:0:3295:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869466 committed transno 17179869474 00000004:00080000:2.0:1762166864.041106:0:3295:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869469 committed transno 17179869474 00000004:00080000:2.0:1762166864.041122:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de00000, transno 17179869471 00000100:00100000:0.0:1762166864.041124:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+18:3296:x1847765452019840:12345-0@lo:400:kworker.0 Request processed in 56us (1077us total) trans 0 rc 0/0 00000004:00080000:2.0:1762166864.041129:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de02680, transno 17179869472 00000100:00100000:0.0:1762166864.041132:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000004:00080000:2.0:1762166864.041137:0:3295:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869474 committed transno 17179869474 00000100:00100000:2.0:1762166864.041172:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765452019712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166864.041212:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765452020352:0@lo:400:kworker.0 00000100:00100000:0.0:1762166864.041232:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f1807908-b95d-4027-b65a-753b7d69e554:3296:1847765452019840:0@lo:400:kworker.0 00000004:00080000:1.0:1762166864.041390:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 3 in progress, 0 in flight, 6 done 00000004:00080000:1.0:1762166864.041487:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 0 in progress, 0 in flight, 3 done 00010000:00010000:3.0:1762166864.295900:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166865.319987:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1762166865.585758:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869477 is committed 00010000:00010000:0.0:1762166866.343910:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166867.347848:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166867.347956:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444594304 00000100:00100000:1.0:1762166867.347974:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444594304 00000100:00080000:0.0:1762166867.348059:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166867.348094:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 564 00000100:00100000:1.0:1762166867.348107:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:50081:x1847765444594304:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:1.0:1762166867.348155:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166867.348184:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9ff6f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9200c expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166867.348278:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9ff76 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348293:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9ff76 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348309:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9ff76 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348323:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ff7d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348329:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ff7d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348335:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ff7d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348585:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9ff84 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348594:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9ff84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348601:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9ff84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762166867.348611:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 4 00010000:00010000:1.0:1762166867.348729:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9ff76 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348745:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9ff76 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348752:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9ff76 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348758:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a27a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166867.348796:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9ff76 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348806:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9ff76 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348820:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:1.0:1762166867.348823:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166867.348828:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9ff76 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348834:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27a00/0xf915a5bdf3c9ff76 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348850:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ff7d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348856:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ff7d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348861:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ff7d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348865:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a26000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762166867.348867:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ff7d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348882:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ff7d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348888:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0xd5143738 (ffff9ee34ada3800) 00010000:00010000:1.0:1762166867.348890:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166867.348893:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ff7d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348899:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26000/0xf915a5bdf3c9ff7d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762166867.348960:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a27000/0xf915a5bdf3c9ff6f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9200c expref: 30 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166867.348972:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9ff84 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9200c expref: 29 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166867.348980:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01d00) 00010000:00010000:1.0:1762166867.348982:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166867.348985:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a26c00, rc 0) 00000100:00100000:1.0:1762166867.349061:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:50081:x1847765444594304:12345-192.168.203.35@tcp:101:cat.0 Request processed in 957us (1234us total) trans 8589935204 rc 0/0 00000100:00100000:1.0:1762166867.349069:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 564 00000100:00100000:2.0:1762166867.350662:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166867.350719:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444594432 00000100:00100000:1.0:1762166867.350728:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444594432 00000100:00100000:3.0:1762166867.350808:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 246 00000100:00100000:3.0:1762166867.350823:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358650850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:50081:x1847765444594432:12345-192.168.203.35@tcp:49:cat.0 00000100:00100000:3.0:1762166867.350931:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358650850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:50081:x1847765444594432:12345-192.168.203.35@tcp:49:cat.0 Request processed in 113us (276us total) trans 0 rc -61/-61 00000100:00100000:3.0:1762166867.350939:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 246 00000100:00100000:3.0:1762166867.353059:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166867.353175:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444594688 00000100:00100000:0.0:1762166867.353186:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444594688 00000100:00100000:0.0:1762166867.353239:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 247 00000100:00100000:0.0:1762166867.353254:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:50081:x1847765444594688:12345-192.168.203.35@tcp:35:cat.0 00000100:00100000:0.0:1762166867.353536:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:50081:x1847765444594688:12345-192.168.203.35@tcp:35:cat.0 Request processed in 284us (484us total) trans 8589935205 rc 0/0 00000100:00100000:0.0:1762166867.353544:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 247 00010000:00010000:2.0:1762166867.367994:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1762166867.636497:0:32137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935205 is committed 00000020:00080000:3.0:1762166867.636517:0:32137:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969131 batchid updated 00000004:00080000:3.0:1762166867.636549:0:32137:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00000004:00080000:1.0:1762166867.636551:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 15 committed 00000020:00080000:0.0:1762166867.636557:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969131 00000020:00080000:0.0:1762166867.636573:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969131 00000004:00080000:1.0:1762166867.636604:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 15 committed 00000100:00100000:0.0:1762166867.636676:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1762166867.636705:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765452020736:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762166867.636828:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166867.638236:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765452020864:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762166867.638245:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765452020992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166867.638295:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166867.638359:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166867.638378:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452020736 00000100:00100000:1.0:1762166867.638392:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452020736 00000100:00100000:2.0:1762166867.638411:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452020864 00000100:00100000:2.0:1762166867.638434:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452020864 00000100:00080000:0.0:1762166867.638499:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166867.638500:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452020992 00000100:00100000:1.0:1762166867.638507:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452020992 00000100:00080000:0.0:1762166867.638511:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166867.638556:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:3.0:1762166867.638570:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765452020736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1762166867.638600:0:6533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:141 count 1 00010000:00010000:3.0:1762166867.638625:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9ff92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166867.638645:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9faec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e92 expref: 9 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166867.638655:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1762166867.638662:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00010000:00010000:3.0:1762166867.638663:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166867.638674:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9ff92 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166867.638683:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765452020992:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1762166867.638721:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9faec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e92 expref: 9 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166867.638734:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:2.0:1762166867.638745:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765452020864:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1762166867.638747:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9faec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e92 expref: 9 pid: 12400 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1762166867.638759:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765452021120:192.168.203.35@tcp:104: 00002000:00080000:2.0:1762166867.638793:0:6532:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:141 count 1 00010000:00010000:2.0:1762166867.638809:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ff99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166867.638821:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f4f expref: 10 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166867.638827:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166867.638829:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166867.638831:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ff99 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166867.638854:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246eef3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1762166867.638857:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fce4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f4f expref: 10 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166867.638868:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fce4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f4f expref: 10 pid: 12400 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1762166867.638880:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f400a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765452021248:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166867.638916:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243596e40 going to sleep for 11 seconds 00002000:00010000:1.0:1762166867.639071:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166867.639076:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb mtime from disk: 1762166862 -> 1762166862 00002000:00010000:1.0:1762166867.639079:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166867.639082:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb ctime from disk: 1762166862 -> 1762166862 00002000:00010000:1.0:1762166867.639085:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:1.0:1762166867.639187:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3293:x1847765452020992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 510us (842us total) trans 17179869478 rc 0/0 00000100:00100000:1.0:1762166867.639195:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000004:00080000:2.0:1762166867.639321:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435aa300/2, rc 0, transno 17179869478 00000100:00100000:2.0:1762166867.639329:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765452020992:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166867.640984:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f400a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765452021248:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166867.641024:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762166867.641044:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ff99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166867.641059:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765452021120:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166867.641093:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9ff92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166867.641103:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166867.641121:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444594944 00000100:00100000:2.0:1762166867.641131:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444594944 00010000:00010000:2.0:1762166867.641192:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fce4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f4f expref: 11 pid: 12400 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1762166867.641197:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444594816 00000100:00100000:3.0:1762166867.641210:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444594816 00000100:00100000:2.0:1762166867.641245:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 916 00010000:00010000:3.0:1762166867.641255:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9faec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e92 expref: 10 pid: 12400 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1762166867.641265:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765444594944:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166867.641295:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166867.641301:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fce4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f4f expref: 11 pid: 12400 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1762166867.641312:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fce4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f4f expref: 11 pid: 12400 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1762166867.641338:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9fce4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f4f expref: 11 pid: 12400 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1762166867.641368:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166867.641371:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166867.641377:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ff99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166867.641390:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ff99 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1762166867.641395:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1762166867.641404:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166867.641416:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 917 00000100:00100000:3.0:1762166867.641435:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444594816:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166867.641436:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166867.641457:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166867.641467:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9faec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e92 expref: 10 pid: 12400 timeout: 588 lvb_type: 0 00010000:00010000:0.0:1762166867.641473:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ff99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166867.641491:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ff99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166867.641492:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9faec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e92 expref: 10 pid: 12400 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1762166867.641529:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2360:x1847765444594944:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 262us (500us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166867.641535:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ff99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166867.641559:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 916 00010000:00010000:0.0:1762166867.641562:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ff99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166867.641571:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3c9faec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91e92 expref: 10 pid: 12400 timeout: 588 lvb_type: 0 00010000:00010000:0.0:1762166867.641593:0:6532:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166867.641596:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166867.641601:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166867.641607:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9ff92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166867.641623:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166867.641638:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ff99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166867.641643:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9ff92 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166867.641658:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166867.641665:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ff99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166867.641697:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ff99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166867.641715:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ff99 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166867.641724:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ff99 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166867.641725:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166867.641739:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9ff92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166867.641750:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9ff92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166867.641759:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9ff92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166867.641795:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9ff92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166867.641818:0:6533:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1762166867.641825:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2361:x1847765444594816:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 392us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166867.641889:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 917 00010000:00010000:2.0:1762166867.641980:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166867.641987:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9ff92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166867.641995:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166867.642002:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9ff92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166867.642011:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9ff92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166867.642027:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9ff92 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166867.642036:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee348228800/0xf915a5bdf3c9ff92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166867.642064:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166867.642071:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166867.642075:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166867.642088:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166867.642369:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765452020864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3624us (4072us total) trans 17179869479 rc 0/0 00000100:00100000:1.0:1762166867.642375:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765452020736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3807us (5545us total) trans 21474836806 rc 0/0 00000100:00100000:0.0:1762166867.642396:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000004:00080000:2.0:1762166867.642406:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435ab480/2, rc 0, transno 17179869479 00000100:00100000:1.0:1762166867.642406:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:2.0:1762166867.642417:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765452020864:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1762166867.642436:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c3800/2, rc 0, transno 21474836806 00000100:00100000:2.0:1762166867.642440:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765452020736:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166868.068313:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166868.068409:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444595072 00000100:00100000:0.0:1762166868.068424:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444595072 00000100:00100000:1.0:1762166868.068445:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166868.068511:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 65 00000100:00100000:0.0:1762166868.068525:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2361:x1847765444595072:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:2.0:1762166868.068548:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444595200 00000100:00100000:2.0:1762166868.068560:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444595200 00000100:00100000:2.0:1762166868.068629:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16 00000100:00100000:0.0:1762166868.068637:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2361:x1847765444595072:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 112us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166868.068649:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444595200:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:0.0:1762166868.068652:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 65 00000100:00100000:2.0:1762166868.068748:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765444595200:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 107us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166868.068754:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16 00010000:00010000:1.0:1762166868.391973:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166869.160029:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765452021504:0@lo:400:kworker.0 00000100:00100000:1.0:1762166869.160099:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166869.160122:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1847765452021632:0@lo:400:kworker.0 00000100:00100000:2.0:1762166869.160163:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166869.160167:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1847765452022016:0@lo:400:kworker.0 00000100:00100000:0.0:1762166869.160168:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452021504 00000100:00100000:0.0:1762166869.160180:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452021504 00000100:00100000:2.0:1762166869.160195:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765452022144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762166869.160202:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166869.160236:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166869.160241:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1762166869.160255:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765452021504:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1762166869.160264:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166869.160280:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452021632 00000100:00100000:2.0:1762166869.160285:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452021632 00000100:00100000:1.0:1762166869.160290:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f1807908-b95d-4027-b65a-753b7d69e554:3294:1847765452021376:0@lo:400:kworker.0 00000100:00100000:0.0:1762166869.160321:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765452021504:12345-0@lo:400:kworker.0 Request processed in 69us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166869.160331:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452022016 00000100:00100000:1.0:1762166869.160334:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166869.160335:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1762166869.160350:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452022016 00000100:00100000:0.0:1762166869.160377:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1762166869.160383:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765452021888:0@lo:400:kworker.0 00000100:00100000:0.0:1762166869.160389:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1847765452021632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166869.160411:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1762166869.160416:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166869.160424:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1847765452022016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166869.160444:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1847765452021632:12345-0@lo:400:kworker.0 Request processed in 59us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166869.160448:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1762166869.160453:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1762166869.160458:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765452021760:0@lo:400:kworker.0 00000100:00100000:2.0:1762166869.160470:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1847765452022016:12345-0@lo:400:kworker.0 Request processed in 49us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166869.160478:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1762166869.160479:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452022144 00000100:00100000:0.0:1762166869.160484:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452021376 00000100:00100000:3.0:1762166869.160485:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452022144 00000100:00100000:0.0:1762166869.160491:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452021376 00000100:00100000:1.0:1762166869.160504:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166869.160527:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1762166869.160527:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1847765452021632:0@lo:400:kworker.0 00000100:00100000:1.0:1762166869.160531:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765452022272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166869.160534:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1762166869.160539:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765452022144:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762166869.160551:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3294:x1847765452021376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166869.160566:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1762166869.160575:0:8383:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 56033280 pending 0 free 3856662528 avail 3854565376 00000100:00100000:2.0:1762166869.160589:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452022272 00000100:00100000:2.0:1762166869.160592:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452022272 00000100:00100000:0.0:1762166869.160599:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3294:x1847765452021376:12345-0@lo:400:kworker.0 Request processed in 53us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166869.160606:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f1807908-b95d-4027-b65a-753b7d69e554:3294:1847765452021376:0@lo:400:kworker.0 00000100:00100000:0.0:1762166869.160611:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1762166869.160616:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1762166869.160626:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1847765452022272:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166869.160628:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765452022144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166869.160635:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1762166869.160635:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1762166869.160641:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1762166869.160643:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:2.0:1762166869.160648:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 61014016 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1762166869.160665:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765452021504:0@lo:400:kworker.0 00000100:00100000:0.0:1762166869.160666:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452021888 00000100:00100000:0.0:1762166869.160672:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452021888 00000100:00100000:1.0:1762166869.160681:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1847765452022016:0@lo:400:kworker.0 00000100:00100000:3.0:1762166869.160691:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452021760 00000100:00100000:2.0:1762166869.160691:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3294:x1847765452022272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166869.160695:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452021760 00000100:00100000:2.0:1762166869.160704:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1762166869.160710:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1762166869.160719:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3294:x1847765452021888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166869.160729:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1762166869.160738:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765452021760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166869.160752:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765452022144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762166869.160758:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3294:x1847765452021888:12345-0@lo:400:kworker.0 Request processed in 39us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166869.160789:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1762166869.160811:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765452021760:12345-0@lo:400:kworker.0 Request processed in 73us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166869.160812:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765452022272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166869.160825:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1762166869.160833:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765452021888:0@lo:400:kworker.0 00000100:00100000:1.0:1762166869.160856:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765452021760:0@lo:400:kworker.0 00010000:00010000:2.0:1762166869.416053:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166870.439973:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1762166870.710821:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869479 is committed 00010000:00010000:2.0:1762166871.463995:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166872.359971:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.360025:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444595456 00000100:00100000:2.0:1762166872.360036:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444595456 00000100:00080000:1.0:1762166872.360102:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166872.360115:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 565 00000100:00100000:2.0:1762166872.360128:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:49855:x1847765444595456:12345-192.168.203.35@tcp:101:bash.0 00010000:00010000:2.0:1762166872.360149:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166872.360170:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ffa0 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92013 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.360259:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ffa7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.360273:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ffa7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.360292:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ffa7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166872.360304:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 4 00010000:00010000:2.0:1762166872.360499:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ffa0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92013 expref: 30 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.360516:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ffa7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92013 expref: 29 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.360525:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01d00) 00010000:00010000:2.0:1762166872.360528:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166872.360532:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2e00, rc 0) 00000100:00100000:2.0:1762166872.360588:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49855:x1847765444595456:12345-192.168.203.35@tcp:101:bash.0 Request processed in 464us (626us total) trans 8589935206 rc 0/0 00000100:00100000:2.0:1762166872.360595:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 565 00000100:00100000:1.0:1762166872.362406:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166872.362454:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166872.362509:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444595584 00000100:00100000:2.0:1762166872.362521:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444595840 00000100:00100000:3.0:1762166872.362522:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444595584 00000100:00100000:2.0:1762166872.362533:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444595840 00000100:00100000:3.0:1762166872.362613:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 276 00000100:00100000:2.0:1762166872.362616:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 566 00000100:00100000:2.0:1762166872.362629:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49855:x1847765444595840:12345-192.168.203.35@tcp:36:bash.0 00000100:00100000:3.0:1762166872.362647:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765444595584:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166872.362663:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166872.362695:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166872.362696:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ffa7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92013 expref: 30 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.362723:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01d00) 00010000:00010000:2.0:1762166872.362727:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a26c00/0xf915a5bdf3c9ff84 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9200c expref: 29 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.362731:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166872.362753:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01d00) 00010000:00010000:2.0:1762166872.362759:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166872.362837:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765444595584:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 194us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166872.362847:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 276 00010000:00010000:2.0:1762166872.363096:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ffb5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.363114:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ffb5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.363139:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ffb5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:2.0:1762166872.363214:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935207 00000004:00010000:2.0:1762166872.363254:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002534370c reply state 00000000deb8083d transno 8589935208 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ffb5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166872.363264:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166872.363371:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49855:x1847765444595840:12345-192.168.203.35@tcp:36:bash.0 Request processed in 744us (914us total) trans 8589935208 rc 0/0 00000100:00100000:2.0:1762166872.363378:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 566 00000020:00080000:2.0:1762166872.363384:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762166872.364374:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ffb5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.364387:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ffb5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.364395:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ffb5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.364401:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166872.364410:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ffb5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.364418:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ffb5 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.364431:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01d00) 00010000:00010000:2.0:1762166872.364434:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166872.364438:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ffb5 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.364444:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ffb5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762166872.364783:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.364842:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444595968 00000100:00100000:2.0:1762166872.364852:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444595968 00002000:00010000:2.0:1762166872.364894:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/142 (0->18446744073709551615) 00000100:00080000:1.0:1762166872.364895:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:2.0:1762166872.364901:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374ab2680 with x1847765444595968 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166872.364911:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee374ab2680. 00000100:00100000:2.0:1762166872.364940:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 984 00000100:00100000:2.0:1762166872.364952:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2360:x1847765444595968:12345-192.168.203.35@tcp:10:bash.0 00002000:00010000:2.0:1762166872.365240:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166872.365244:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb mtime from disk: 1762166862 -> 1762166872 00002000:00010000:2.0:1762166872.365247:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166872.365249:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb ctime from disk: 1762166862 -> 1762166872 00002000:00010000:2.0:1762166872.365252:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762166872.365305:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765444595968:12345-192.168.203.35@tcp:10:bash.0 Request processed in 355us (546us total) trans 17179869480 rc 0/0 00000100:00100000:2.0:1762166872.365313:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 984 00002000:00010000:2.0:1762166872.365331:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/142 (0->18446744073709551615) 00002000:00100000:2.0:1762166872.365333:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374ab2680 with x1847765444595968 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166872.365337:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee374ab2680. 00000100:00100000:1.0:1762166872.367759:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166872.367842:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444596224 00000100:00100000:0.0:1762166872.367851:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444596224 00000100:00100000:0.0:1762166872.367910:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 248 00000100:00100000:0.0:1762166872.367922:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:49855:x1847765444596224:12345-192.168.203.35@tcp:35:bash.0 00000100:00100000:0.0:1762166872.368231:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:49855:x1847765444596224:12345-192.168.203.35@tcp:35:bash.0 Request processed in 310us (476us total) trans 8589935209 rc 0/0 00000100:00100000:0.0:1762166872.368240:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 248 00000100:00100000:1.0:1762166872.374644:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.374726:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444596352 00000100:00100000:2.0:1762166872.374736:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444596352 00000100:00100000:2.0:1762166872.374820:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 567 00000100:00100000:2.0:1762166872.374831:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:50083:x1847765444596352:12345-192.168.203.35@tcp:101:cp.0 00010000:00010000:2.0:1762166872.374866:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166872.374891:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ffbc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9201a expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.374955:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ffc3 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.374968:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ffc3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.374979:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ffc3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.374993:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ffca lrc: 3/1,0 mode: --/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.374999:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ffca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375005:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ffca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375112:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ffd1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375120:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ffd1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375127:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ffd1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166872.375154:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x49:0x0]: returning size 0 00000004:00200000:2.0:1762166872.375158:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166872.375197:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ffd1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375208:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ffd1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375216:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ffc3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375223:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ffc3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375229:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ffc3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375235:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166872.375239:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ffc3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375246:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ffc3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375257:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166872.375260:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166872.375264:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ffc3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375270:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3c9ffc3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375282:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ffca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375288:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ffca lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375294:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ffca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375299:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166872.375302:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ffca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375307:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ffca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375313:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x363df604 (ffff9ee359d01700) 00010000:00010000:2.0:1762166872.375330:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166872.375333:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ffca lrc: 2/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375339:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9ffca lrc: 0/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.375367:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3c9ffbc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9201a expref: 32 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.375384:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ffd1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9201a expref: 31 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.375392:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:2.0:1762166872.375395:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166872.375397:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d2800, rc 0) 00000100:00100000:2.0:1762166872.375454:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:50083:x1847765444596352:12345-192.168.203.35@tcp:101:cp.0 Request processed in 625us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166872.375461:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 567 00000100:00100000:3.0:1762166872.377100:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166872.377226:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444596480 00000100:00100000:0.0:1762166872.377247:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444596480 00000100:00080000:1.0:1762166872.377358:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166872.377375:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1317 00000100:00100000:0.0:1762166872.377395:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2361:x1847765444596480:12345-192.168.203.35@tcp:101:cp.0 00010000:00010000:0.0:1762166872.377418:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166872.377451:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9ffd8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92021 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166872.377482:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762166872.377505:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166872.377509:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166872.377521:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9ffd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92021 expref: 10 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166872.377544:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9ffd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92021 expref: 10 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166872.377558:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199e00, rc 0) 00000100:00100000:0.0:1762166872.377631:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444596480:12345-192.168.203.35@tcp:101:cp.0 Request processed in 245us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166872.377639:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1317 00000100:00100000:1.0:1762166872.379113:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.379173:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444596608 00000100:00100000:2.0:1762166872.379185:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444596608 00000100:00100000:2.0:1762166872.379262:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 568 00000100:00100000:2.0:1762166872.379273:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:50083:x1847765444596608:12345-192.168.203.35@tcp:101:cp.0 00010000:00010000:2.0:1762166872.379291:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166872.379308:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ffdf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92028 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.379374:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ffe6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379384:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ffe6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379392:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ffe6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379400:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ffed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379407:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ffed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379411:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ffed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379524:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fff4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379532:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fff4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379538:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fff4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166872.379563:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 5 00000004:00200000:2.0:1762166872.379567:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166872.379582:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fff4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379592:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fff4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379599:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ffe6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379605:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ffe6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379611:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ffe6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379615:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166872.379619:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ffe6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379626:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ffe6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379638:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:2.0:1762166872.379641:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166872.379646:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ffe6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379651:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3c9ffe6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379662:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ffed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379665:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ffed lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379669:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ffed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379671:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d3c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166872.379673:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ffed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379676:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ffed lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379680:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0xd5143738 (ffff9ee359d01600) 00010000:00010000:2.0:1762166872.379681:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166872.379682:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ffed lrc: 2/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379685:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3c9ffed lrc: 0/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.379712:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3c9ffdf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92028 expref: 33 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.379720:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fff4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92028 expref: 32 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.379725:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01d00) 00010000:00010000:2.0:1762166872.379726:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166872.379728:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3800, rc 0) 00000100:00100000:2.0:1762166872.379840:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:50083:x1847765444596608:12345-192.168.203.35@tcp:101:cp.0 Request processed in 568us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166872.379847:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 568 00000100:00100000:1.0:1762166872.381644:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166872.381723:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444596736 00000100:00100000:0.0:1762166872.381731:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444596736 00000100:00100000:0.0:1762166872.381806:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 249 00000100:00100000:0.0:1762166872.381817:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:50083:x1847765444596736:12345-192.168.203.35@tcp:49:cp.0 00000100:00100000:0.0:1762166872.381921:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:50083:x1847765444596736:12345-192.168.203.35@tcp:49:cp.0 Request processed in 106us (281us total) trans 0 rc -61/-61 00000100:00100000:0.0:1762166872.381930:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 249 00000100:00100000:3.0:1762166872.382921:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.382963:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444596992 00000100:00100000:2.0:1762166872.382969:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444596992 00000100:00100000:2.0:1762166872.383008:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 569 00000100:00100000:2.0:1762166872.383015:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:50083:x1847765444596992:12345-192.168.203.35@tcp:101:cp.0 00010000:00010000:2.0:1762166872.383025:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166872.383038:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fffb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9202f expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.383093:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3ca0002 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.383102:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3ca0002 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.383109:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3ca0002 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166872.383119:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 5 00010000:00010000:2.0:1762166872.383222:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3c9fffb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9202f expref: 35 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.383238:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3ca0002 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9202f expref: 34 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.383246:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01d00) 00010000:00010000:2.0:1762166872.383249:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166872.383252:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3000, rc 0) 00000100:00100000:2.0:1762166872.383288:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:50083:x1847765444596992:12345-192.168.203.35@tcp:101:cp.0 Request processed in 275us (369us total) trans 8589935210 rc 0/0 00000100:00100000:2.0:1762166872.383293:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 569 00000100:00100000:2.0:1762166872.384870:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166872.384931:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444597248 00000100:00100000:3.0:1762166872.384939:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444597248 00000100:00100000:3.0:1762166872.384983:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 570 00000100:00100000:3.0:1762166872.384990:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:50083:x1847765444597248:12345-192.168.203.35@tcp:101:cp.0 00010000:00010000:3.0:1762166872.385004:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166872.385015:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca0010 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92036 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.385084:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca0017 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166872.385096:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca0017 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762166872.385105:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca0017 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762166872.385147:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x49:0x0]: returning size 0 00010000:00010000:3.0:1762166872.385247:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca0010 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92036 expref: 37 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.385264:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca0017 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92036 expref: 36 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.385273:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:3.0:1762166872.385275:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166872.385278:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228400, rc 0) 00000100:00100000:3.0:1762166872.385336:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:50083:x1847765444597248:12345-192.168.203.35@tcp:101:cp.0 Request processed in 346us (478us total) trans 8589935211 rc 0/0 00000100:00100000:3.0:1762166872.385343:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 570 00000100:00100000:1.0:1762166872.386590:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762166872.386626:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166872.386665:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444597376 00000100:00100000:2.0:1762166872.386666:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444597632 00000100:00100000:3.0:1762166872.386672:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444597376 00000100:00100000:2.0:1762166872.386672:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444597632 00000100:00100000:2.0:1762166872.386719:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 571 00000100:00100000:3.0:1762166872.386726:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 277 00000100:00100000:2.0:1762166872.386733:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:50083:x1847765444597632:12345-192.168.203.35@tcp:36:cp.0 00000100:00100000:3.0:1762166872.386741:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:2360:x1847765444597376:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166872.386754:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166872.386800:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca0017 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92036 expref: 37 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.386806:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166872.386821:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:2.0:1762166872.386823:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3c9ffd1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9201a expref: 36 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.386826:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166872.386840:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee359d01200) 00010000:00010000:2.0:1762166872.386850:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166872.386878:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765444597376:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 139us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166872.386886:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 277 00010000:00010000:2.0:1762166872.387059:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca0025 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.387075:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca0025 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.387083:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca0025 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:2.0:1762166872.387143:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935212 00000004:00010000:2.0:1762166872.387164:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000048c86305 reply state 000000005150e513 transno 8589935213 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca0025 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166872.387173:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166872.387232:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:50083:x1847765444597632:12345-192.168.203.35@tcp:36:cp.0 Request processed in 503us (604us total) trans 8589935213 rc 0/0 00000100:00100000:2.0:1762166872.387238:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 571 00000020:00080000:2.0:1762166872.387242:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762166872.387794:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca0025 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166872.387804:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca0025 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166872.387810:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca0025 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166872.387816:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166872.387820:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca0025 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166872.387828:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca0025 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166872.387839:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee359d01600) 00010000:00010000:0.0:1762166872.387842:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166872.387845:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca0025 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166872.387849:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca0025 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166872.388004:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.388042:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444597760 00000100:00100000:2.0:1762166872.388048:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444597760 00000100:00100000:2.0:1762166872.388080:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 572 00000100:00100000:2.0:1762166872.388088:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:50083:x1847765444597760:12345-192.168.203.35@tcp:101:cp.0 00010000:00010000:2.0:1762166872.388101:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166872.388113:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3ca002c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9203d expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.388147:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3ca002c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9203d expref: 37 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.388158:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3ca002c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9203d expref: 37 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.388172:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee359d01700) 00010000:00010000:2.0:1762166872.388175:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166872.388178:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3c00, rc 0) 00000100:00100000:2.0:1762166872.388212:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:50083:x1847765444597760:12345-192.168.203.35@tcp:101:cp.0 Request processed in 125us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166872.388219:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 572 00000100:00100000:1.0:1762166872.389157:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166872.389191:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444597888 00000100:00100000:0.0:1762166872.389197:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444597888 00000100:00100000:0.0:1762166872.389240:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1318 00000100:00100000:0.0:1762166872.389250:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:50083:x1847765444597888:12345-192.168.203.35@tcp:101:cp.0 00010000:00010000:0.0:1762166872.389260:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166872.389272:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca0033 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92044 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166872.389294:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9ffd8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92021 expref: 11 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166872.389303:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166872.389305:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166872.389309:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca0033 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92044 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166872.389353:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9ffd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92021 expref: 11 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166872.389371:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9ffd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92021 expref: 11 pid: 6532 timeout: 593 lvb_type: 1 00000100:00100000:0.0:1762166872.389384:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765452022400:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166872.389459:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36cb756c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166872.390370:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765452022400:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166872.390456:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca0033 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40000080020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92044 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.390472:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198a00, rc 0) 00000100:00100000:1.0:1762166872.390562:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166872.390607:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:50083:x1847765444597888:12345-192.168.203.35@tcp:101:cp.0 Request processed in 1272us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166872.390616:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1318 00000100:00100000:0.0:1762166872.390645:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444598016 00000100:00100000:0.0:1762166872.390652:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444598016 00010000:00010000:0.0:1762166872.390687:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9ffd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92021 expref: 12 pid: 6532 timeout: 593 lvb_type: 1 00000100:00100000:0.0:1762166872.390724:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 918 00000100:00100000:0.0:1762166872.390734:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444598016:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166872.390746:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166872.390751:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9ffd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92021 expref: 11 pid: 6532 timeout: 593 lvb_type: 1 00010000:00010000:0.0:1762166872.390801:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9ffd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92021 expref: 11 pid: 6532 timeout: 593 lvb_type: 1 00010000:00010000:0.0:1762166872.390823:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3c9ffd8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92021 expref: 11 pid: 6532 timeout: 593 lvb_type: 1 00010000:00010000:0.0:1762166872.390833:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166872.390835:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166872.390840:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca0033 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40080080020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92044 expref: 10 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166872.390846:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca0033 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40080080020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92044 expref: 10 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166872.390873:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca0033 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92044 expref: 10 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166872.390897:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765452022528:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762166872.390950:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36cb756c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166872.391966:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765452022528:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762166872.391988:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166872.392031:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444598016:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1298us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166872.392034:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166872.392045:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 918 00000100:00100000:2.0:1762166872.392078:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444598144 00000100:00100000:2.0:1762166872.392085:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444598144 00002000:00010000:2.0:1762166872.392112:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/143 (0->18446744073709551615) 00002000:00100000:2.0:1762166872.392117:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24550dc00 with x1847765444598144 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166872.392124:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24550dc00. 00000100:00100000:2.0:1762166872.392149:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 985 00000100:00100000:2.0:1762166872.392158:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444598144:12345-192.168.203.35@tcp:10:cp.0 00002000:00010000:2.0:1762166872.392439:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166872.392443:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb mtime from disk: 0 -> 1762166872 00002000:00010000:2.0:1762166872.392446:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166872.392448:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb ctime from disk: 0 -> 1762166872 00002000:00010000:2.0:1762166872.392450:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166872.392493:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444598144:12345-192.168.203.35@tcp:10:cp.0 Request processed in 336us (462us total) trans 21474836807 rc 0/0 00000100:00100000:2.0:1762166872.392500:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 985 00002000:00010000:2.0:1762166872.392504:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/143 (0->18446744073709551615) 00002000:00100000:2.0:1762166872.392529:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24550dc00 with x1847765444598144 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166872.392534:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24550dc00. 00000100:00100000:1.0:1762166872.393837:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.393876:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444598272 00000100:00100000:2.0:1762166872.393883:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444598272 00000100:00100000:2.0:1762166872.393924:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 573 00000100:00100000:2.0:1762166872.393931:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:50083:x1847765444598272:12345-192.168.203.35@tcp:101:cp.0 00010000:00010000:2.0:1762166872.393945:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166872.393964:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3ca003a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9204b expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.394034:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3ca0041 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.394045:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3ca0041 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.394054:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3ca0041 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762166872.394073:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x49:0x0]: returning size 0 00000004:00200000:2.0:1762166872.394077:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166872.394093:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3ca0041 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.394115:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2400/0xf915a5bdf3ca003a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9204b expref: 39 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.394129:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3ca0041 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9204b expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.394137:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee359d01700) 00010000:00010000:2.0:1762166872.394139:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166872.394142:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2482d3200, rc 0) 00000100:00100000:2.0:1762166872.394184:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:50083:x1847765444598272:12345-192.168.203.35@tcp:101:cp.0 Request processed in 253us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166872.394191:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 573 00000100:00100000:1.0:1762166872.396909:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.396981:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444598528 00000100:00100000:2.0:1762166872.396997:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444598528 00000100:00100000:2.0:1762166872.397045:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 574 00000100:00100000:2.0:1762166872.397053:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:50083:x1847765444598528:12345-192.168.203.35@tcp:36:cp.0 00010000:00010000:2.0:1762166872.397095:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166872.397118:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3200/0xf915a5bdf3ca0041 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9204b expref: 38 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.397131:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee359d01700) 00010000:00010000:2.0:1762166872.397134:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166872.397163:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3ca0048 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.397171:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3ca0048 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.397177:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3ca0048 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:2.0:1762166872.397280:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008994ae10 reply state 00000000c2bda483 transno 8589935214 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3ca0048 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166872.397286:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166872.397375:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:50083:x1847765444598528:12345-192.168.203.35@tcp:36:cp.0 Request processed in 322us (479us total) trans 8589935214 rc 0/0 00000100:00100000:2.0:1762166872.397383:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 574 00010000:00010000:2.0:1762166872.398428:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3ca0048 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.398440:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3ca0048 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.398448:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3ca0048 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.398455:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166872.398459:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3ca0048 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.398467:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3ca0048 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.398483:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee359d01700) 00010000:00010000:2.0:1762166872.398486:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166872.398490:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3ca0048 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.398496:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2800/0xf915a5bdf3ca0048 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166872.398918:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166872.399091:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444598656 00000100:00100000:3.0:1762166872.399100:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444598656 00000100:00100000:3.0:1762166872.399143:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1319 00000100:00100000:3.0:1762166872.399151:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444598656:12345-192.168.203.35@tcp:2:cp.0 00002000:00010000:3.0:1762166872.399304:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166872.399308:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb mtime from disk: 1762166872 -> 1762166872 00002000:00010000:3.0:1762166872.399311:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb atime from disk: 0 -> 1762166867 00002000:00010000:3.0:1762166872.399313:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb ctime from disk: 1762166872 -> 1762166872 00002000:00010000:3.0:1762166872.399328:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762166872.399376:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444598656:12345-192.168.203.35@tcp:2:cp.0 Request processed in 226us (463us total) trans 21474836808 rc 0/0 00000100:00100000:3.0:1762166872.399381:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1319 00000100:00100000:0.0:1762166872.400572:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.400614:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444598912 00000100:00100000:2.0:1762166872.400619:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444598912 00000100:00100000:2.0:1762166872.400650:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 575 00000100:00100000:2.0:1762166872.400656:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:50083:x1847765444598912:12345-192.168.203.35@tcp:55:cp.0 00010000:00010000:2.0:1762166872.400708:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca004f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.400721:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca004f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.400732:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca004f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.400751:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca004f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.400757:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca004f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.400782:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca004f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.400786:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166872.400788:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca004f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.400793:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca004f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.400800:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee359d01700) 00010000:00010000:2.0:1762166872.400802:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1762166872.400805:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca004f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x49:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.400814:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2200/0xf915a5bdf3ca004f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x49:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166872.400867:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:50083:x1847765444598912:12345-192.168.203.35@tcp:55:cp.0 Request processed in 209us (297us total) trans 0 rc -22/-22 00000100:00100000:2.0:1762166872.400875:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 575 00000100:00100000:1.0:1762166872.401749:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.401844:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444599168 00000100:00100000:2.0:1762166872.401852:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444599168 00000100:00100000:2.0:1762166872.401892:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 576 00000100:00100000:2.0:1762166872.401900:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:50083:x1847765444599168:12345-192.168.203.35@tcp:36:cp.0 00010000:00010000:2.0:1762166872.401951:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3ca0056 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.401963:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3ca0056 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.401976:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3ca0056 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:2.0:1762166872.402154:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000031f22944 reply state 00000000cf796635 transno 8589935215 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3ca0056 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166872.402163:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166872.402214:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:50083:x1847765444599168:12345-192.168.203.35@tcp:36:cp.0 Request processed in 314us (470us total) trans 8589935215 rc 0/0 00000100:00100000:2.0:1762166872.402221:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 576 00010000:00010000:0.0:1762166872.402876:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3ca0056 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166872.402886:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3ca0056 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166872.402892:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3ca0056 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166872.402897:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2482d2e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166872.402901:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3ca0056 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166872.402907:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3ca0056 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166872.402918:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee359d01700) 00010000:00010000:0.0:1762166872.402920:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1762166872.402924:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3ca0056 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166872.402933:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2e00/0xf915a5bdf3ca0056 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166872.403041:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.403073:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444599296 00000100:00100000:2.0:1762166872.403079:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444599296 00000100:00100000:2.0:1762166872.403110:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 577 00000100:00100000:2.0:1762166872.403117:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:50083:x1847765444599296:12345-192.168.203.35@tcp:101:cp.0 00010000:00010000:2.0:1762166872.403131:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166872.403141:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3ca005d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92052 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.403163:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3ca0064 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.403172:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3ca0064 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.403179:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3ca0064 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.403245:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3a00/0xf915a5bdf3ca005d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x49:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92052 expref: 41 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.403265:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3ca0064 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92052 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.403272:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee359d01700) 00010000:00010000:2.0:1762166872.403274:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166872.403277:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159600, rc 0) 00000100:00100000:2.0:1762166872.403323:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:50083:x1847765444599296:12345-192.168.203.35@tcp:101:cp.0 Request processed in 193us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166872.403331:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 577 00000100:00100000:1.0:1762166872.404202:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.404242:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444599552 00000100:00100000:2.0:1762166872.404246:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444599552 00000100:00100000:2.0:1762166872.404271:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 578 00000100:00100000:2.0:1762166872.404276:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:50083:x1847765444599552:12345-192.168.203.35@tcp:36:cp.0 00010000:00010000:2.0:1762166872.404312:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca006b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.404333:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca006b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.404341:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca006b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000040:00080000:2.0:1762166872.404568:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].21, 88 off9752 00000004:00080000:2.0:1762166872.404578:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 493196814860ns, next at 494196812408ns, rc = 0 00000004:00010000:2.0:1762166872.404640:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ed0cb5eb reply state 0000000059368bfe transno 8589935216 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca006b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166872.404648:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166872.404713:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:50083:x1847765444599552:12345-192.168.203.35@tcp:36:cp.0 Request processed in 435us (513us total) trans 8589935216 rc 0/0 00000100:00100000:2.0:1762166872.404719:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 578 00010000:00010000:2.0:1762166872.405450:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca006b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.405460:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca006b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.405466:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca006b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.405472:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166872.405476:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca006b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.405483:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca006b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.405494:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee359d01700) 00010000:00010000:2.0:1762166872.405497:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1762166872.405501:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca006b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.405505:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca006b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762166872.405668:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166872.405755:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444599680 00000100:00100000:3.0:1762166872.405783:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444599680 00000100:00100000:3.0:1762166872.405821:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1320 00000100:00100000:3.0:1762166872.405831:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444599680:12345-192.168.203.35@tcp:2:cp.0 00002000:00010000:3.0:1762166872.405961:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166872.405965:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb mtime from disk: 1762166872 -> 1762166872 00002000:00010000:3.0:1762166872.405967:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb atime from disk: 1762166867 -> 1762166867 00002000:00010000:3.0:1762166872.405970:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb ctime from disk: 1762166872 -> 1762166872 00002000:00010000:3.0:1762166872.405972:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762166872.406011:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444599680:12345-192.168.203.35@tcp:2:cp.0 Request processed in 181us (342us total) trans 21474836809 rc 0/0 00000100:00100000:3.0:1762166872.406017:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1320 00000100:00100000:0.0:1762166872.407154:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.407194:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444599936 00000100:00100000:2.0:1762166872.407199:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444599936 00000100:00100000:2.0:1762166872.407230:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 579 00000100:00100000:2.0:1762166872.407236:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+41:50083:x1847765444599936:12345-192.168.203.35@tcp:36:cp.0 00010000:00010000:2.0:1762166872.407275:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166872.407294:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3ca0064 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x49:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92052 expref: 41 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166872.407309:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee359d01700) 00010000:00010000:2.0:1762166872.407313:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166872.407340:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3ca0072 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.407352:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3ca0072 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762166872.407360:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3ca0072 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:2.0:1762166872.407509:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000098879a6 reply state 00000000542c9f7c transno 8589935217 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3ca0072 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166872.407518:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166872.407558:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:50083:x1847765444599936:12345-192.168.203.35@tcp:36:cp.0 Request processed in 322us (406us total) trans 8589935217 rc 0/0 00000100:00100000:2.0:1762166872.407563:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 579 00010000:00010000:0.0:1762166872.408365:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3ca0072 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166872.408373:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3ca0072 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166872.408377:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3ca0072 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166872.408380:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166872.408382:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3ca0072 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166872.408387:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3ca0072 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166872.408397:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee359d01700) 00000100:00100000:1.0:1762166872.408402:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762166872.408404:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1762166872.408410:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3ca0072 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762166872.408416:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158000/0xf915a5bdf3ca0072 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762166872.408477:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444600192 00000100:00100000:2.0:1762166872.408482:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444600192 00000100:00100000:2.0:1762166872.408515:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 250 00000100:00100000:2.0:1762166872.408524:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+41:50083:x1847765444600192:12345-192.168.203.35@tcp:35:cp.0 00000100:00100000:2.0:1762166872.408720:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:50083:x1847765444600192:12345-192.168.203.35@tcp:35:cp.0 Request processed in 198us (321us total) trans 8589935218 rc 0/0 00000100:00100000:2.0:1762166872.408726:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 250 00000100:00100000:1.0:1762166872.416248:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.416343:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444600448 00000100:00100000:2.0:1762166872.416354:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444600448 00000100:00100000:2.0:1762166872.416414:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 251 00000100:00100000:2.0:1762166872.416425:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:37763:x1847765444600448:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166872.416677:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:37763:x1847765444600448:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 253us (436us total) trans 8589935219 rc 0/0 00000100:00100000:2.0:1762166872.416686:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 251 00000100:00100000:0.0:1762166872.417871:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.417907:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444600704 00000100:00100000:2.0:1762166872.417915:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444600704 00000100:00100000:2.0:1762166872.417956:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 252 00000100:00100000:2.0:1762166872.417965:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358650c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:37763:x1847765444600704:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166872.418135:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358650c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:37763:x1847765444600704:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 170us (277us total) trans 8589935220 rc 0/0 00000100:00100000:2.0:1762166872.418143:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 252 00000100:00100000:1.0:1762166872.419022:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.419066:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444600960 00000100:00100000:2.0:1762166872.419073:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444600960 00000100:00100000:2.0:1762166872.419109:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 253 00000100:00100000:2.0:1762166872.419120:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:37763:x1847765444600960:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166872.419291:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+45:37763:x1847765444600960:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 172us (270us total) trans 8589935221 rc 0/0 00000100:00100000:2.0:1762166872.419299:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 253 00000100:00100000:1.0:1762166872.420194:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.420255:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444601216 00000100:00100000:2.0:1762166872.420260:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444601216 00000100:00100000:2.0:1762166872.420297:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 254 00000100:00100000:2.0:1762166872.420305:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+45:37763:x1847765444601216:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166872.420591:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:37763:x1847765444601216:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 286us (398us total) trans 8589935222 rc 0/0 00000100:00100000:2.0:1762166872.420602:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 254 00000100:00100000:0.0:1762166872.421387:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.421425:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444601472 00000100:00100000:2.0:1762166872.421431:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444601472 00000100:00100000:2.0:1762166872.421467:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 255 00000100:00100000:2.0:1762166872.421476:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+46:37763:x1847765444601472:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166872.421688:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:37763:x1847765444601472:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 213us (301us total) trans 8589935223 rc 0/0 00000100:00100000:2.0:1762166872.421695:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 255 00000100:00100000:1.0:1762166872.422537:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.422608:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444601728 00000100:00100000:2.0:1762166872.422614:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444601728 00000100:00100000:2.0:1762166872.422648:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 256 00000100:00100000:2.0:1762166872.422657:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+47:37763:x1847765444601728:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000001:00080000:2.0:1762166872.422918:0:30821:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935224 00000100:00100000:2.0:1762166872.422993:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:37763:x1847765444601728:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 337us (457us total) trans 8589935225 rc 0/0 00000100:00100000:2.0:1762166872.423001:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 256 00000020:00080000:2.0:1762166872.423005:0:30821:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166872.424062:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.424119:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444601984 00000100:00100000:2.0:1762166872.424125:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444601984 00000100:00100000:2.0:1762166872.424164:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 257 00000100:00100000:2.0:1762166872.424172:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+49:37763:x1847765444601984:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166872.424486:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:37763:x1847765444601984:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 314us (426us total) trans 8589935226 rc 0/0 00000100:00100000:2.0:1762166872.424494:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 257 00000100:00100000:0.0:1762166872.425301:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.425352:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444602240 00000100:00100000:2.0:1762166872.425362:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444602240 00000100:00100000:2.0:1762166872.425401:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 258 00000100:00100000:2.0:1762166872.425409:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358650050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+50:37763:x1847765444602240:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166872.425672:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358650050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:37763:x1847765444602240:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 263us (372us total) trans 8589935227 rc 0/0 00000100:00100000:2.0:1762166872.425679:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 258 00000100:00100000:1.0:1762166872.426874:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166872.426914:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444602496 00000100:00100000:2.0:1762166872.426921:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444602496 00000100:00100000:2.0:1762166872.426965:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 259 00000100:00100000:2.0:1762166872.426973:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+51:37763:x1847765444602496:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166872.427258:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:37763:x1847765444602496:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 285us (386us total) trans 8589935228 rc 0/0 00000100:00100000:2.0:1762166872.427267:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 259 00000100:00100000:1.0:1762166872.428333:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166872.428378:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444602624 00000100:00100000:3.0:1762166872.428385:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444602624 00000100:00100000:3.0:1762166872.428445:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 278 00000100:00100000:3.0:1762166872.428454:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+52:37763:x1847765444602624:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166872.428467:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 23 locks, starting at 0 00010000:00010000:3.0:1762166872.428491:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3000/0xf915a5bdf3ca0002 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9202f expref: 52 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428514:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3800/0xf915a5bdf3c9fff4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92028 expref: 51 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428524:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01d00) 00010000:00010000:3.0:1762166872.428533:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3c00/0xf915a5bdf3ca002c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x49:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9203d expref: 50 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428548:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee359d01700) 00010000:00010000:3.0:1762166872.428576:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2600/0xf915a5bdf3c9fe18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fa3 expref: 49 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428585:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee359d01f00) 00010000:00010000:3.0:1762166872.428595:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3c9feff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fe2 expref: 48 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428606:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3400/0xf915a5bdf3c9ff61 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92005 expref: 47 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428614:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee359d01d00) 00010000:00010000:3.0:1762166872.428624:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159200/0xf915a5bdf3c9ff37 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91ff7 expref: 46 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428632:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee359d01300) 00010000:00010000:3.0:1762166872.428642:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee244473400/0xf915a5bdf3c9d7d0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9116b expref: 45 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428649:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:3.0:1762166872.428656:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3e00/0xf915a5bdf3c9fde0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f95 expref: 44 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428666:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2c00/0xf915a5bdf3c9fdbd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91f8e expref: 43 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428673:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e:0x0].0x0 (ffff9ee359d01000) 00010000:00010000:3.0:1762166872.428681:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2439bf000/0xf915a5bdf3c9d599 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910ae expref: 42 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428699:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d:0x0].0x0 (ffff9ee34bdb4300) 00010000:00010000:3.0:1762166872.428711:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d2a00/0xf915a5bdf3c9d545 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f910a0 expref: 41 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428720:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:3.0:1762166872.428727:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2482d3600/0xf915a5bdf3c9d51b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9108b expref: 40 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428735:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a:0x0].0x0 (ffff9ee343a13900) 00010000:00010000:3.0:1762166872.428744:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686600/0xf915a5bdf3c9d2e4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fc7 expref: 39 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428752:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19:0x0].0x0 (ffff9ee360714c00) 00010000:00010000:3.0:1762166872.428794:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee245686200/0xf915a5bdf3c9d289 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fb9 expref: 38 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428813:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216ce00/0xf915a5bdf3c9d266 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90fab expref: 37 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428823:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14:0x0].0x0 (ffff9ee363960500) 00010000:00010000:3.0:1762166872.428834:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee382044e00/0xf915a5bdf3c9d1b0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f7a expref: 36 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428845:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee38216d600/0xf915a5bdf3c9d23c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90f9d expref: 35 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428853:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15:0x0].0x0 (ffff9ee363960600) 00010000:00010000:3.0:1762166872.428870:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14c00/0xf915a5bdf3c9cefb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a48 expref: 34 pid: 30855 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428879:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff9ee360714b00) 00010000:00010000:3.0:1762166872.428889:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3c9cef4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90a25 expref: 33 pid: 30855 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428897:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3:0x0].0x0 (ffff9ee360714d00) 00010000:00010000:3.0:1762166872.428906:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14a00/0xf915a5bdf3c9ceed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90c1d expref: 32 pid: 30855 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428930:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7:0x0].0x0 (ffff9ee360714900) 00010000:00010000:3.0:1762166872.428941:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc14200/0xf915a5bdf3c9cee6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cd3 expref: 31 pid: 30855 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428959:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xe:0x0].0x0 (ffff9ee360714000) 00010000:00010000:3.0:1762166872.428970:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15a00/0xf915a5bdf3c9cedf lrc: 0/0,0 mode: --/CR res: [0x200000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f90cef expref: 30 pid: 30855 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166872.428978:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xf:0x0].0x0 (ffff9ee360714700) 00010000:00010000:3.0:1762166872.428984:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166872.429034:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:37763:x1847765444602624:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 581us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166872.429042:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 278 00010000:00010000:1.0:1762166872.487969:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1762166872.760020:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935209 is committed 00000001:00080000:1.0:1762166872.760045:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935228 is committed 00000004:00080000:1.0:1762166872.760094:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 16 committed 00000100:00100000:0.0:1762166872.760275:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1762166872.760301:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765452022656:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1762166872.760360:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836806 is committed 00000001:00080000:1.0:1762166872.760376:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836807 is committed 00000100:00100000:0.0:1762166872.760384:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1762166872.760391:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836809 is committed 00000100:00100000:3.0:1762166872.760439:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452022656 00000100:00100000:3.0:1762166872.760448:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452022656 00000100:00080000:1.0:1762166872.760503:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166872.760513:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1762166872.760529:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765452022656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762166872.760726:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166872.760730:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb mtime from disk: 1762166872 -> 1762166872 00002000:00010000:3.0:1762166872.760733:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb atime from disk: 1762166867 -> 1762166867 00002000:00010000:3.0:1762166872.760735:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb ctime from disk: 1762166872 -> 1762166872 00002000:00010000:3.0:1762166872.760737:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:3.0:1762166872.760807:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765452022656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 284us (425us total) trans 21474836810 rc 0/0 00000100:00100000:3.0:1762166872.760815:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:0.0:1762166872.760846:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836806 gen 2 00000004:00080000:0.0:1762166872.760851:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c3800, transno 21474836806 00000100:00100000:0.0:1762166872.760864:0:3293:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee374ab3b80 x1847765452022656/t21474836810(21474836810) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166888 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1762166872.760875:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee374ab3b80/2, rc 0, transno 21474836810 00000100:00100000:0.0:1762166872.760879:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765452022656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166873.188058:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166873.188100:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166873.188120:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444602880 00000100:00100000:0.0:1762166873.188125:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166873.188132:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444602880 00000100:00100000:0.0:1762166873.188161:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166873.188164:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444602752 00000100:00100000:3.0:1762166873.188171:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444602752 00000100:00100000:2.0:1762166873.188196:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20 00000100:00100000:0.0:1762166873.188201:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444603008 00000100:00100000:0.0:1762166873.188206:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444603008 00000100:00100000:2.0:1762166873.188211:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2358:x1847765444602880:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762166873.188225:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 67 00000100:00100000:3.0:1762166873.188241:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343f6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2358:x1847765444602752:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:0.0:1762166873.188253:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444603136 00000100:00100000:0.0:1762166873.188258:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444603136 00000100:00100000:1.0:1762166873.188278:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 207 00000100:00100000:0.0:1762166873.188301:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 208 00000100:00100000:3.0:1762166873.188302:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343f6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2358:x1847765444602752:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 58us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166873.188302:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:2358:x1847765444602880:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 89us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166873.188324:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2359:x1847765444603008:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:2.0:1762166873.188343:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20 00000100:00100000:0.0:1762166873.188343:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2358:x1847765444603136:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762166873.188344:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 67 00000100:00100000:0.0:1762166873.188399:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2358:x1847765444603136:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 89us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166873.188405:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 208 00000100:00100000:1.0:1762166873.188425:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2359:x1847765444603008:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 128us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166873.188439:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 207 00010000:00010000:2.0:1762166873.511925:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166874.280070:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1847765452023168:0@lo:400:kworker.0 00000100:00100000:0.0:1762166874.280070:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765452022784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762166874.280168:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166874.280172:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166874.280243:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765452023040:0@lo:400:kworker.0 00000100:00100000:1.0:1762166874.280289:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1847765452023680:0@lo:400:kworker.0 00000100:00100000:0.0:1762166874.280290:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765452023552:0@lo:400:kworker.0 00000100:00100000:2.0:1762166874.280314:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166874.280359:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166874.280373:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166874.280384:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1847765452023296:0@lo:400:kworker.0 00000100:00100000:2.0:1762166874.280436:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166874.280451:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452023552 00000100:00100000:0.0:1762166874.280462:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452023552 00000100:00100000:1.0:1762166874.280467:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765452022912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166874.280493:0:6537:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452022784 00000100:00100000:3.0:1762166874.280501:0:6537:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452022784 00000100:00100000:0.0:1762166874.280537:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1762166874.280542:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166874.280566:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765452023552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166874.280603:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452023168 00000100:00100000:2.0:1762166874.280609:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452023168 00000100:00100000:0.0:1762166874.280633:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765452023552:12345-0@lo:400:kworker.0 Request processed in 69us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166874.280641:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452023680 00000100:00100000:0.0:1762166874.280642:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1762166874.280646:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452023680 00000100:00100000:2.0:1762166874.280670:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452023296 00000100:00100000:2.0:1762166874.280672:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452023296 00000100:00100000:0.0:1762166874.280684:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1762166874.280697:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1847765452023168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166874.280701:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1762166874.280711:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1847765452023680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166874.280742:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1847765452023168:12345-0@lo:400:kworker.0 Request processed in 49us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166874.280750:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1762166874.280757:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1847765452023680:12345-0@lo:400:kworker.0 Request processed in 47us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166874.280786:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1762166874.280795:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1762166874.280805:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1847765452023296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166874.280834:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452023040 00000100:00100000:2.0:1762166874.280839:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452023040 00000100:00100000:0.0:1762166874.280844:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1847765452023296:12345-0@lo:400:kworker.0 Request processed in 40us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166874.280853:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1762166874.280871:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1762166874.280880:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343f68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765452023040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166874.280893:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869479 gen 2 00000004:00080000:0.0:1762166874.280901:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435aa300, transno 17179869478 00000004:00080000:0.0:1762166874.280913:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435ab480, transno 17179869479 00000100:00100000:2.0:1762166874.280915:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343f68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765452023040:12345-0@lo:400:kworker.0 Request processed in 36us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166874.280923:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765452023552:0@lo:400:kworker.0 00000100:00100000:2.0:1762166874.280925:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1762166874.280967:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765452023040:0@lo:400:kworker.0 00000100:00100000:2.0:1762166874.280979:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1847765452023296:0@lo:400:kworker.0 00000100:00080000:2.0:1762166874.281028:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1762166874.281034:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1762166874.281037:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166874.281067:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1847765452023680:0@lo:400:kworker.0 00000100:00100000:2.0:1762166874.281087:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1847765452023168:0@lo:400:kworker.0 00000100:00100000:2.0:1762166874.281162:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452022912 00000100:00100000:2.0:1762166874.281167:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452022912 00000100:00100000:3.0:1762166874.281179:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1762166874.281197:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765452023424:0@lo:400:kworker.0 00000100:00100000:3.0:1762166874.281198:0:6537:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765452022784:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1762166874.281210:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1762166874.281226:0:6536:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765452022912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1762166874.281244:0:6537:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 56033280 pending 0 free 3856662528 avail 3854565376 00002000:00000024:2.0:1762166874.281251:0:6536:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 61014016 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1762166874.281259:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166874.281330:0:6536:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765452022912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166874.281334:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452023424 00000100:00100000:2.0:1762166874.281338:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1762166874.281342:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452023424 00000100:00100000:3.0:1762166874.281345:0:6537:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765452022784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166874.281361:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1762166874.281366:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765452022912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166874.281397:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1762166874.281406:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765452023424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166874.281456:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765452023424:12345-0@lo:400:kworker.0 Request processed in 52us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166874.281467:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1762166874.281471:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765452022784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1762166874.281528:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765452023424:0@lo:400:kworker.0 00010000:00010000:2.0:1762166874.536031:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166875.560179:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1762166875.824926:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869480 is committed 00010000:00010000:1.0:1762166876.583972:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166877.449043:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.449179:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444603264 00000100:00100000:2.0:1762166877.449189:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444603264 00000100:00100000:2.0:1762166877.449273:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 580 00000100:00100000:2.0:1762166877.449315:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+6:50091:x1847765444603264:12345-192.168.203.35@tcp:101:stat.0 00000100:00080000:1.0:1762166877.449318:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1762166877.449338:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166877.449368:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca0079 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92059 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.449439:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3ca0080 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.449451:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3ca0080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.449465:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3ca0080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:2.0:1762166877.449538:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:2.0:1762166877.449542:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 26 stripe count 1 MDT count 1 00000004:00010000:2.0:1762166877.449582:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3ca0080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.449618:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca0079 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92059 expref: 8 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.449638:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159e00/0xf915a5bdf3ca0080 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92059 expref: 7 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.449646:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:2.0:1762166877.449648:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762166877.449651:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159e00, rc 0) 00000100:00100000:2.0:1762166877.449708:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:50091:x1847765444603264:12345-192.168.203.35@tcp:101:stat.0 Request processed in 424us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.449715:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 580 00000100:00100000:2.0:1762166877.451191:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.451272:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444603392 00000100:00100000:3.0:1762166877.451290:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444603392 00000100:00100000:3.0:1762166877.451336:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 581 00000100:00100000:3.0:1762166877.451358:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+7:50091:x1847765444603392:12345-192.168.203.35@tcp:101:stat.0 00010000:00010000:3.0:1762166877.451373:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.451387:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca0087 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92060 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.451429:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca008e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451437:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca008e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451443:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca008e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451452:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca0095 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451456:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca0095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451459:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca0095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451560:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca009c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451565:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca009c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451569:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca009c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166877.451587:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x47:0x0]: returning size 11776 00000004:00200000:3.0:1762166877.451589:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166877.451614:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca009c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451622:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca008e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451626:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca008e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451630:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca008e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451634:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.451636:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca008e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451640:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca008e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451648:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:3.0:1762166877.451649:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166877.451652:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca008e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451655:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca008e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451663:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca0095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451666:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca0095 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451670:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca0095 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451679:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.451681:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca0095 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451684:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca0095 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451689:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x159f6f8a (ffff9ee363960700) 00010000:00010000:3.0:1762166877.451691:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166877.451693:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca0095 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451698:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca0095 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.451725:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca0087 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92060 expref: 9 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.451750:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca009c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92060 expref: 8 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.451758:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:3.0:1762166877.451799:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166877.451802:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348229400, rc 0) 00000100:00100000:3.0:1762166877.451863:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:50091:x1847765444603392:12345-192.168.203.35@tcp:101:stat.0 Request processed in 506us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.451868:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 581 00000100:00100000:0.0:1762166877.453205:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.453299:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444603520 00000100:00100000:2.0:1762166877.453306:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444603520 00000100:00100000:2.0:1762166877.453355:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 260 00000100:00100000:2.0:1762166877.453365:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:50091:x1847765444603520:12345-192.168.203.35@tcp:49:stat.0 00000100:00100000:2.0:1762166877.453453:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:50091:x1847765444603520:12345-192.168.203.35@tcp:49:stat.0 Request processed in 89us (250us total) trans 0 rc -61/-61 00000100:00100000:2.0:1762166877.453458:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 260 00000100:00100000:1.0:1762166877.454510:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.454567:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444603648 00000100:00100000:3.0:1762166877.454578:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444603648 00000100:00100000:3.0:1762166877.454663:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 582 00000100:00100000:3.0:1762166877.454674:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+8:50091:x1847765444603648:12345-192.168.203.35@tcp:101:stat.0 00010000:00010000:3.0:1762166877.454698:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.454721:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca00a3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92067 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.454821:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca00aa lrc: 3/1,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.454837:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca00aa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.454852:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca00aa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.454870:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00b1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.454877:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00b1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.454883:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00b1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455081:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca00b8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455090:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca00b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455097:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca00b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166877.455133:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 5 00000004:00200000:3.0:1762166877.455144:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166877.455169:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca00b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455182:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca00b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455192:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca00aa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455198:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca00aa lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455205:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca00aa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455211:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.455216:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca00aa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455225:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca00aa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455237:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:3.0:1762166877.455241:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166877.455246:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca00aa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455252:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca00aa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455267:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00b1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455273:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00b1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455301:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00b1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455306:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.455310:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00b1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455316:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00b1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455325:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0xd5143738 (ffff9ee363960600) 00010000:00010000:3.0:1762166877.455328:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166877.455330:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00b1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455336:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00b1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.455372:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca00a3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92067 expref: 10 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.455386:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca00b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92067 expref: 9 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.455394:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960500) 00010000:00010000:3.0:1762166877.455397:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166877.455400:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228200, rc 0) 00000100:00100000:3.0:1762166877.455472:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:50091:x1847765444603648:12345-192.168.203.35@tcp:101:stat.0 Request processed in 799us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.455481:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 582 00000100:00100000:1.0:1762166877.464580:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.464690:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444603776 00000100:00100000:2.0:1762166877.464700:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444603776 00000100:00100000:2.0:1762166877.464784:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 261 00000100:00100000:2.0:1762166877.464796:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:50092:x1847765444603776:12345-192.168.203.35@tcp:49:lfs.0 00000100:00100000:2.0:1762166877.464930:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:50092:x1847765444603776:12345-192.168.203.35@tcp:49:lfs.0 Request processed in 137us (359us total) trans 0 rc -61/-61 00000100:00100000:2.0:1762166877.464941:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 261 00000100:00100000:0.0:1762166877.466112:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.466169:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444604032 00000100:00100000:3.0:1762166877.466176:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444604032 00000100:00100000:3.0:1762166877.466221:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 583 00000100:00100000:3.0:1762166877.466232:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:50092:x1847765444604032:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.466246:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.466265:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca00bf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9206e expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.466360:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00c6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.466376:0:31205:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca00b8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92067 expref: 10 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.466384:0:31205:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00c6 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.466418:0:31205:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca00b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92067 expref: 10 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.466431:0:31205:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca00b8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92067 expref: 10 pid: 31205 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1762166877.466445:0:31205:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:31205:1847765452023808:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166877.466528:0:31205:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36cb75c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166877.469364:0:31205:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:31205:1847765452023808:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762166877.469377:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762166877.469402:0:31205:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00c6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000100:00100000:0.0:1762166877.469498:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444604160 00000100:00100000:0.0:1762166877.469507:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444604160 00010000:00010000:0.0:1762166877.469552:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca00b8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92067 expref: 11 pid: 31205 timeout: 598 lvb_type: 0 00000100:00100000:0.0:1762166877.469600:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 919 00000100:00100000:0.0:1762166877.469611:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765444604160:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166877.469627:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166877.469634:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca00b8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92067 expref: 11 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.469647:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca00b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92067 expref: 11 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.469676:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca00b8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92067 expref: 11 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.469693:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960500) 00010000:00010000:0.0:1762166877.469697:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00c6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166877.469708:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00c6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166877.469715:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00c6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166877.469751:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166877.469800:0:31205:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00c6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.469828:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00c6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166877.469851:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 5 00000100:00100000:0.0:1762166877.469877:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2360:x1847765444604160:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 266us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166877.469885:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 919 00010000:00010000:3.0:1762166877.470043:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca00bf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9206e expref: 11 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.470077:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00c6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9206e expref: 10 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.470085:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960500) 00010000:00010000:3.0:1762166877.470088:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166877.470091:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228800, rc 0) 00000100:00100000:3.0:1762166877.470131:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:50092:x1847765444604032:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3903us (4023us total) trans 8589935229 rc 0/0 00000100:00100000:3.0:1762166877.470139:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 583 00000100:00100000:1.0:1762166877.471907:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.471972:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444604416 00000100:00100000:3.0:1762166877.471984:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444604416 00000100:00100000:3.0:1762166877.472035:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 584 00000100:00100000:3.0:1762166877.472043:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:50092:x1847765444604416:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.472075:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.472097:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca00d4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92075 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.472163:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca00db lrc: 3/1,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472174:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca00db lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472193:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca00db lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472206:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca00e2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472212:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca00e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472217:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca00e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472352:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca00e9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472358:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca00e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472365:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca00e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166877.472373:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x49:0x0]: returning size 5 00010000:00010000:3.0:1762166877.472443:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca00db lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472449:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca00db lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472455:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca00db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472461:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.472473:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca00db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472491:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca00db lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472501:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:3.0:1762166877.472504:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166877.472508:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca00db lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472513:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca00db lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472524:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca00e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472529:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca00e2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472534:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca00e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472538:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.472540:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca00e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472544:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca00e2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472549:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x363df604 (ffff9ee363960600) 00010000:00010000:3.0:1762166877.472552:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166877.472554:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca00e2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472558:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca00e2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.472597:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca00d4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92075 expref: 13 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.472608:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca00e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92075 expref: 12 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.472614:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee363960700) 00010000:00010000:3.0:1762166877.472616:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166877.472618:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348229600, rc 0) 00000100:00100000:3.0:1762166877.472676:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:50092:x1847765444604416:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 633us (781us total) trans 8589935230 rc 0/0 00000100:00100000:3.0:1762166877.472683:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 584 00000100:00100000:1.0:1762166877.474167:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.474258:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444604544 00000100:00100000:0.0:1762166877.474266:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444604544 00000100:00100000:0.0:1762166877.474314:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 262 00000100:00100000:0.0:1762166877.474320:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:50092:x1847765444604544:12345-192.168.203.35@tcp:49:lfs.0 00000100:00100000:0.0:1762166877.474394:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:50092:x1847765444604544:12345-192.168.203.35@tcp:49:lfs.0 Request processed in 75us (238us total) trans 0 rc -61/-61 00000100:00100000:0.0:1762166877.474399:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 262 00000100:00100000:1.0:1762166877.475442:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.475574:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444604672 00000100:00100000:3.0:1762166877.475581:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444604672 00000100:00100000:3.0:1762166877.475619:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 585 00000100:00100000:3.0:1762166877.475626:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:50092:x1847765444604672:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.475643:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.475659:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca00f7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9207c expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.475716:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca00fe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.475726:0:31205:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00c6 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9206e expref: 13 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.475731:0:31205:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca00fe lrc: 4/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.475785:0:31205:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00c6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9206e expref: 13 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.475795:0:31205:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00c6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9206e expref: 13 pid: 31205 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1762166877.475805:0:31205:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:31205:1847765452023936:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166877.475874:0:31205:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36cb756c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166877.477118:0:31205:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:31205:1847765452023936:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166877.477155:0:31205:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca00fe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000100:00100000:1.0:1762166877.477185:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.477251:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444604800 00000100:00100000:2.0:1762166877.477259:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444604800 00010000:00010000:2.0:1762166877.477297:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00c6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9206e expref: 14 pid: 31205 timeout: 598 lvb_type: 0 00000100:00100000:2.0:1762166877.477330:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 920 00000100:00100000:2.0:1762166877.477338:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765444604800:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166877.477360:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166877.477368:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00c6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9206e expref: 14 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:2.0:1762166877.477384:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00c6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9206e expref: 14 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:2.0:1762166877.477400:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca00c6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9206e expref: 14 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:2.0:1762166877.477415:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960500) 00010000:00010000:2.0:1762166877.477420:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca00fe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.477427:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca00fe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.477433:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca00fe lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.477458:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166877.477483:0:31205:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca00fe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.477494:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca00fe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000100:00100000:2.0:1762166877.477502:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765444604800:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 163us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.477511:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 920 00000004:00200000:3.0:1762166877.477529:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 5 00000004:00200000:3.0:1762166877.477535:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166877.477554:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca00fe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.477588:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca00f7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9207c expref: 13 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.477608:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca00fe lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9207c expref: 12 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.477630:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960500) 00010000:00010000:3.0:1762166877.477634:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166877.477637:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348229800, rc 0) 00000100:00100000:3.0:1762166877.477718:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:50092:x1847765444604672:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2092us (2283us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.477725:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 585 00000100:00100000:1.0:1762166877.479332:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.479382:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444605056 00000100:00100000:3.0:1762166877.479389:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444605056 00000100:00100000:3.0:1762166877.479426:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 586 00000100:00100000:3.0:1762166877.479433:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:50092:x1847765444605056:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.479448:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.479461:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0105 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92083 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.479531:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca010c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.479541:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca010c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.479550:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca010c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166877.479559:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 5 00010000:00010000:3.0:1762166877.479647:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0105 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92083 expref: 15 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.479659:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca010c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92083 expref: 14 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.479676:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960500) 00010000:00010000:3.0:1762166877.479679:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166877.479682:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228600, rc 0) 00000100:00100000:3.0:1762166877.479738:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:50092:x1847765444605056:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 297us (406us total) trans 8589935231 rc 0/0 00000100:00100000:3.0:1762166877.479749:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 586 00000100:00100000:1.0:1762166877.525070:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.525152:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444605184 00000100:00100000:2.0:1762166877.525165:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444605184 00000100:00080000:1.0:1762166877.525230:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:2.0:1762166877.525245:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x8e:0x0] (0->4) req@ffff9ee36de01c00 x1847765444605184/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:663/0 lens 496/0 e 0 to 0 dl 1762166888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166877.525259:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de01c00 with x1847765444605184 ext(0->4) 00002000:00010000:2.0:1762166877.525265:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36de01c00 00000100:00100000:2.0:1762166877.525305:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 986 00000100:00100000:2.0:1762166877.525315:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2360:x1847765444605184:12345-192.168.203.35@tcp:4:lfs.0 00000100:00100000:2.0:1762166877.525757:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444605184:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 444us (705us total) trans 17179869481 rc 0/0 00000100:00100000:2.0:1762166877.525794:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 986 00002000:00100000:2.0:1762166877.525802:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x8e:0x0] (0->4) req@ffff9ee36de01c00 x1847765444605184/t17179869481(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:663/0 lens 496/448 e 0 to 0 dl 1762166888 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166877.525810:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de01c00 with x1847765444605184 ext(0->4) 00002000:00010000:2.0:1762166877.525814:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36de01c00 00000100:00100000:1.0:1762166877.527191:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.527243:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444605312 00000100:00100000:2.0:1762166877.527248:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444605312 00000100:00100000:2.0:1762166877.527296:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 987 00000100:00100000:2.0:1762166877.527305:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444605312:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762166877.527336:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca011a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.527353:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ff06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fe9 expref: 12 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.527362:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166877.527364:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166877.527367:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca011a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.527394:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ff06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fe9 expref: 12 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.527404:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ff06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fe9 expref: 12 pid: 12400 timeout: 598 lvb_type: 0 00000100:00100000:2.0:1762166877.527414:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765452024064:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166877.527471:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee342ae9840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166877.528469:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765452024064:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166877.528489:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca011a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166877.528737:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.528782:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444605440 00000100:00100000:2.0:1762166877.528786:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444605440 00010000:00010000:2.0:1762166877.528803:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ff06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fe9 expref: 13 pid: 12400 timeout: 598 lvb_type: 0 00000100:00100000:2.0:1762166877.528833:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 921 00000100:00100000:2.0:1762166877.528838:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444605440:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166877.528846:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1762166877.528869:0:7415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1762166877.528873:0:7415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb atime from disk: 0 -> 1762166872 00010000:00010000:2.0:1762166877.528879:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ff06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fe9 expref: 13 pid: 12400 timeout: 598 lvb_type: 0 00010000:00010000:2.0:1762166877.528890:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ff06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fe9 expref: 13 pid: 12400 timeout: 598 lvb_type: 0 00010000:00010000:2.0:1762166877.528911:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198c00/0xf915a5bdf3c9ff06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f91fe9 expref: 13 pid: 12400 timeout: 598 lvb_type: 0 00010000:00010000:2.0:1762166877.528924:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.528927:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.528930:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca011a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.528938:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca011a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.528956:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166877.528975:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca011a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.528987:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca011a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166877.528995:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444605440:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 155us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.529007:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 921 00010000:00010000:3.0:1762166877.529105:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca011a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.529115:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca011a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.529120:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca011a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.529125:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166877.529128:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca011a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.529133:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca011a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.529197:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca011a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.529204:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca011a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166877.529255:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444605312:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1951us (2066us total) trans 0 rc 5/5 00000100:00100000:3.0:1762166877.529265:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 987 00000100:00100000:1.0:1762166877.530417:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.530458:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444605568 00000100:00100000:3.0:1762166877.530464:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444605568 00002000:00100000:3.0:1762166877.530513:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x8f:0x0] (0->4) req@ffff9ee36de00700 x1847765444605568/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:663/0 lens 496/0 e 0 to 0 dl 1762166888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00080000:1.0:1762166877.530522:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1762166877.530523:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de00700 with x1847765444605568 ext(0->4) 00002000:00010000:3.0:1762166877.530531:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de00700 00000100:00100000:3.0:1762166877.530558:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 988 00000100:00100000:3.0:1762166877.530568:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2358:x1847765444605568:12345-192.168.203.35@tcp:4:lfs.0 00000100:00100000:3.0:1762166877.530881:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2358:x1847765444605568:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 314us (463us total) trans 21474836811 rc 0/0 00000100:00100000:3.0:1762166877.530889:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 988 00002000:00100000:3.0:1762166877.530897:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x8f:0x0] (0->4) req@ffff9ee36de00700 x1847765444605568/t21474836811(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:663/0 lens 496/448 e 0 to 0 dl 1762166888 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166877.530906:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de00700 with x1847765444605568 ext(0->4) 00002000:00010000:3.0:1762166877.530909:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de00700 00000100:00100000:1.0:1762166877.531937:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.532195:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444605696 00000100:00100000:3.0:1762166877.532206:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444605696 00000100:00100000:3.0:1762166877.532244:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 989 00000100:00100000:3.0:1762166877.532252:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2359:x1847765444605696:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762166877.532276:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0121 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.532306:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca0033 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92044 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.532313:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166877.532315:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166877.532318:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0121 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.532346:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca0033 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000080020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92044 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.532357:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca0033 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000480020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92044 expref: 12 pid: 6532 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1762166877.532369:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765452024192:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166877.532430:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36cb756c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166877.533388:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765452024192:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166877.533409:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0121 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166877.533726:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.533811:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444605824 00000100:00100000:0.0:1762166877.533817:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444605824 00010000:00010000:0.0:1762166877.533845:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca0033 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92044 expref: 13 pid: 6532 timeout: 598 lvb_type: 0 00000100:00100000:0.0:1762166877.533893:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 922 00000100:00100000:0.0:1762166877.533903:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765444605824:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166877.533916:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1762166877.533937:0:29775:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x8f:0x0] updating lvb size from disk: 0 -> 5 00010000:00010000:0.0:1762166877.533943:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca0033 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92044 expref: 13 pid: 6532 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.533953:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca0033 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000480020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92044 expref: 13 pid: 6532 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.533978:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca0033 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801480020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92044 expref: 13 pid: 6532 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.533993:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166877.533995:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166877.533998:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0121 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.534006:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0121 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.534032:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166877.534065:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0121 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166877.534079:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444605824:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 177us (353us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166877.534097:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0121 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166877.534097:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 922 00010000:00010000:3.0:1762166877.534203:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0121 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.534213:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0121 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.534220:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0121 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.534227:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166877.534231:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0121 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.534240:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0121 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.534253:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0121 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.534261:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0121 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166877.534352:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2359:x1847765444605696:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2099us (2416us total) trans 0 rc 5/5 00000100:00100000:3.0:1762166877.534360:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 989 00000100:00100000:1.0:1762166877.535589:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.535629:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444605952 00000100:00100000:0.0:1762166877.535634:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444605952 00000100:00100000:0.0:1762166877.535664:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1322 00000100:00100000:0.0:1762166877.535669:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444605952:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166877.535678:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166877.535691:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0128 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9208a expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166877.535706:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x8e:0x0] initial LVB size: 5, mtime: 0x69088858, atime: 0x69088858, ctime: 0x69088858, blocks: 0x3 00010000:00010000:0.0:1762166877.535715:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166877.535717:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166877.535722:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0128 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9208a expref: 12 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166877.535732:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0128 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9208a expref: 12 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166877.535739:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347198000, rc 0) 00000100:00100000:0.0:1762166877.535799:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444605952:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 128us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166877.535816:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1322 00000100:00100000:1.0:1762166877.546523:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.546636:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444606080 00000100:00100000:0.0:1762166877.546651:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444606080 00000100:00100000:0.0:1762166877.546721:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1323 00000100:00100000:0.0:1762166877.546736:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444606080:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762166877.546805:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca012f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.546822:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0128 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9208a expref: 12 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166877.546831:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166877.546833:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166877.546836:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca012f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.546887:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0128 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9208a expref: 12 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166877.546901:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0128 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9208a expref: 12 pid: 26444 timeout: 598 lvb_type: 1 00000100:00100000:0.0:1762166877.546916:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452024320:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166877.547003:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34bd2b180 going to sleep for 11 seconds 00000100:00100000:0.0:1762166877.548119:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452024320:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166877.548150:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca012f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166877.548366:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.548418:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444606208 00000100:00100000:0.0:1762166877.548426:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444606208 00010000:00010000:0.0:1762166877.548464:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0128 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9208a expref: 13 pid: 26444 timeout: 598 lvb_type: 1 00000100:00100000:0.0:1762166877.548511:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 923 00000100:00100000:0.0:1762166877.548520:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444606208:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166877.548536:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166877.548566:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0128 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9208a expref: 13 pid: 26444 timeout: 598 lvb_type: 1 00010000:00010000:0.0:1762166877.548579:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0128 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9208a expref: 13 pid: 26444 timeout: 598 lvb_type: 1 00010000:00010000:0.0:1762166877.548608:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0128 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9208a expref: 13 pid: 26444 timeout: 598 lvb_type: 1 00010000:00010000:0.0:1762166877.548626:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166877.548629:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166877.548635:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca012f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.548644:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca012f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.548677:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166877.548720:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca012f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.548729:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca012f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166877.548741:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444606208:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 219us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166877.548750:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 923 00010000:00010000:2.0:1762166877.548791:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca012f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.548802:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca012f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.548811:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca012f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.548819:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166877.548824:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca012f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.548833:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca012f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.548846:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca012f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.548853:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347198a00/0xf915a5bdf3ca012f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166877.548912:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765444606080:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2179us (2404us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.548922:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1323 00000100:00100000:1.0:1762166877.549921:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.549963:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444606336 00000100:00100000:2.0:1762166877.549971:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444606336 00000100:00100000:2.0:1762166877.550017:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1324 00000100:00100000:2.0:1762166877.550026:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765444606336:12345-192.168.203.35@tcp:1:lfs.0 00002000:00010000:2.0:1762166877.550086:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x8f:0x0] initial LVB size: 5, mtime: 0x69088858, atime: 0x69088853, ctime: 0x69088858, blocks: 0x3 00010000:00010000:2.0:1762166877.550093:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0136 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.550104:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.550106:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.550110:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0136 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.550123:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0136 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.550139:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0136 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.550146:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0136 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.550153:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0136 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.550159:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166877.550163:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0136 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.550175:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0136 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.550188:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0136 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.550195:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0136 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166877.550256:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765444606336:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 231us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.550264:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1324 00000100:00100000:1.0:1762166877.551411:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.551473:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444606592 00000100:00100000:3.0:1762166877.551480:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444606592 00000100:00100000:3.0:1762166877.551541:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 587 00000100:00100000:3.0:1762166877.551554:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:50092:x1847765444606592:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166877.551630:0:31205:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166877.551654:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca00fe lrc: 0/0,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9207c expref: 14 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.551670:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960500) 00010000:00010000:3.0:1762166877.551675:0:31205:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166877.551721:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca013d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.551735:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca013d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.551744:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca013d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00010000:3.0:1762166877.551982:0:31205:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005c42d594 reply state 00000000cc7cde47 transno 8589935232 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca013d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000100:00100000:3.0:1762166877.551992:0:31205:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166877.552079:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:50092:x1847765444606592:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 530us (673us total) trans 8589935232 rc 0/0 00000100:00100000:3.0:1762166877.552087:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 587 00010000:00010000:2.0:1762166877.552944:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca013d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.552957:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca013d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.552963:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca013d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.552974:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166877.552979:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca013d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.552987:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca013d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.553002:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960500) 00010000:00010000:2.0:1762166877.553006:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166877.553010:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca013d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.553015:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca013d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00000100:00100000:1.0:1762166877.553141:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.553177:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444606720 00000100:00100000:3.0:1762166877.553223:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444606720 00000100:00100000:3.0:1762166877.553271:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 588 00000100:00100000:3.0:1762166877.553291:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:50092:x1847765444606720:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.553329:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.553342:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca0144 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92091 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.553394:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca0144 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92091 expref: 15 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.553407:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca0144 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92091 expref: 15 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.553428:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960500) 00010000:00010000:3.0:1762166877.553430:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166877.553432:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348229200, rc 0) 00000100:00100000:3.0:1762166877.553465:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:50092:x1847765444606720:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 187us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.553472:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 588 00000100:00100000:1.0:1762166877.554940:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.554996:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444606848 00000100:00100000:2.0:1762166877.555005:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444606848 00000100:00100000:2.0:1762166877.555049:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1325 00000100:00100000:2.0:1762166877.555057:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:50092:x1847765444606848:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166877.555075:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166877.555092:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca014b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92098 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166877.555110:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x8e:0x0] initial LVB size: 5, mtime: 0x69088858, atime: 0x69088858, ctime: 0x69088858, blocks: 0x3 00010000:00010000:2.0:1762166877.555128:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.555129:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.555135:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca014b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92098 expref: 12 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.555146:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca014b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92098 expref: 12 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.555155:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159a00, rc 0) 00000100:00100000:2.0:1762166877.555200:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:50092:x1847765444606848:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 144us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.555204:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1325 00000100:00100000:1.0:1762166877.556299:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.556354:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444606976 00000100:00100000:2.0:1762166877.556359:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444606976 00000100:00100000:2.0:1762166877.556394:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1326 00000100:00100000:2.0:1762166877.556402:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444606976:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166877.556571:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1762166877.556575:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb mtime from disk: 1762166872 -> 1762166872 00002000:00010000:2.0:1762166877.556577:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb atime from disk: 1762166872 -> 1762166872 00002000:00010000:2.0:1762166877.556580:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb ctime from disk: 1762166872 -> 1762166877 00002000:00010000:2.0:1762166877.556582:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762166877.556623:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444606976:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 222us (326us total) trans 17179869482 rc 0/0 00000100:00100000:2.0:1762166877.556630:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1326 00000100:00100000:1.0:1762166877.557452:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.557570:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444607232 00000100:00100000:0.0:1762166877.557574:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444607232 00000100:00100000:0.0:1762166877.557605:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 263 00000100:00100000:0.0:1762166877.557610:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358652850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:50092:x1847765444607232:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762166877.557718:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x48:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca010c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92083 expref: 15 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.557751:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0152 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.557801:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca0144 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92091 expref: 15 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.557810:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0152 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.557844:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca0144 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92091 expref: 15 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.557862:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca0144 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92091 expref: 15 pid: 31205 timeout: 598 lvb_type: 0 00000100:00100000:0.0:1762166877.557875:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435aa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765452024448:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166877.557940:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34bd2b180 going to sleep for 11 seconds 00000100:00100000:0.0:1762166877.558922:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435aa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765452024448:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762166877.558942:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0152 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166877.559008:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.559074:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444607360 00000100:00100000:0.0:1762166877.559080:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444607360 00010000:00010000:0.0:1762166877.559103:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca0144 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92091 expref: 16 pid: 31205 timeout: 598 lvb_type: 0 00000100:00100000:0.0:1762166877.559134:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 924 00000100:00100000:0.0:1762166877.559143:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765444607360:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166877.559155:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166877.559162:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca0144 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92091 expref: 16 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.559173:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca0144 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92091 expref: 16 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.559188:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca0144 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92091 expref: 16 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.559209:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960500) 00010000:00010000:0.0:1762166877.559213:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0152 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.559221:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0152 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.559228:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0152 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.559252:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166877.559273:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0152 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166877.559294:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765444607360:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 152us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166877.559300:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 924 00010000:00010000:3.0:1762166877.559386:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0152 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.559402:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca0159 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.559449:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca00e9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92075 expref: 14 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.559458:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca0159 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.559505:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca00e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92075 expref: 14 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.559515:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca00e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92075 expref: 14 pid: 31205 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1762166877.559526:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765452024576:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166877.559573:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36cb75c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166877.560318:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765452024576:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166877.560334:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca0159 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166877.560636:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.560685:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444607488 00000100:00100000:0.0:1762166877.560691:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444607488 00010000:00010000:0.0:1762166877.560719:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca00e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92075 expref: 15 pid: 31205 timeout: 598 lvb_type: 0 00000100:00100000:0.0:1762166877.560758:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 925 00000100:00100000:0.0:1762166877.560790:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765444607488:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166877.560800:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166877.560807:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca00e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92075 expref: 15 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.560818:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca00e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92075 expref: 15 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.560837:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca00e9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92075 expref: 15 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.560850:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee363960700) 00010000:00010000:0.0:1762166877.560859:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca0159 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.560866:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca0159 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.560871:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca0159 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.560891:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166877.560924:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2361:x1847765444607488:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 136us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166877.560930:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 925 00010000:00010000:3.0:1762166877.560958:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca0159 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.560968:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca0159 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166877.561425:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452024704:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166877.561471:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166877.561499:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3504380c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166877.561519:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452024704 00000100:00100000:2.0:1762166877.561525:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452024704 00000100:00100000:2.0:1762166877.561578:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1762166877.561581:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166877.561588:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:31351:x1847765452024704:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166877.561661:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:31351:x1847765452024704:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 76us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.561669:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1762166877.561682:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452024704:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166877.561724:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452024832:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166877.561741:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166877.561756:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3504380c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166877.561794:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452024832 00000100:00100000:2.0:1762166877.561799:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452024832 00000100:00100000:2.0:1762166877.561833:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1762166877.561834:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166877.561845:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:31351:x1847765452024832:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166877.561896:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:31351:x1847765452024832:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 53us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.561903:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1762166877.561918:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452024832:0@lo:1000:mdt_rdpg00_002.0 00000040:00080000:3.0:1762166877.562087:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].2, 280 off33328 00000001:00080000:3.0:1762166877.562095:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935233 00000100:00100000:3.0:1762166877.562127:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452024960:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166877.562143:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166877.562161:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36cb75c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166877.562183:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452024960 00000100:00100000:2.0:1762166877.562188:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452024960 00000100:00100000:2.0:1762166877.562215:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1762166877.562222:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:31351:x1847765452024960:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166877.562359:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:31351:x1847765452024960:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 137us (213us total) trans 21474836812 rc 0/0 00000100:00100000:2.0:1762166877.562366:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1762166877.562397:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452024960:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166877.562418:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff80000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452025088:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166877.562440:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166877.562458:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36cb75c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166877.562483:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452025088 00000100:00100000:0.0:1762166877.562489:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452025088 00000100:00100000:0.0:1762166877.562518:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1762166877.562525:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:31351:x1847765452025088:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166877.562628:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:31351:x1847765452025088:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 102us (186us total) trans 17179869483 rc 0/0 00000100:00100000:0.0:1762166877.562634:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1762166877.562648:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff80000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452025088:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166877.562708:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935234 00010000:00010000:3.0:1762166877.562732:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca0159 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.562739:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca0159 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.562743:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca0159 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.562747:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.562750:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca0159 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.562756:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca0159 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.562791:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee363960700) 00010000:00010000:3.0:1762166877.562794:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166877.562803:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca0159 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.562808:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca0159 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.562827:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0152 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.562832:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0152 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.562838:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0152 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.562842:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347198000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.562845:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0152 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.562851:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0152 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.562858:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960500) 00010000:00010000:3.0:1762166877.562861:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166877.562864:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0152 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.562869:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198000/0xf915a5bdf3ca0152 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.562881:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960500) 00010000:00010000:3.0:1762166877.562883:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166877.562889:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca010c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92083 expref: 16 pid: 31205 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166877.562979:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358652850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:50092:x1847765444607232:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 5367us (5529us total) trans 8589935235 rc 0/0 00000100:00100000:3.0:1762166877.562988:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 263 00000020:00080000:3.0:1762166877.562993:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166877.564264:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.564311:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444607616 00000100:00100000:3.0:1762166877.564319:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444607616 00000100:00100000:3.0:1762166877.564357:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 589 00000100:00100000:3.0:1762166877.564365:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:50092:x1847765444607616:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.564384:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.564401:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca0160 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9209f expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.564452:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca0160 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9209f expref: 16 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.564464:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca0160 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9209f expref: 16 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.564478:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960600) 00010000:00010000:3.0:1762166877.564481:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166877.564484:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348229800, rc 0) 00000100:00100000:3.0:1762166877.564533:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:50092:x1847765444607616:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 168us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.564540:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 589 00000100:00100000:1.0:1762166877.566174:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.566221:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444607872 00000100:00100000:3.0:1762166877.566227:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444607872 00000100:00100000:3.0:1762166877.566306:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 264 00000100:00100000:3.0:1762166877.566315:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:50092:x1847765444607872:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166877.566519:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:50092:x1847765444607872:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 204us (349us total) trans 8589935236 rc 0/0 00000100:00100000:3.0:1762166877.566526:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 264 00000100:00100000:1.0:1762166877.567513:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.567570:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444608128 00000100:00100000:3.0:1762166877.567576:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444608128 00000100:00100000:3.0:1762166877.567611:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 265 00000100:00100000:3.0:1762166877.567620:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:50092:x1847765444608128:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166877.567829:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:50092:x1847765444608128:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 208us (318us total) trans 8589935237 rc 0/0 00000100:00100000:3.0:1762166877.567837:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 265 00000100:00100000:1.0:1762166877.569026:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.569191:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444608256 00000100:00100000:3.0:1762166877.569198:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444608256 00000100:00100000:3.0:1762166877.569246:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 590 00000100:00100000:3.0:1762166877.569255:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:50092:x1847765444608256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.569272:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.569303:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca0167 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f920a6 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.569360:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca016e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569372:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca016e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569384:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca016e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569422:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0175 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569428:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0175 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569435:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0175 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569537:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca017c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569542:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca017c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569547:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca017c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166877.569566:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x49:0x0]: returning size 0 00000004:00200000:3.0:1762166877.569568:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166877.569579:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca017c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569586:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca017c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569591:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca016e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569600:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca016e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569604:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca016e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569615:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.569618:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca016e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569623:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca016e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569632:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:3.0:1762166877.569634:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166877.569637:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca016e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569641:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca016e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569649:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0175 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569652:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0175 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569656:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0175 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569659:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.569660:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0175 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569663:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0175 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569666:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x363df604 (ffff9ee363960b00) 00010000:00010000:3.0:1762166877.569671:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166877.569673:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0175 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569676:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0175 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.569701:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca0167 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920a6 expref: 20 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.569711:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca017c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920a6 expref: 19 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.569715:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee363960100) 00010000:00010000:3.0:1762166877.569717:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166877.569719:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348229c00, rc 0) 00000100:00100000:3.0:1762166877.569756:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:50092:x1847765444608256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 504us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.569800:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 590 00000100:00100000:1.0:1762166877.571271:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.571314:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444608512 00000100:00100000:3.0:1762166877.571320:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444608512 00000100:00100000:3.0:1762166877.571352:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 591 00000100:00100000:3.0:1762166877.571358:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:50092:x1847765444608512:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166877.571390:0:31205:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1762166877.571406:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca017c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920a6 expref: 19 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.571416:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee363960100) 00010000:00010000:3.0:1762166877.571424:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca009c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92060 expref: 18 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.571439:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:3.0:1762166877.571443:0:31205:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166877.571456:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229000/0xf915a5bdf3ca0183 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.571463:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229000/0xf915a5bdf3ca0183 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.571468:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229000/0xf915a5bdf3ca0183 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.571480:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3ca018a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.571485:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3ca018a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.571491:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3ca018a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.571580:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0191 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.571588:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0191 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.571595:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0191 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.572011:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca0198 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.572022:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca0198 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.572038:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca0198 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.572046:0:31205:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca0198 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.572052:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca0198 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.572057:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca0198 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.572080:0:31205:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166877.572099:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0191 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.572106:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0191 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.572112:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0191 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.572117:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166877.572120:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.572128:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0191 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.572128:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca0198 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.572146:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166877.572147:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0191 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.572151:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca0198 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.572163:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee363960800) 00010000:00010000:3.0:1762166877.572167:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1762166877.572172:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0191 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.572173:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca0198 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x49:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.572190:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x49:0x0].0x0 (ffff9ee363960800) 00010000:00010000:3.0:1762166877.572197:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0191 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.572197:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166877.572204:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca0198 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x49:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.572213:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca0198 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x49:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762166877.572234:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166877.572236:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166877.572238:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166877.572246:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229000/0xf915a5bdf3ca0183 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.572253:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229000/0xf915a5bdf3ca0183 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.572259:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229000/0xf915a5bdf3ca0183 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.572264:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.572267:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229000/0xf915a5bdf3ca0183 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.572273:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229000/0xf915a5bdf3ca0183 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.572293:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee363960400) 00010000:00010000:3.0:1762166877.572296:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166877.572299:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229000/0xf915a5bdf3ca0183 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.572304:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229000/0xf915a5bdf3ca0183 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00000004:00010000:3.0:1762166877.572316:0:31205:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a6125965 reply state 000000003fe43ee8 transno 8589935238 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3ca018a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000100:00100000:3.0:1762166877.572324:0:31205:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166877.572399:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:50092:x1847765444608512:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 1039us (1131us total) trans 8589935238 rc 0/0 00000100:00100000:3.0:1762166877.572418:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 591 00010000:00010000:0.0:1762166877.573410:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3ca018a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166877.573421:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3ca018a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166877.573429:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3ca018a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166877.573433:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166877.573435:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3ca018a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166877.573438:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3ca018a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166877.573446:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x363df604 (ffff9ee363960900) 00010000:00010000:0.0:1762166877.573448:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166877.573450:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3ca018a lrc: 2/0,0 mode: --/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166877.573453:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228e00/0xf915a5bdf3ca018a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x47:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00000100:00100000:1.0:1762166877.581275:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.581405:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444608640 00000100:00100000:3.0:1762166877.581421:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444608640 00000100:00100000:3.0:1762166877.581491:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 592 00000100:00100000:3.0:1762166877.581502:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:50094:x1847765444608640:12345-192.168.203.35@tcp:101:stat.0 00010000:00010000:3.0:1762166877.581534:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.581561:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca019f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f920ad expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.581626:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca01a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.581640:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca01a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.581650:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca01a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.581662:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.581668:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.581674:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.581898:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229000/0xf915a5bdf3ca01b4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.581906:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229000/0xf915a5bdf3ca01b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.581930:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229000/0xf915a5bdf3ca01b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166877.581964:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x47:0x0]: returning size 11776 00000004:00200000:3.0:1762166877.581968:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166877.581991:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229000/0xf915a5bdf3ca01b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.582002:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca01a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.582008:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca01a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.582013:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca01a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.582019:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.582022:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca01a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.582029:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca01a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.582039:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee359d01800) 00010000:00010000:3.0:1762166877.582042:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166877.582046:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca01a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.582051:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca01a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.582062:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.582074:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.582080:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.582084:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.582087:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.582093:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.582100:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x159f6f8a (ffff9ee363960d00) 00010000:00010000:3.0:1762166877.582102:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166877.582104:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.582109:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.582135:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca019f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920ad expref: 20 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.582147:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229000/0xf915a5bdf3ca01b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920ad expref: 19 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.582153:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee363960400) 00010000:00010000:3.0:1762166877.582155:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1762166877.582158:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348229000, rc 0) 00000100:00100000:3.0:1762166877.582221:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:50094:x1847765444608640:12345-192.168.203.35@tcp:101:stat.0 Request processed in 721us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.582235:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 592 00000100:00100000:1.0:1762166877.583543:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.583621:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444608768 00000100:00100000:3.0:1762166877.583628:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444608768 00000100:00100000:3.0:1762166877.583670:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 266 00000100:00100000:3.0:1762166877.583679:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:50094:x1847765444608768:12345-192.168.203.35@tcp:49:stat.0 00000100:00100000:3.0:1762166877.583801:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:50094:x1847765444608768:12345-192.168.203.35@tcp:49:stat.0 Request processed in 122us (267us total) trans 0 rc -61/-61 00000100:00100000:3.0:1762166877.583808:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 266 00000100:00100000:1.0:1762166877.584980:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.585025:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444608896 00000100:00100000:3.0:1762166877.585031:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444608896 00000100:00100000:3.0:1762166877.585076:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 593 00000100:00100000:3.0:1762166877.585085:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:50094:x1847765444608896:12345-192.168.203.35@tcp:101:stat.0 00010000:00010000:3.0:1762166877.585098:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.585115:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca01bb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f920b4 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.585162:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca01c2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585174:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca01c2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585183:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca01c2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585195:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585201:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585221:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585334:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca01d0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585342:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca01d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585349:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca01d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166877.585371:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 5 00000004:00200000:3.0:1762166877.585374:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166877.585390:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca01d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585400:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca01d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585407:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca01c2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585412:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca01c2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585418:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca01c2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585423:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.585426:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca01c2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585433:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca01c2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585451:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee363960400) 00010000:00010000:3.0:1762166877.585454:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166877.585458:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca01c2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585463:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca01c2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585473:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585490:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01c9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585495:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585500:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.585502:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585508:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585514:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0xd5143738 (ffff9ee363960100) 00010000:00010000:3.0:1762166877.585517:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166877.585519:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01c9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585525:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01c9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.585555:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca01bb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920b4 expref: 21 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.585577:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca01d0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920b4 expref: 20 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.585583:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960600) 00010000:00010000:3.0:1762166877.585585:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166877.585588:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228600, rc 0) 00000100:00100000:3.0:1762166877.585634:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:50094:x1847765444608896:12345-192.168.203.35@tcp:101:stat.0 Request processed in 550us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.585641:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 593 00000100:00100000:1.0:1762166877.594353:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.594524:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444609024 00000100:00100000:3.0:1762166877.594534:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444609024 00000100:00100000:3.0:1762166877.594595:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 267 00000100:00100000:3.0:1762166877.594604:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:50095:x1847765444609024:12345-192.168.203.35@tcp:49:lfs.0 00000100:00100000:3.0:1762166877.594720:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:50095:x1847765444609024:12345-192.168.203.35@tcp:49:lfs.0 Request processed in 117us (376us total) trans 0 rc -61/-61 00000100:00100000:3.0:1762166877.594728:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 267 00000100:00100000:1.0:1762166877.596080:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.596138:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444609280 00000100:00100000:3.0:1762166877.596147:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444609280 00000100:00100000:3.0:1762166877.596198:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 594 00000100:00100000:3.0:1762166877.596206:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:50095:x1847765444609280:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.596219:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.596238:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca01d7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f920bb expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.596332:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01de lrc: 3/0,1 mode: --/CW res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.596363:0:31205:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca01d0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920b4 expref: 21 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.596370:0:31205:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01de lrc: 4/0,1 mode: --/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.596402:0:31205:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca01d0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920b4 expref: 21 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.596411:0:31205:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca01d0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920b4 expref: 21 pid: 31205 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1762166877.596421:0:31205:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:31205:1847765452025216:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166877.596481:0:31205:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3504380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166877.598241:0:31205:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:31205:1847765452025216:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166877.598357:0:31205:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01de lrc: 3/0,1 mode: --/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000100:00100000:1.0:1762166877.598425:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.598503:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444609408 00000100:00100000:0.0:1762166877.598514:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444609408 00010000:00010000:0.0:1762166877.598563:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca01d0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920b4 expref: 22 pid: 31205 timeout: 598 lvb_type: 0 00000100:00100000:0.0:1762166877.598617:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 926 00000100:00100000:0.0:1762166877.598629:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765444609408:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166877.598650:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166877.598662:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca01d0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920b4 expref: 22 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.598677:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca01d0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920b4 expref: 22 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.598710:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca01d0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920b4 expref: 22 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.598730:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960600) 00010000:00010000:0.0:1762166877.598736:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01de lrc: 3/0,1 mode: --/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166877.598746:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01de lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166877.598756:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01de lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166877.598836:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166877.598885:0:31205:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01de lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.598903:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01de lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000100:00100000:0.0:1762166877.598916:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765444609408:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 279us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166877.598932:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 926 00000004:00200000:3.0:1762166877.598934:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 5 00010000:00010000:3.0:1762166877.599175:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca01d7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920bb expref: 22 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.599198:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01de lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920bb expref: 21 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.599221:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960600) 00010000:00010000:3.0:1762166877.599225:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166877.599228:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348229a00, rc 0) 00000100:00100000:3.0:1762166877.599314:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:50095:x1847765444609280:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3107us (3245us total) trans 8589935239 rc 0/0 00000100:00100000:3.0:1762166877.599324:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 594 00000100:00100000:1.0:1762166877.600871:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.600944:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444609664 00000100:00100000:3.0:1762166877.600955:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444609664 00000100:00100000:3.0:1762166877.601014:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 595 00000100:00100000:3.0:1762166877.601024:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:50095:x1847765444609664:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.601060:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.601098:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca01ec lrc: 2/0,0 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f920c2 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.601871:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01f3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.601889:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.601902:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166877.601915:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x4b:0x0]: returning size 0 00010000:00010000:3.0:1762166877.601973:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca01ec lrc: 0/0,0 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920c2 expref: 24 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.601994:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920c2 expref: 23 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.602013:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4b:0x0].0x0 (ffff9ee363960100) 00010000:00010000:3.0:1762166877.602017:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166877.602020:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228400, rc 0) 00000100:00100000:3.0:1762166877.602092:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:50095:x1847765444609664:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1069us (1230us total) trans 8589935240 rc 0/0 00000100:00100000:3.0:1762166877.602099:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 595 00000100:00100000:1.0:1762166877.603674:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.603724:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444609920 00000100:00100000:3.0:1762166877.603736:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444609920 00000100:00100000:3.0:1762166877.603823:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 596 00000100:00100000:3.0:1762166877.603838:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:50095:x1847765444609920:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.603868:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.603900:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0201 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f920c9 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.604008:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca0208 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.604022:0:31205:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01f3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920c2 expref: 24 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.604030:0:31205:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca0208 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.604063:0:31205:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920c2 expref: 24 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.604075:0:31205:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01f3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920c2 expref: 24 pid: 31205 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1762166877.604106:0:31205:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:31205:1847765452025344:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166877.604183:0:31205:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36f3fd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166877.605093:0:31205:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:31205:1847765452025344:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166877.605114:0:31205:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca0208 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000100:00100000:1.0:1762166877.605258:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.605319:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444610048 00000100:00100000:0.0:1762166877.605324:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444610048 00010000:00010000:0.0:1762166877.605343:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01f3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920c2 expref: 25 pid: 31205 timeout: 598 lvb_type: 0 00000100:00100000:0.0:1762166877.605367:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 927 00000100:00100000:0.0:1762166877.605373:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765444610048:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166877.605380:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166877.605384:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01f3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920c2 expref: 25 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.605396:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920c2 expref: 25 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.605412:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca01f3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920c2 expref: 25 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.605422:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4b:0x0].0x0 (ffff9ee363960100) 00010000:00010000:0.0:1762166877.605424:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca0208 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166877.605429:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca0208 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166877.605433:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca0208 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166877.605447:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166877.605457:0:31205:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca0208 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.605464:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca0208 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000100:00100000:0.0:1762166877.605472:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765444610048:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 99us (216us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166877.605473:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x4b:0x0]: returning size 0 00000100:00100000:0.0:1762166877.605481:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 927 00000004:00080000:3.0:1762166877.605791:0:31205:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x8f:0x0], index 1: 0 00010000:00010000:3.0:1762166877.605921:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca0208 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.605928:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca0208 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.605935:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca0208 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.605941:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.605945:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca0208 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.605952:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca0208 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.605960:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4b:0x0].0x0 (ffff9ee363960100) 00010000:00010000:3.0:1762166877.605970:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166877.605973:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca0208 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.605977:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca0208 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.606020:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0201 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920c9 expref: 24 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.606026:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee363960400) 00010000:00010000:3.0:1762166877.606027:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166877.606029:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0201 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920c9 expref: 24 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.606035:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228000, rc 0) 00000100:00100000:3.0:1762166877.606068:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:50095:x1847765444609920:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2236us (2402us total) trans 8589935241 rc 301/301 00000100:00100000:3.0:1762166877.606075:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 596 00000100:00100000:1.0:1762166877.606961:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.607003:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444610304 00000100:00100000:3.0:1762166877.607010:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444610304 00000100:00100000:3.0:1762166877.607044:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 268 00000100:00100000:3.0:1762166877.607054:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358651050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:50095:x1847765444610304:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762166877.607241:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358651050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:50095:x1847765444610304:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 184us (276us total) trans 8589935242 rc 0/0 00000100:00100000:3.0:1762166877.607250:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 268 00010000:00010000:2.0:1762166877.607883:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166877.608159:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.608212:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444610432 00000100:00100000:3.0:1762166877.608219:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444610432 00000100:00100000:3.0:1762166877.608254:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 597 00000100:00100000:3.0:1762166877.608274:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:50095:x1847765444610432:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.608302:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.608315:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca0216 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f920d0 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.608369:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca021d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.608378:0:31205:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01de lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920bb expref: 25 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.608383:0:31205:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca021d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.608404:0:31205:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01de lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920bb expref: 25 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.608411:0:31205:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01de lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920bb expref: 25 pid: 31205 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1762166877.608419:0:31205:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:31205:1847765452025472:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166877.608467:0:31205:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3504380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166877.609222:0:31205:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:31205:1847765452025472:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166877.609235:0:31205:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca021d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000100:00100000:1.0:1762166877.609420:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.609463:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444610560 00000100:00100000:0.0:1762166877.609469:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444610560 00010000:00010000:0.0:1762166877.609492:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01de lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920bb expref: 26 pid: 31205 timeout: 598 lvb_type: 0 00000100:00100000:0.0:1762166877.609525:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 928 00000100:00100000:0.0:1762166877.609531:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765444610560:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166877.609539:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166877.609543:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01de lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920bb expref: 26 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.609550:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01de lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920bb expref: 26 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.609563:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca01de lrc: 0/0,0 mode: --/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920bb expref: 26 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.609572:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960600) 00010000:00010000:0.0:1762166877.609575:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca021d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166877.609581:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca021d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166877.609585:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca021d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 31205 initiator: MDT0 00010000:00010000:0.0:1762166877.609601:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166877.609627:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765444610560:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 95us (206us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166877.609633:0:31205:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca021d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000100:00100000:0.0:1762166877.609634:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 928 00010000:00010000:3.0:1762166877.609645:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca021d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166877.609682:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 5 00000004:00200000:3.0:1762166877.609686:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166877.609702:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca021d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.609726:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca0216 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920d0 expref: 25 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.609740:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca021d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920d0 expref: 24 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.609812:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960600) 00010000:00010000:3.0:1762166877.609815:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166877.609818:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228c00, rc 0) 00000100:00100000:3.0:1762166877.609850:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:50095:x1847765444610432:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1578us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.609857:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 597 00000100:00100000:1.0:1762166877.610794:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.610843:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444610688 00000100:00100000:3.0:1762166877.610849:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444610688 00000100:00100000:3.0:1762166877.610894:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 598 00000100:00100000:3.0:1762166877.610906:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:50095:x1847765444610688:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.610920:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.610934:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca0224 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f920d7 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.610977:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca022b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.611001:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca022b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.611010:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca022b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762166877.611031:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x4b:0x0]: returning size 0 00000004:00200000:3.0:1762166877.611034:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166877.611045:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca022b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.611065:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca0224 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920d7 expref: 26 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.611078:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca022b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920d7 expref: 25 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.611086:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4b:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:3.0:1762166877.611089:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762166877.611092:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228a00, rc 0) 00000100:00100000:3.0:1762166877.611128:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:50095:x1847765444610688:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 224us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.611135:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 598 00000100:00100000:1.0:1762166877.612072:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.612130:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444610816 00000100:00100000:2.0:1762166877.612136:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444610816 00000100:00100000:2.0:1762166877.612175:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1327 00000100:00100000:2.0:1762166877.612184:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2358:x1847765444610816:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166877.612199:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166877.612213:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0232 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f920de expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166877.612234:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166877.612247:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.612249:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.612256:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0232 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920de expref: 14 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166877.612268:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0232 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920de expref: 14 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166877.612292:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158a00, rc 0) 00000100:00100000:2.0:1762166877.612332:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2358:x1847765444610816:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 149us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.612339:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1327 00000100:00100000:1.0:1762166877.613219:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.613255:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444610944 00000100:00100000:3.0:1762166877.613261:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444610944 00000100:00100000:3.0:1762166877.613304:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 599 00000100:00100000:3.0:1762166877.613312:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:50095:x1847765444610944:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.613320:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.613329:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0239 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f920e5 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.613353:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca0240 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.613360:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca0240 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.613366:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca0240 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762166877.613431:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0239 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920e5 expref: 27 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.613446:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca0240 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920e5 expref: 26 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.613453:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4b:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:3.0:1762166877.613456:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1762166877.613459:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228800, rc 0) 00000100:00100000:3.0:1762166877.613496:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:50095:x1847765444610944:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 184us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.613503:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 599 00000100:00100000:1.0:1762166877.614374:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.614410:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444611200 00000100:00100000:3.0:1762166877.614415:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444611200 00000100:00100000:0.0:1762166877.614465:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 600 00000100:00100000:0.0:1762166877.614473:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:50095:x1847765444611200:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762166877.614497:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166877.614511:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca022b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920d7 expref: 26 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.614523:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4b:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:0.0:1762166877.614526:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166877.614546:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3ca0247 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.614554:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3ca0247 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.614562:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3ca0247 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000040:00080000:0.0:1762166877.614843:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].21, 88 off9776 00000004:00080000:0.0:1762166877.614851:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 498407088235ns, next at 499407086505ns, rc = 0 00000004:00010000:0.0:1762166877.614918:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001611a9d1 reply state 0000000027211a53 transno 8589935243 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3ca0247 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166877.614925:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166877.614974:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:50095:x1847765444611200:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 503us (600us total) trans 8589935243 rc 0/0 00000100:00100000:0.0:1762166877.614979:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 600 00010000:00010000:2.0:1762166877.615547:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3ca0247 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166877.615557:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3ca0247 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166877.615563:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3ca0247 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166877.615568:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166877.615572:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3ca0247 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166877.615579:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3ca0247 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166877.615589:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4b:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:2.0:1762166877.615592:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1762166877.615596:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3ca0247 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166877.615602:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199800/0xf915a5bdf3ca0247 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166877.615716:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.615781:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444611328 00000100:00100000:0.0:1762166877.615786:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444611328 00000100:00100000:0.0:1762166877.615818:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 601 00000100:00100000:0.0:1762166877.615826:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:50095:x1847765444611328:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166877.615843:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166877.615852:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3ca024e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f920ec expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.615881:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3ca024e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920ec expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.615892:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3ca024e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920ec expref: 27 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.615907:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4b:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:0.0:1762166877.615910:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166877.615912:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199a00, rc 0) 00000100:00100000:0.0:1762166877.615949:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:50095:x1847765444611328:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 124us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166877.615955:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 601 00000100:00100000:1.0:1762166877.616828:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.616891:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444611456 00000100:00100000:2.0:1762166877.616896:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444611456 00000100:00100000:2.0:1762166877.616930:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1328 00000100:00100000:2.0:1762166877.616938:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765444611456:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166877.617109:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x8f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166877.617112:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x8f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1762166877.617114:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166877.617116:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8f:0x0] updating lvb ctime from disk: 0 -> 1762166877 00002000:00010000:2.0:1762166877.617119:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x8f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166877.617155:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444611456:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 217us (328us total) trans 17179869484 rc 0/0 00000100:00100000:2.0:1762166877.617162:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1328 00000100:00100000:1.0:1762166877.618085:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.618151:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444611712 00000100:00100000:0.0:1762166877.618155:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444611712 00000100:00100000:0.0:1762166877.618190:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 602 00000100:00100000:0.0:1762166877.618200:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:50095:x1847765444611712:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762166877.618211:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166877.618223:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3ca0255 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f920f3 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.618300:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3ca025c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.618311:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3ca025c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.618319:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3ca025c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762166877.618329:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 5 00010000:00010000:0.0:1762166877.618399:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347198e00/0xf915a5bdf3ca0255 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920f3 expref: 30 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.618410:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3ca025c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920f3 expref: 29 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.618415:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960600) 00010000:00010000:0.0:1762166877.618417:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166877.618419:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347199600, rc 0) 00000100:00100000:0.0:1762166877.618449:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:50095:x1847765444611712:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 251us (365us total) trans 8589935244 rc 0/0 00000100:00100000:0.0:1762166877.618458:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 602 00000100:00100000:1.0:1762166877.619569:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.619611:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444611840 00000100:00100000:2.0:1762166877.619616:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444611840 00000100:00100000:2.0:1762166877.619648:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1329 00000100:00100000:2.0:1762166877.619655:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765444611840:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166877.619684:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca026a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.619699:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca014b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92098 expref: 15 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.619706:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166877.619708:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166877.619712:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca026a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.619743:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca014b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92098 expref: 15 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.619757:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca014b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92098 expref: 15 pid: 26444 timeout: 598 lvb_type: 0 00000100:00100000:2.0:1762166877.619801:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452025600:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166877.619858:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166877.620844:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452025600:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166877.620862:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca026a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166877.621001:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.621048:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444611968 00000100:00100000:0.0:1762166877.621054:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444611968 00010000:00010000:0.0:1762166877.621079:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca014b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92098 expref: 16 pid: 26444 timeout: 598 lvb_type: 0 00000100:00100000:0.0:1762166877.621112:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 929 00000100:00100000:0.0:1762166877.621122:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444611968:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166877.621133:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166877.621151:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca014b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92098 expref: 16 pid: 26444 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.621159:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca014b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92098 expref: 16 pid: 26444 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.621173:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca014b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92098 expref: 16 pid: 26444 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.621181:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166877.621182:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166877.621185:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca026a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.621192:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca026a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.621211:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166877.621229:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca026a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.621239:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca026a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166877.621241:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444611968:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 121us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166877.621249:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 929 00010000:00010000:2.0:1762166877.621277:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca026a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.621296:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca026a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.621304:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca026a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.621311:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f158200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166877.621315:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca026a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.621327:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca026a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.621340:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca026a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.621348:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca026a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166877.621396:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2361:x1847765444611840:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 1741us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.621407:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1329 00000100:00100000:1.0:1762166877.622164:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.622203:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444612096 00000100:00100000:3.0:1762166877.622208:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444612096 00000100:00100000:3.0:1762166877.622235:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 269 00000100:00100000:3.0:1762166877.622241:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:50095:x1847765444612096:12345-192.168.203.35@tcp:49:lfs.0 00000100:00100000:3.0:1762166877.622320:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:50095:x1847765444612096:12345-192.168.203.35@tcp:49:lfs.0 Request processed in 79us (160us total) trans 0 rc -61/-61 00000100:00100000:3.0:1762166877.622337:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 269 00000100:00100000:1.0:1762166877.645082:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.645137:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444612224 00000100:00100000:2.0:1762166877.645148:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444612224 00000100:00100000:2.0:1762166877.645216:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1330 00000100:00100000:2.0:1762166877.645226:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765444612224:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166877.645242:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166877.645257:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca0271 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f920fa expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166877.645276:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x8e:0x0] initial LVB size: 5, mtime: 0x69088858, atime: 0x69088858, ctime: 0x6908885d, blocks: 0x3 00010000:00010000:2.0:1762166877.645306:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.645308:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.645315:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca0271 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920fa expref: 15 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166877.645327:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca0271 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920fa expref: 15 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166877.645337:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158200, rc 0) 00000100:00100000:2.0:1762166877.645382:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444612224:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 160us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.645387:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1330 00000100:00100000:1.0:1762166877.647046:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.647098:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444612352 00000100:00100000:3.0:1762166877.647105:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444612352 00000100:00100000:3.0:1762166877.647160:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 990 00000100:00100000:3.0:1762166877.647170:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765444612352:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762166877.647198:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0278 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.647210:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166877.647212:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166877.647216:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0278 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.647227:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0278 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.647356:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0278 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.647364:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0278 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.647371:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0278 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.647390:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166877.647395:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0278 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.647422:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0278 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.647435:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0278 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.647442:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0278 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166877.647504:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765444612352:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 336us (463us total) trans 0 rc 5/5 00000100:00100000:3.0:1762166877.647511:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 990 00000100:00100000:1.0:1762166877.648888:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.648937:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444612480 00000100:00100000:3.0:1762166877.648945:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444612480 00000100:00100000:3.0:1762166877.648994:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 991 00000100:00100000:3.0:1762166877.649002:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444612480:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:3.0:1762166877.649025:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee348229200/0xf915a5bdf3ca027f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.649039:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0232 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920de expref: 15 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166877.649047:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166877.649049:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166877.649053:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348229200/0xf915a5bdf3ca027f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.649088:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0232 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920de expref: 15 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166877.649122:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0232 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920de expref: 15 pid: 26444 timeout: 598 lvb_type: 1 00000100:00100000:3.0:1762166877.649137:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765452025728:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166877.649200:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3504380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166877.650123:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765452025728:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166877.650145:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee348229200/0xf915a5bdf3ca027f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166877.650345:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.650446:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444612608 00000100:00100000:0.0:1762166877.650452:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444612608 00010000:00010000:0.0:1762166877.650476:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0232 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920de expref: 16 pid: 26444 timeout: 598 lvb_type: 1 00000100:00100000:0.0:1762166877.650503:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 930 00000100:00100000:0.0:1762166877.650510:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444612608:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166877.650521:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166877.650540:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0232 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920de expref: 16 pid: 26444 timeout: 598 lvb_type: 1 00010000:00010000:0.0:1762166877.650553:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0232 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920de expref: 16 pid: 26444 timeout: 598 lvb_type: 1 00010000:00010000:0.0:1762166877.650571:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0232 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920de expref: 16 pid: 26444 timeout: 598 lvb_type: 1 00010000:00010000:0.0:1762166877.650583:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166877.650586:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166877.650590:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee348229200/0xf915a5bdf3ca027f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.650598:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348229200/0xf915a5bdf3ca027f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.650622:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166877.650645:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee348229200/0xf915a5bdf3ca027f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.650654:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee348229200/0xf915a5bdf3ca027f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166877.650665:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444612608:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 149us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166877.650673:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 930 00000001:00080000:0.0:1762166877.661587:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869483 is committed 00000001:00080000:0.0:1762166877.661612:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869484 is committed 00000001:00080000:0.0:1762166877.661628:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869485 is committed 00002000:00010000:1.0:1762166877.661678:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x8f:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1762166877.661688:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x8f:0x0] updating lvb mtime from disk: 0 -> 1762166877 00002000:00010000:1.0:1762166877.661692:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x8f:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1762166877.661709:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee348229200/0xf915a5bdf3ca027f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166877.661723:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348229200/0xf915a5bdf3ca027f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166877.661733:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee348229200/0xf915a5bdf3ca027f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166877.661741:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166877.661747:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348229200/0xf915a5bdf3ca027f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166877.661808:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348229200/0xf915a5bdf3ca027f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166877.661833:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee348229200/0xf915a5bdf3ca027f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166877.661841:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee348229200/0xf915a5bdf3ca027f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166877.661994:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2360:x1847765444612480:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 12984us (13102us total) trans 17179869485 rc 0/0 00000100:00100000:1.0:1762166877.662011:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 991 00000100:00100000:1.0:1762166877.663473:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.663530:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444612736 00000100:00100000:0.0:1762166877.663542:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444612736 00000100:00100000:0.0:1762166877.663593:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 603 00000100:00100000:0.0:1762166877.663600:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:50095:x1847765444612736:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:2.0:1762166877.675746:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935244 is committed 00000004:00080000:2.0:1762166877.675808:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 16 committed 00000020:00080000:2.0:1762166877.675889:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee34821d480 refcount 2 committed 0 result 0 batchid 4294969132 00000020:00080000:2.0:1762166877.675897:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435c0b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee34881f900 00000020:00080000:2.0:1762166877.675901:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435c0700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee34821d780 00000020:00080000:2.0:1762166877.675905:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435c0500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee24558f800 00000020:00080000:2.0:1762166877.675913:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].2 00000100:00100000:3.0:1762166877.675935:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:50095:x1847765444612736:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 12325us (12461us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.675951:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 603 00000020:00080000:0.0:1762166877.676118:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969132 committed batchid 4294969131 00000100:00100000:2.0:1762166877.676313:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765452025856:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1762166877.676346:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969131 00000100:00100000:2.0:1762166877.676366:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166877.676416:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452025856 00000100:00100000:0.0:1762166877.676426:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452025856 00000100:00100000:0.0:1762166877.676480:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:0.0:1762166877.676490:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3295:x1847765452025856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166877.676700:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765452025856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 211us (333us total) trans 17179869486 rc 0/0 00000100:00100000:0.0:1762166877.676707:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:2.0:1762166877.676752:0:3295:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869483 gen 2 00000004:00080000:2.0:1762166877.676759:0:3295:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869483 committed transno 17179869483 00000100:00100000:2.0:1762166877.676804:0:3295:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee37f2d0e00 x1847765452025856/t17179869486(17179869486) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166893 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1762166877.676818:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f2d0e00/2, rc 0, transno 17179869486 00000100:00100000:2.0:1762166877.676823:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765452025856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166877.677652:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.677699:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444612864 00000100:00100000:0.0:1762166877.677705:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444612864 00000100:00100000:0.0:1762166877.677746:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1332 00000100:00100000:0.0:1762166877.677753:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444612864:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:0.0:1762166877.677844:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765444612864:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 91us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166877.677851:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1332 00000100:00100000:0.0:1762166877.684444:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.684526:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444612992 00000100:00100000:2.0:1762166877.684537:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444612992 00000100:00100000:2.0:1762166877.684590:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1333 00000100:00100000:2.0:1762166877.684601:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2360:x1847765444612992:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166877.684644:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3ca0286 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.684656:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.684657:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.684661:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3ca0286 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.684671:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3ca0286 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.684695:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3ca0286 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.684704:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3ca0286 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.684709:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3ca0286 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.684713:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166877.684716:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3ca0286 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.684721:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3ca0286 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.684730:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3ca0286 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.684734:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3ca0286 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166877.684825:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2360:x1847765444612992:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 226us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.684831:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1333 00000100:00100000:1.0:1762166877.685874:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.685917:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444613248 00000100:00100000:3.0:1762166877.685922:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444613248 00000100:00100000:3.0:1762166877.685960:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 604 00000100:00100000:3.0:1762166877.685970:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:50095:x1847765444613248:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166877.686037:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca028d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.686070:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca028d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.686080:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca028d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:3.0:1762166877.686221:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a21e268b reply state 000000005e706fcd transno 8589935245 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca028d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166877.686227:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166877.686295:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:50095:x1847765444613248:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 328us (423us total) trans 8589935245 rc 0/0 00000100:00100000:3.0:1762166877.686300:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 604 00010000:00010000:0.0:1762166877.686906:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca028d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.686914:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca028d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.686921:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca028d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.686926:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166877.686929:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca028d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.686936:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca028d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.686946:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4b:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:0.0:1762166877.686949:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166877.686952:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca028d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.686957:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca028d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166877.687174:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.687217:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444613376 00000100:00100000:2.0:1762166877.687223:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444613376 00000100:00100000:2.0:1762166877.687256:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1334 00000100:00100000:2.0:1762166877.687265:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:50095:x1847765444613376:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166877.687277:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166877.687305:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159800/0xf915a5bdf3ca0294 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92101 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166877.687325:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x8f:0x0] initial LVB size: 5, mtime: 0x6908885d, atime: 0x0, ctime: 0x6908885d, blocks: 0xb 00010000:00010000:2.0:1762166877.687339:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.687341:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.687347:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159800/0xf915a5bdf3ca0294 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92101 expref: 11 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.687365:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159800/0xf915a5bdf3ca0294 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92101 expref: 11 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.687375:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159800, rc 0) 00000100:00100000:2.0:1762166877.687408:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:50095:x1847765444613376:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 144us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.687415:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1334 00000100:00100000:1.0:1762166877.688082:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.688116:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444613504 00000100:00100000:2.0:1762166877.688120:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444613504 00000100:00100000:2.0:1762166877.688144:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1335 00000100:00100000:2.0:1762166877.688150:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765444613504:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166877.688290:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x8f:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1762166877.688294:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x8f:0x0] updating lvb mtime from disk: 1762166877 -> 1762166872 00002000:00010000:2.0:1762166877.688296:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x8f:0x0] updating lvb atime from disk: 0 -> 1762166872 00002000:00010000:2.0:1762166877.688298:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8f:0x0] updating lvb ctime from disk: 1762166877 -> 1762166877 00002000:00010000:2.0:1762166877.688300:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x8f:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1762166877.688346:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444613504:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 196us (264us total) trans 17179869487 rc 0/0 00000100:00100000:2.0:1762166877.688351:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1335 00000100:00100000:0.0:1762166877.689153:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.689202:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444613760 00000100:00100000:3.0:1762166877.689208:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444613760 00000100:00100000:3.0:1762166877.689241:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 605 00000100:00100000:3.0:1762166877.689249:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:50095:x1847765444613760:12345-192.168.203.35@tcp:55:lfs.0 00010000:00010000:3.0:1762166877.689295:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca029b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.689307:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca0240 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920e5 expref: 14 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.689314:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca029b lrc: 4/0,1 mode: --/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.689348:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca0240 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920e5 expref: 14 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.689360:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca0240 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920e5 expref: 14 pid: 31205 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1762166877.689387:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765452025984:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166877.689439:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3482d79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166877.690267:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765452025984:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166877.690297:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca029b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166877.690652:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.690709:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444613888 00000100:00100000:3.0:1762166877.690714:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444613888 00010000:00010000:3.0:1762166877.690732:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca0240 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920e5 expref: 15 pid: 31205 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1762166877.690753:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 931 00000100:00100000:3.0:1762166877.690757:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444613888:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166877.690787:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166877.690792:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca0240 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920e5 expref: 15 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1762166877.690800:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca0240 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920e5 expref: 15 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1762166877.690813:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca0240 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920e5 expref: 15 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1762166877.690822:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4b:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:3.0:1762166877.690824:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca029b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.690839:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca029b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.690844:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca029b lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.690861:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166877.690880:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca029b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.690890:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca029b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166877.690899:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765444613888:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 139us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.690908:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 931 00010000:00010000:0.0:1762166877.690911:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca029b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.690919:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca029b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.690925:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca029b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.690930:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166877.690934:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca029b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.690941:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca029b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.690951:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4b:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:0.0:1762166877.690954:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1762166877.690958:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca029b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.690964:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca029b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166877.691010:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:50095:x1847765444613760:12345-192.168.203.35@tcp:55:lfs.0 Request processed in 1761us (1858us total) trans 0 rc -22/-22 00000100:00100000:0.0:1762166877.691020:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 605 00000100:00100000:0.0:1762166877.692402:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.692436:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444614144 00000100:00100000:3.0:1762166877.692441:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444614144 00000100:00100000:3.0:1762166877.692473:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 606 00000100:00100000:3.0:1762166877.692479:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:50095:x1847765444614144:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166877.692515:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166877.692528:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca021d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920d0 expref: 13 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.692538:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960600) 00010000:00010000:3.0:1762166877.692541:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166877.692564:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca02a2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.692577:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca02a2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.692582:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca02a2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:3.0:1762166877.692672:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b6219fdb reply state 00000000a7f3d0ac transno 8589935246 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca02a2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166877.692689:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166877.692752:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:50095:x1847765444614144:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 273us (354us total) trans 8589935246 rc 0/0 00000100:00100000:3.0:1762166877.692777:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 606 00010000:00010000:2.0:1762166877.693681:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca02a2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166877.693691:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca02a2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166877.693698:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca02a2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166877.693703:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762166877.693707:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca02a2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166877.693713:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca02a2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166877.693723:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960600) 00010000:00010000:2.0:1762166877.693726:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166877.693730:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca02a2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166877.693736:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca02a2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166877.693955:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.693994:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444614272 00000100:00100000:2.0:1762166877.693999:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444614272 00000100:00100000:2.0:1762166877.694029:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1336 00000100:00100000:2.0:1762166877.694034:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:50095:x1847765444614272:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166877.694043:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166877.694053:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3ca02a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92108 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.694070:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca0271 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920fa expref: 13 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166877.694075:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.694077:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.694080:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3ca02a9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92108 expref: 13 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.694107:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca0271 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920fa expref: 13 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166877.694120:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca0271 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920fa expref: 13 pid: 26444 timeout: 598 lvb_type: 1 00000100:00100000:2.0:1762166877.694133:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452026112:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166877.694185:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166877.695071:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452026112:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166877.695095:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3ca02a9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92108 expref: 13 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.695108:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159200, rc 0) 00000100:00100000:2.0:1762166877.695142:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:50095:x1847765444614272:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1106us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.695150:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1336 00000100:00100000:1.0:1762166877.695334:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.695370:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444614400 00000100:00100000:3.0:1762166877.695376:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444614400 00010000:00010000:3.0:1762166877.695398:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca0271 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920fa expref: 13 pid: 26444 timeout: 598 lvb_type: 1 00000100:00100000:3.0:1762166877.695425:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 932 00000100:00100000:3.0:1762166877.695433:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765444614400:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166877.695443:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1762166877.695458:0:29775:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb blocks from disk: 3 -> 11 00010000:00010000:3.0:1762166877.695464:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca0271 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920fa expref: 13 pid: 26444 timeout: 598 lvb_type: 1 00010000:00010000:3.0:1762166877.695473:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca0271 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920fa expref: 13 pid: 26444 timeout: 598 lvb_type: 1 00010000:00010000:3.0:1762166877.695490:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca0271 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920fa expref: 13 pid: 26444 timeout: 598 lvb_type: 1 00010000:00010000:3.0:1762166877.695500:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166877.695502:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166877.695508:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3ca02a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92108 expref: 12 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.695532:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3ca02a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92108 expref: 12 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.695555:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159200/0xf915a5bdf3ca02a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92108 expref: 12 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166877.695566:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765452026240:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762166877.695607:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3482d79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166877.696535:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765452026240:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762166877.696548:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166877.696578:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444614400:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1146us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.696584:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 932 00000100:00100000:1.0:1762166877.696801:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.696899:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444614528 00000100:00100000:2.0:1762166877.696905:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444614528 00000100:00100000:2.0:1762166877.696940:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1337 00000100:00100000:2.0:1762166877.696949:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2360:x1847765444614528:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166877.697102:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1762166877.697106:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb mtime from disk: 1762166872 -> 1762166872 00002000:00010000:2.0:1762166877.697108:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb atime from disk: 1762166872 -> 1762166872 00002000:00010000:2.0:1762166877.697111:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb ctime from disk: 1762166877 -> 1762166877 00002000:00010000:2.0:1762166877.697113:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x8e:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1762166877.697151:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765444614528:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 202us (349us total) trans 17179869488 rc 0/0 00000100:00100000:2.0:1762166877.697158:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1337 00000100:00100000:1.0:1762166877.698022:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.698057:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444614784 00000100:00100000:3.0:1762166877.698074:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444614784 00000100:00100000:3.0:1762166877.698110:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 270 00000100:00100000:3.0:1762166877.698118:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:50095:x1847765444614784:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:3.0:1762166877.698185:0:31351:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x48:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3ca025c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920f3 expref: 13 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.698210:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02b0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.698218:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca0160 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9209f expref: 13 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.698237:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02b0 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.698262:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca0160 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9209f expref: 13 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.698274:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca0160 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9209f expref: 13 pid: 31205 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1762166877.698298:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765452026368:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166877.698343:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3482d7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166877.699246:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765452026368:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166877.699261:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02b0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166877.699873:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.699949:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444614912 00000100:00100000:3.0:1762166877.699955:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444614912 00010000:00010000:3.0:1762166877.699975:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca0160 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9209f expref: 14 pid: 31205 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1762166877.700000:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 933 00000100:00100000:3.0:1762166877.700008:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765444614912:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166877.700017:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166877.700022:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca0160 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9209f expref: 14 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1762166877.700030:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca0160 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9209f expref: 14 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1762166877.700052:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca0160 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9209f expref: 14 pid: 31205 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1762166877.700064:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960600) 00010000:00010000:3.0:1762166877.700069:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02b0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.700077:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02b0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.700083:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02b0 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.700108:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166877.700133:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02b0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.700141:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02b0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166877.700149:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765444614912:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 142us (283us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166877.700155:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3ca02b7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166877.700161:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 933 00010000:00010000:0.0:1762166877.700168:0:31351:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3ca024e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920ec expref: 13 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.700174:0:31351:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3ca02b7 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.700195:0:31351:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3ca024e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920ec expref: 12 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.700203:0:31351:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3ca024e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920ec expref: 12 pid: 30818 timeout: 598 lvb_type: 0 00000100:00100000:0.0:1762166877.700213:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765452026496:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762166877.700256:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243611c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166877.701411:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:31351:1847765452026496:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166877.701439:0:31351:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3ca02b7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:1.0:1762166877.701526:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.701588:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444615040 00000100:00100000:3.0:1762166877.701595:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444615040 00010000:00010000:3.0:1762166877.701613:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3ca024e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920ec expref: 13 pid: 30818 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1762166877.701635:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 934 00000100:00100000:3.0:1762166877.701641:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765444615040:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166877.701657:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166877.701661:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3ca024e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920ec expref: 13 pid: 30818 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1762166877.701669:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3ca024e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920ec expref: 13 pid: 30818 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1762166877.701679:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199a00/0xf915a5bdf3ca024e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920ec expref: 13 pid: 30818 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1762166877.701688:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4b:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:3.0:1762166877.701692:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3ca02b7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.701697:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3ca02b7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.701701:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3ca02b7 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31351 initiator: MDT0 00010000:00010000:3.0:1762166877.701718:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166877.701749:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2361:x1847765444615040:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 108us (224us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166877.701753:0:31351:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3ca02b7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:3.0:1762166877.701754:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 934 00010000:00010000:0.0:1762166877.701801:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3ca02b7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166877.702173:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452026624:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166877.702212:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166877.702244:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243611780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166877.702259:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452026624 00000100:00100000:2.0:1762166877.702265:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452026624 00000100:00100000:2.0:1762166877.702314:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1762166877.702322:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:31351:x1847765452026624:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166877.702396:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:31351:x1847765452026624:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 75us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.702402:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1762166877.702440:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452026624:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166877.702481:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452026752:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166877.702504:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166877.702521:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243611780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166877.702544:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452026752 00000100:00100000:3.0:1762166877.702549:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452026752 00000100:00100000:3.0:1762166877.702579:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1762166877.702587:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:31351:x1847765452026752:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166877.702642:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:31351:x1847765452026752:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 55us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.702658:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1762166877.702664:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452026752:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166877.702688:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452026880:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166877.702703:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166877.702717:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243611780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166877.702731:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452026880 00000100:00100000:3.0:1762166877.702734:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452026880 00000100:00100000:3.0:1762166877.702756:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1762166877.702789:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:31351:x1847765452026880:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166877.702830:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:31351:x1847765452026880:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 69us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.702836:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1762166877.702858:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452026880:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1762166877.703011:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935247 00000100:00100000:0.0:1762166877.703056:0:31351:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452027008:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166877.703072:0:31351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166877.703088:0:31351:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243611e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166877.703112:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452027008 00000100:00100000:3.0:1762166877.703117:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452027008 00000100:00100000:3.0:1762166877.703145:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1762166877.703152:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:31351:x1847765452027008:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166877.703306:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:31351:x1847765452027008:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 155us (231us total) trans 17179869489 rc 0/0 00000100:00100000:3.0:1762166877.703313:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1762166877.703348:0:31351:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:31351:1847765452027008:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1762166877.703404:0:31351:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935248 00010000:00010000:0.0:1762166877.703429:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3ca02b7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.703437:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3ca02b7 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.703444:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3ca02b7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.703450:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166877.703454:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3ca02b7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.703461:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3ca02b7 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.703472:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4b:0x0].0x0 (ffff9ee363960d00) 00010000:00010000:0.0:1762166877.703476:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166877.703480:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3ca02b7 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.703485:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199e00/0xf915a5bdf3ca02b7 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.703502:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02b0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.703505:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02b0 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.703509:0:31351:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02b0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.703511:0:31351:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166877.703513:0:31351:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02b0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.703516:0:31351:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02b0 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.703520:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960600) 00010000:00010000:0.0:1762166877.703521:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166877.703523:0:31351:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02b0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.703529:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02b0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x48:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.703536:0:31351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960600) 00010000:00010000:0.0:1762166877.703537:0:31351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166877.703541:0:31351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3ca025c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f920f3 expref: 14 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166877.703616:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:50095:x1847765444614784:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 5499us (5594us total) trans 8589935249 rc 0/0 00000100:00100000:0.0:1762166877.703625:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 270 00000020:00080000:0.0:1762166877.703629:0:31351:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166877.704809:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.704847:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444615168 00000100:00100000:3.0:1762166877.704851:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444615168 00000100:00100000:3.0:1762166877.704889:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 607 00000100:00100000:3.0:1762166877.704898:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:50095:x1847765444615168:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.704914:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.704931:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca02be lrc: 2/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9210f expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.704975:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca02be lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9210f expref: 14 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.704988:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca02be lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9210f expref: 14 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.705015:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960700) 00010000:00010000:3.0:1762166877.705017:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166877.705019:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228800, rc 0) 00000100:00100000:3.0:1762166877.705052:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:50095:x1847765444615168:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 155us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.705059:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 607 00000100:00100000:1.0:1762166877.705938:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.705974:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444615168 00000100:00100000:3.0:1762166877.705979:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444615168 00000004:00100000:3.0:1762166877.705996:0:30818:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) @@@ lock 000000002704a37e cookie 0x779cfd37a0f9210f req@ffff9ee37f2d2d80 x1847765444615168/t0(0) o101->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:663/0 lens 376/0 e 0 to 0 dl 1762166888 ref 1 fl New:/602/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000004:00010000:3.0:1762166877.706004:0:30818:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) ### hpreq resend ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca02be lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9210f expref: 14 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166877.706032:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 24 00000100:00100000:3.0:1762166877.706040:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:50095:x1847765444615168:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.706049:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.706057:0:30818:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue()) @@@ found existing lock cookie 0xf915a5bdf3ca02be req@ffff9ee37f2d2d80 x1847765444615168/t0(0) o101->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:663/0 lens 376/0 e 0 to 0 dl 1762166888 ref 1 fl Interpret:H/602/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1762166877.706083:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228800/0xf915a5bdf3ca02be lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9210f expref: 14 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.706096:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960700) 00010000:00010000:3.0:1762166877.706098:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166877.706100:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228800, rc 0) 00000100:00100000:3.0:1762166877.706126:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:50095:x1847765444615168:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 88us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.706137:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 24 00000100:00100000:1.0:1762166877.707824:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.707862:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444615552 00000100:00100000:0.0:1762166877.707870:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444615552 00000100:00100000:0.0:1762166877.707938:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 271 00000100:00100000:0.0:1762166877.707948:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:50095:x1847765444615552:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166877.708137:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:50095:x1847765444615552:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 191us (316us total) trans 8589935250 rc 0/0 00000100:00100000:0.0:1762166877.708145:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 271 00000100:00100000:1.0:1762166877.709151:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.709189:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444615808 00000100:00100000:0.0:1762166877.709193:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444615808 00000100:00100000:0.0:1762166877.709218:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 272 00000100:00100000:0.0:1762166877.709223:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:50095:x1847765444615808:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:0.0:1762166877.709463:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x4b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166877.709566:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3ca02c5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.709584:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3ca02c5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.709601:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3ca02c5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.709609:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3ca02c5 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.709615:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3ca02c5 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.709621:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3ca02c5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.709640:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166877.709684:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166877.709691:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3ca02c5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166877.709700:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166877.709704:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3ca02c5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166877.709713:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3ca02c5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166877.709726:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4b:0x0].0x0 (ffff9ee34bdb4e00) 00000100:00100000:0.0:1762166877.709728:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:50095:x1847765444615808:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 502us (578us total) trans 8589935251 rc 0/0 00010000:00010000:2.0:1762166877.709730:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166877.709737:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3ca02c5 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00000100:00100000:0.0:1762166877.709742:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 272 00010000:00010000:2.0:1762166877.709750:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199200/0xf915a5bdf3ca02c5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:2.0:1762166877.709794:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166877.709796:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166877.709800:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166877.717591:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.717649:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444615936 00000100:00100000:3.0:1762166877.717660:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444615936 00000100:00100000:3.0:1762166877.717716:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 608 00000100:00100000:3.0:1762166877.717726:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:50097:x1847765444615936:12345-192.168.203.35@tcp:101:stat.0 00010000:00010000:3.0:1762166877.717750:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.717802:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca02cc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92116 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.717886:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca02d3 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.717900:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca02d3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.717911:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca02d3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.717925:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca02da lrc: 3/1,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.717932:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca02da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.717938:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca02da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718050:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02e1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718058:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718078:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762166877.718106:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 5 00000004:00200000:3.0:1762166877.718110:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166877.718127:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718140:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718146:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca02d3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718150:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca02d3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718154:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca02d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718158:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.718160:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca02d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718165:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca02d3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718172:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee363960400) 00010000:00010000:3.0:1762166877.718174:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166877.718176:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca02d3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718180:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca02d3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718193:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca02da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718196:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca02da lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718200:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca02da lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718202:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.718204:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca02da lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718207:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca02da lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718211:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0xd5143738 (ffff9ee363960500) 00010000:00010000:3.0:1762166877.718212:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166877.718214:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca02da lrc: 2/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718216:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca02da lrc: 0/0,0 mode: --/PR res: [0x200000404:0x47:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.718236:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca02cc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92116 expref: 18 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.718247:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92116 expref: 17 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.718253:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960700) 00010000:00010000:3.0:1762166877.718260:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166877.718263:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348229c00, rc 0) 00000100:00100000:3.0:1762166877.718334:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:50097:x1847765444615936:12345-192.168.203.35@tcp:101:stat.0 Request processed in 609us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.718342:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 608 00000100:00100000:1.0:1762166877.727690:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.727815:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444616064 00000100:00100000:0.0:1762166877.727825:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444616064 00000100:00100000:0.0:1762166877.727898:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 273 00000100:00100000:0.0:1762166877.727908:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358653c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:50098:x1847765444616064:12345-192.168.203.35@tcp:49:lfs.0 00000100:00100000:0.0:1762166877.728032:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358653c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:50098:x1847765444616064:12345-192.168.203.35@tcp:49:lfs.0 Request processed in 125us (353us total) trans 0 rc -61/-61 00000100:00100000:0.0:1762166877.728040:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 273 00000100:00100000:1.0:1762166877.729409:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.729450:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444616320 00000100:00100000:3.0:1762166877.729457:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444616320 00000100:00100000:3.0:1762166877.729517:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 609 00000100:00100000:3.0:1762166877.729526:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:50098:x1847765444616320:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.729541:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.729560:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca02e8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9211d expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.729638:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca02ef lrc: 3/1,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.729651:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca02ef lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.729662:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca02ef lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762166877.729672:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 5 00010000:00010000:3.0:1762166877.729839:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca02e8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9211d expref: 20 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.729857:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228200/0xf915a5bdf3ca02ef lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x48:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9211d expref: 19 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.729865:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960700) 00010000:00010000:3.0:1762166877.729878:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166877.729881:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228200, rc 0) 00000100:00100000:3.0:1762166877.729924:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:50098:x1847765444616320:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 399us (520us total) trans 8589935252 rc 0/0 00000100:00100000:3.0:1762166877.729931:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 609 00000100:00100000:1.0:1762166877.731637:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.731683:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444616448 00000100:00100000:0.0:1762166877.731692:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444616448 00000100:00100000:0.0:1762166877.731739:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 274 00000100:00100000:0.0:1762166877.731748:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:50098:x1847765444616448:12345-192.168.203.35@tcp:49:lfs.0 00000100:00100000:0.0:1762166877.731885:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:50098:x1847765444616448:12345-192.168.203.35@tcp:49:lfs.0 Request processed in 137us (257us total) trans 0 rc -61/-61 00000100:00100000:0.0:1762166877.731893:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 274 00000100:00100000:1.0:1762166877.734074:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.734129:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444616704 00000100:00100000:3.0:1762166877.734140:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444616704 00000100:00100000:3.0:1762166877.734209:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 610 00000100:00100000:3.0:1762166877.734222:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:50098:x1847765444616704:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.734248:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.734272:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca02fd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92124 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.734410:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0304 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.734427:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02e1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92116 expref: 20 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.734436:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0304 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.734488:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92116 expref: 20 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.734502:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02e1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92116 expref: 20 pid: 30818 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1762166877.734517:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765452027136:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166877.734629:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36cb756c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166877.735988:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765452027136:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166877.736021:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0304 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166877.736032:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.736123:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444616832 00000100:00100000:0.0:1762166877.736131:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444616832 00010000:00010000:0.0:1762166877.736172:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02e1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92116 expref: 21 pid: 30818 timeout: 598 lvb_type: 0 00000100:00100000:0.0:1762166877.736216:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 935 00000100:00100000:0.0:1762166877.736228:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765444616832:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166877.736245:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166877.736253:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02e1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92116 expref: 21 pid: 30818 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.736266:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92116 expref: 21 pid: 30818 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.736304:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229c00/0xf915a5bdf3ca02e1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92116 expref: 21 pid: 30818 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.736324:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960700) 00010000:00010000:0.0:1762166877.736329:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0304 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.736339:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0304 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.736346:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0304 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.736376:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166877.736404:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0304 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.736415:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0304 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166877.736435:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765444616832:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 207us (401us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166877.736436:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 5 00000100:00100000:0.0:1762166877.736456:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 935 00010000:00010000:3.0:1762166877.736672:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca02fd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92124 expref: 21 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.736694:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0304 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92124 expref: 20 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.736702:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960700) 00010000:00010000:3.0:1762166877.736706:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166877.736708:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228000, rc 0) 00000100:00100000:3.0:1762166877.736747:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:50098:x1847765444616704:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2528us (2682us total) trans 8589935253 rc 0/0 00000100:00100000:3.0:1762166877.736754:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 610 00000100:00100000:1.0:1762166877.738460:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.738545:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444617088 00000100:00100000:3.0:1762166877.738561:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444617088 00000100:00100000:3.0:1762166877.738630:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 611 00000100:00100000:3.0:1762166877.738641:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:50098:x1847765444617088:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.738664:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.738696:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca0312 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9212b expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.739193:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca0319 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.739205:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca0319 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.739215:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca0319 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762166877.739225:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x4c:0x0]: returning size 0 00010000:00010000:3.0:1762166877.739268:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca0312 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9212b expref: 23 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.739299:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca0319 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9212b expref: 22 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.739309:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4c:0x0].0x0 (ffff9ee363960500) 00010000:00010000:3.0:1762166877.739312:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166877.739316:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348229400, rc 0) 00000100:00100000:3.0:1762166877.739386:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:50098:x1847765444617088:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 747us (937us total) trans 8589935254 rc 0/0 00000100:00100000:3.0:1762166877.739394:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 611 00000100:00100000:1.0:1762166877.740941:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.741002:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444617344 00000100:00100000:3.0:1762166877.741009:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444617344 00000100:00100000:3.0:1762166877.741055:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 612 00000100:00100000:3.0:1762166877.741065:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:50098:x1847765444617344:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.741083:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.741105:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0327 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92132 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.741178:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca032e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.741190:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca0319 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9212b expref: 23 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.741198:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca032e lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.741229:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca0319 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9212b expref: 23 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.741242:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca0319 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9212b expref: 23 pid: 30818 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1762166877.741255:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765452027264:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166877.741335:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee363992d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166877.742270:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765452027264:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166877.742363:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca032e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166877.742411:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.742491:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444617472 00000100:00100000:0.0:1762166877.742506:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444617472 00010000:00010000:0.0:1762166877.742555:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca0319 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9212b expref: 24 pid: 30818 timeout: 598 lvb_type: 0 00000100:00100000:0.0:1762166877.742603:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 936 00000100:00100000:0.0:1762166877.742613:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765444617472:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166877.742632:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166877.742641:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca0319 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9212b expref: 24 pid: 30818 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.742652:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca0319 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9212b expref: 24 pid: 30818 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.742739:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229400/0xf915a5bdf3ca0319 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9212b expref: 24 pid: 30818 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.742760:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4c:0x0].0x0 (ffff9ee363960500) 00010000:00010000:0.0:1762166877.742798:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca032e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.742806:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca032e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.742815:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca032e lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.742842:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166877.742890:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765444617472:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 277us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166877.742902:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 936 00010000:00010000:3.0:1762166877.742965:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca032e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.742974:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca032e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762166877.742991:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x4c:0x0]: returning size 0 00000004:00080000:3.0:1762166877.743379:0:30818:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x90:0x0], index 1: 0 00000004:00080000:3.0:1762166877.743391:0:30818:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x90:0x0], index 0: 0 00000004:00080000:3.0:1762166877.743397:0:30818:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x91:0x0], index 1: 0 00010000:00010000:3.0:1762166877.743524:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca032e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.743530:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca032e lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.743535:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca032e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.743538:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762166877.743541:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca032e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.743546:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca032e lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.743552:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4c:0x0].0x0 (ffff9ee363960500) 00010000:00010000:3.0:1762166877.743554:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166877.743557:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca032e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.743560:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229200/0xf915a5bdf3ca032e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.743596:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0327 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92132 expref: 23 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.743603:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47:0x0].0x0 (ffff9ee363960400) 00010000:00010000:3.0:1762166877.743604:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166877.743612:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229e00/0xf915a5bdf3ca0327 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92132 expref: 23 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.743618:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348229e00, rc 0) 00000100:00100000:3.0:1762166877.743651:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:50098:x1847765444617344:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2589us (2716us total) trans 8589935255 rc 301/301 00000100:00100000:3.0:1762166877.743656:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 612 00000100:00100000:1.0:1762166877.744721:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.744793:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444617728 00000100:00100000:0.0:1762166877.744802:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444617728 00000100:00100000:0.0:1762166877.744851:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 275 00000100:00100000:0.0:1762166877.744861:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:50098:x1847765444617728:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166877.745166:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:50098:x1847765444617728:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 305us (447us total) trans 8589935256 rc 0/0 00000100:00100000:0.0:1762166877.745174:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 275 00000100:00100000:1.0:1762166877.746228:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.746269:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444617856 00000100:00100000:3.0:1762166877.746276:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444617856 00000100:00100000:3.0:1762166877.746328:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 613 00000100:00100000:3.0:1762166877.746337:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:50098:x1847765444617856:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.746356:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.746374:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca033c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92139 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.746443:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0343 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.746453:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0304 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92124 expref: 24 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.746459:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0343 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.746491:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0304 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92124 expref: 24 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.746500:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0304 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92124 expref: 24 pid: 30818 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1762166877.746523:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765452027392:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762166877.746572:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee363992d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166877.747420:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765452027392:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762166877.747520:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0343 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166877.747633:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.747685:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444617984 00000100:00100000:0.0:1762166877.747692:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444617984 00010000:00010000:0.0:1762166877.747716:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0304 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92124 expref: 25 pid: 30818 timeout: 598 lvb_type: 0 00000100:00100000:0.0:1762166877.747746:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 937 00000100:00100000:0.0:1762166877.747755:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765444617984:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166877.747796:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166877.747803:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0304 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92124 expref: 25 pid: 30818 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.747818:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0304 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92124 expref: 25 pid: 30818 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.747840:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228000/0xf915a5bdf3ca0304 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x48:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92124 expref: 25 pid: 30818 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.747860:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960700) 00010000:00010000:0.0:1762166877.747867:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0343 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x48:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.747876:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0343 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.747885:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0343 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.747907:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166877.747936:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0343 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.747945:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0343 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762166877.747946:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765444617984:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 191us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166877.747964:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 937 00000004:00200000:3.0:1762166877.747988:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 5 00000004:00200000:3.0:1762166877.747993:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166877.748012:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0343 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.748039:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228c00/0xf915a5bdf3ca033c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92139 expref: 24 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.748054:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228a00/0xf915a5bdf3ca0343 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92139 expref: 23 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.748061:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960700) 00010000:00010000:3.0:1762166877.748064:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166877.748066:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228a00, rc 0) 00000100:00100000:3.0:1762166877.748097:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:50098:x1847765444617856:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1761us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.748154:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 613 00000100:00100000:1.0:1762166877.749406:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.749458:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444618112 00000100:00100000:3.0:1762166877.749476:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444618112 00000100:00100000:3.0:1762166877.749529:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 614 00000100:00100000:3.0:1762166877.749538:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:50098:x1847765444618112:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.749557:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.749575:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca034a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92140 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.749634:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca0351 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.749645:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca0351 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.749653:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca0351 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762166877.749680:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x4c:0x0]: returning size 0 00000004:00200000:3.0:1762166877.749683:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762166877.749697:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca0351 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.749717:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229800/0xf915a5bdf3ca034a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92140 expref: 25 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.749728:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca0351 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92140 expref: 24 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.749733:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4c:0x0].0x0 (ffff9ee363960100) 00010000:00010000:3.0:1762166877.749744:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762166877.749747:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348229a00, rc 0) 00000100:00100000:3.0:1762166877.749813:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:50098:x1847765444618112:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 274us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.749821:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 614 00000100:00100000:1.0:1762166877.751148:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.751242:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444618240 00000100:00100000:2.0:1762166877.751249:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444618240 00000100:00100000:2.0:1762166877.751298:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1338 00000100:00100000:2.0:1762166877.751308:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2358:x1847765444618240:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166877.751319:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166877.751334:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3ca0358 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92147 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166877.751355:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762166877.751368:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.751371:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.751378:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3ca0358 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92147 expref: 14 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166877.751390:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f158000/0xf915a5bdf3ca0358 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92147 expref: 14 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166877.751401:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158000, rc 0) 00000100:00100000:2.0:1762166877.751447:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2358:x1847765444618240:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 140us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.751457:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1338 00000100:00100000:1.0:1762166877.752419:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.752461:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444618368 00000100:00100000:3.0:1762166877.752466:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444618368 00000100:00100000:3.0:1762166877.752503:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 615 00000100:00100000:3.0:1762166877.752511:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:50098:x1847765444618368:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.752524:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166877.752536:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca035f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9214e expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.752561:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca0366 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.752569:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca0366 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.752575:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca0366 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.752656:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3ca035f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9214e expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.752673:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228600/0xf915a5bdf3ca0366 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9214e expref: 25 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.752680:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4c:0x0].0x0 (ffff9ee363960100) 00010000:00010000:3.0:1762166877.752683:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1762166877.752692:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228600, rc 0) 00000100:00100000:3.0:1762166877.752736:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:50098:x1847765444618368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 224us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166877.752743:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 615 00000100:00100000:1.0:1762166877.753891:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.753975:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444618624 00000100:00100000:3.0:1762166877.753981:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444618624 00000100:00100000:3.0:1762166877.754019:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 616 00000100:00100000:3.0:1762166877.754029:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:50098:x1847765444618624:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762166877.754065:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166877.754089:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca0351 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92140 expref: 25 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.754104:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4c:0x0].0x0 (ffff9ee363960100) 00010000:00010000:3.0:1762166877.754117:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166877.754141:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca036d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.754152:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca036d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762166877.754159:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca036d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000040:00080000:3.0:1762166877.754483:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].22, 88 off9864 00000040:00080000:3.0:1762166877.754526:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].22, 88 off9840 00000004:00080000:3.0:1762166877.754534:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 498546770819ns, next at 499546767960ns, rc = 0 00000040:00080000:3.0:1762166877.754549:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].23, 88 off9952 00000004:00010000:3.0:1762166877.754636:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b1161820 reply state 00000000b22df031 transno 8589935257 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca036d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762166877.754645:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166877.754721:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:50098:x1847765444618624:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 693us (832us total) trans 8589935257 rc 0/0 00000100:00100000:3.0:1762166877.754728:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 616 00010000:00010000:0.0:1762166877.755481:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca036d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.755496:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca036d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.755502:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca036d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.755508:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762166877.755512:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca036d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.755519:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca036d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.755530:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4c:0x0].0x0 (ffff9ee363960100) 00010000:00010000:0.0:1762166877.755533:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1762166877.755537:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca036d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762166877.755542:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348229600/0xf915a5bdf3ca036d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762166877.755848:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.756245:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444618752 00000100:00100000:3.0:1762166877.756257:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444618752 00000100:00100000:3.0:1762166877.756305:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 617 00000100:00100000:3.0:1762166877.756313:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:50098:x1847765444618752:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762166877.756330:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166877.756435:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca0374 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92155 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.756476:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca0374 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92155 expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.756489:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca0374 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92155 expref: 26 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.756504:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4c:0x0].0x0 (ffff9ee363960100) 00010000:00010000:2.0:1762166877.756507:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166877.756510:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158200, rc 0) 00000100:00100000:2.0:1762166877.756550:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:50098:x1847765444618752:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 238us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.756557:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 617 00000100:00100000:1.0:1762166877.757793:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.757842:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444618880 00000100:00100000:2.0:1762166877.757848:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444618880 00000100:00100000:2.0:1762166877.757888:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1339 00000100:00100000:2.0:1762166877.757897:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765444618880:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762166877.758121:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166877.758126:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x91:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1762166877.758128:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166877.758131:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x91:0x0] updating lvb ctime from disk: 0 -> 1762166878 00002000:00010000:2.0:1762166877.758133:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x91:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762166877.758178:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444618880:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 282us (389us total) trans 17179869490 rc 0/0 00000100:00100000:2.0:1762166877.758186:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1339 00000100:00100000:1.0:1762166877.759178:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.759221:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444619008 00000100:00100000:0.0:1762166877.759226:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444619008 00000100:00100000:0.0:1762166877.759260:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 276 00000100:00100000:0.0:1762166877.759267:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:50098:x1847765444619008:12345-192.168.203.35@tcp:49:lfs.0 00000100:00100000:0.0:1762166877.759374:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:50098:x1847765444619008:12345-192.168.203.35@tcp:49:lfs.0 Request processed in 107us (200us total) trans 0 rc -61/-61 00000100:00100000:0.0:1762166877.759383:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 276 00000100:00100000:1.0:1762166877.760623:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.760716:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444619264 00000100:00100000:2.0:1762166877.760724:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444619264 00000100:00100000:2.0:1762166877.760806:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 618 00000100:00100000:2.0:1762166877.760817:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:50098:x1847765444619264:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166877.760833:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166877.760853:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3ca037b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9215c expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.760962:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0382 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166877.760977:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0382 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166877.760987:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0382 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762166877.761000:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x48:0x0]: returning size 5 00010000:00010000:2.0:1762166877.761129:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3ca037b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x48:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9215c expref: 29 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.761146:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0382 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x48:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9215c expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.761155:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960700) 00010000:00010000:2.0:1762166877.761158:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166877.761161:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f158a00, rc 0) 00000100:00100000:2.0:1762166877.761210:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:50098:x1847765444619264:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 395us (589us total) trans 8589935258 rc 0/0 00000100:00100000:2.0:1762166877.761217:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 618 00000100:00100000:1.0:1762166877.762476:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.762545:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444619392 00000100:00100000:2.0:1762166877.762552:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444619392 00000100:00100000:2.0:1762166877.762590:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1340 00000100:00100000:2.0:1762166877.762597:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765444619392:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762166877.762629:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca0390 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.762646:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159800/0xf915a5bdf3ca0294 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92101 expref: 15 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.762654:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166877.762656:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166877.762659:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca0390 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.762690:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159800/0xf915a5bdf3ca0294 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92101 expref: 15 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.762702:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159800/0xf915a5bdf3ca0294 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92101 expref: 15 pid: 26444 timeout: 598 lvb_type: 0 00000100:00100000:2.0:1762166877.762716:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452027520:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762166877.762811:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166877.763658:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765452027520:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762166877.763677:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca0390 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166877.763826:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.763879:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444619520 00000100:00100000:0.0:1762166877.763885:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444619520 00010000:00010000:0.0:1762166877.763908:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159800/0xf915a5bdf3ca0294 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92101 expref: 16 pid: 26444 timeout: 598 lvb_type: 0 00000100:00100000:0.0:1762166877.763943:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 938 00000100:00100000:0.0:1762166877.763952:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765444619520:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166877.763964:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166877.763989:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159800/0xf915a5bdf3ca0294 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92101 expref: 16 pid: 26444 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.764001:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159800/0xf915a5bdf3ca0294 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92101 expref: 16 pid: 26444 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.764021:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159800/0xf915a5bdf3ca0294 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92101 expref: 16 pid: 26444 timeout: 598 lvb_type: 0 00010000:00010000:0.0:1762166877.764030:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166877.764032:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166877.764035:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca0390 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.764042:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca0390 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.764062:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166877.764080:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca0390 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166877.764091:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765444619520:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 140us (265us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166877.764094:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca0390 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166877.764116:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 938 00010000:00010000:2.0:1762166877.764124:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca0390 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.764133:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca0390 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.764142:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca0390 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.764149:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f159a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762166877.764153:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca0390 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.764161:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca0390 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.764174:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca0390 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.764181:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca0390 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166877.764230:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2361:x1847765444619392:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 1632us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.764237:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1340 00000100:00100000:1.0:1762166877.789491:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.789576:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444619648 00000100:00100000:2.0:1762166877.789588:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444619648 00000100:00100000:2.0:1762166877.789642:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 1341 00000100:00100000:2.0:1762166877.789652:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2358:x1847765444619648:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166877.789667:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166877.789685:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca0397 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f92163 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166877.789708:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x8f:0x0] initial LVB size: 5, mtime: 0x69088858, atime: 0x69088858, ctime: 0x6908885d, blocks: 0xb 00010000:00010000:2.0:1762166877.789728:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.789730:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166877.789739:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca0397 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92163 expref: 15 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166877.789755:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f159a00/0xf915a5bdf3ca0397 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92163 expref: 15 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166877.789800:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159a00, rc 0) 00000100:00100000:2.0:1762166877.789846:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2358:x1847765444619648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 197us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166877.789851:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 1341 00000100:00100000:1.0:1762166877.791857:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166877.791936:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444619776 00000100:00100000:3.0:1762166877.791944:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444619776 00000100:00100000:3.0:1762166877.792010:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 992 00000100:00100000:3.0:1762166877.792020:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2359:x1847765444619776:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762166877.792049:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca039e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.792060:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166877.792062:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166877.792067:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca039e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.792078:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca039e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.792196:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca039e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.792202:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca039e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.792221:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca039e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.792226:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348229a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762166877.792229:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca039e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.792234:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca039e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.792244:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca039e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166877.792249:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee348229a00/0xf915a5bdf3ca039e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166877.792312:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2359:x1847765444619776:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 292us (459us total) trans 0 rc 5/5 00000100:00100000:3.0:1762166877.792319:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 992 00000100:00100000:1.0:1762166877.793470:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762166877.793532:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444620032 00000100:00100000:2.0:1762166877.793539:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444620032 00000100:00100000:2.0:1762166877.793583:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 619 00000100:00100000:2.0:1762166877.793593:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:50098:x1847765444620032:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762166877.793614:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166877.793618:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1762166877.793638:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158200/0xf915a5bdf3ca0374 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f92155 expref: 28 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.793650:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4c:0x0].0x0 (ffff9ee363960100) 00010000:00010000:2.0:1762166877.793653:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166877.793662:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3ca03a5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0f9216a expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166877.793702:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3ca03ac lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166877.793714:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3ca03ac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762166877.793723:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3ca03ac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000040:00080000:2.0:1762166877.794053:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].24, 88 off10040 00000004:00080000:2.0:1762166877.794061:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 498586297690ns, next at 499407086505ns, rc = 0 00000040:00080000:2.0:1762166877.794099:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].23, 88 off9928 00000004:00080000:2.0:1762166877.794105:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 498586341833ns, next at 499546767960ns, rc = 0 00000040:00080000:2.0:1762166877.794182:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].25, 88 off10128 00000004:00080000:2.0:1762166877.794188:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 498586424870ns, next at 499407086505ns, rc = 0 00000001:00080000:1.0:1762166877.805272:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935256 is committed 00000020:00080000:1.0:1762166877.805311:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee243611780 refcount 2 committed 0 result 0 batchid 4294969133 00000020:00080000:1.0:1762166877.805317:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee3606cbc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee243611cc0 00000020:00080000:1.0:1762166877.805321:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee3606cbb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee358652c00 00000020:00080000:1.0:1762166877.805347:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969132 batchid updated 00000020:00080000:0.0:1762166877.805371:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969133 committed batchid 4294969132 00000001:00080000:2.0:1762166877.805409:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935259 is committed 00000004:00080000:2.0:1762166877.805417:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 18 committed 00000004:00080000:2.0:1762166877.805431:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 18 committed 00010000:00010000:3.0:1762166877.805440:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3ca03ac lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9216a expref: 23 pid: 30818 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166877.805442:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 17 committed 00010000:00010000:3.0:1762166877.805453:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4c:0x0].0x0 (ffff9ee363960100) 00010000:00010000:3.0:1762166877.805456:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:2.0:1762166877.805457:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 17 committed 00010000:00010000:3.0:1762166877.805485:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159600/0xf915a5bdf3ca03a5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9216a expref: 16 pid: 30818 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1762166877.805510:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f159800/0xf915a5bdf3ca03ac lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9216a expref: 14 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166877.805546:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1762166877.805550:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4c:0x0].0x0 (ffff9ee363960100) 00010000:00010000:3.0:1762166877.805554:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:2.0:1762166877.805554:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765452027904:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1762166877.805557:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f159800, rc 0) 00000100:00100000:1.0:1762166877.805562:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765452027648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166877.805633:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:50098:x1847765444620032:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 12040us (12164us total) trans 8589935259 rc 0/0 00000100:00100000:2.0:1762166877.805633:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1762166877.805635:0:30853:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969132 cancel update log [0x200000bd0:0x1:0x0].2: rc = 0 00000100:00100000:1.0:1762166877.805636:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765452027776:0@lo:2:osp-syn-0-0.0 00000020:00080000:0.0:1762166877.805648:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969132 00000100:00100000:3.0:1762166877.805653:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 619 00000100:00100000:1.0:1762166877.805687:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166877.805699:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452027904 00000100:00100000:2.0:1762166877.805706:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452027904 00000100:00100000:3.0:1762166877.805709:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452027776 00000100:00100000:3.0:1762166877.805712:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452027776 00000100:00100000:1.0:1762166877.805731:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166877.805754:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452027648 00000100:00100000:2.0:1762166877.805759:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452027648 00000100:00100000:3.0:1762166877.805801:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:3.0:1762166877.805813:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3294:x1847765452027904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166877.805813:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1762166877.805828:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3293:x1847765452027776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166877.805834:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:2.0:1762166877.805844:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765452027648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762166877.805972:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166877.805976:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x91:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1762166877.805978:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166877.805981:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x91:0x0] updating lvb ctime from disk: 1762166878 -> 1762166878 00002000:00010000:3.0:1762166877.805984:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x91:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166877.806018:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765452027776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 195us (330us total) trans 21474836813 rc 0/0 00000100:00100000:2.0:1762166877.806024:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765452027648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (290us total) trans 17179869492 rc 0/0 00000100:00100000:0.0:1762166877.806028:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:2.0:1762166877.806039:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000004:00080000:1.0:1762166877.806068:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc58380/2, rc 0, transno 21474836813 00000100:00100000:1.0:1762166877.806087:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765452027776:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166877.806088:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765452027904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 277us (455us total) trans 17179869491 rc 0/0 00000004:00080000:2.0:1762166877.806089:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f285c00/2, rc 0, transno 17179869491 00000100:00100000:3.0:1762166877.806100:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:2.0:1762166877.806104:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765452027904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166877.806118:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f2d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765452028032:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166877.806150:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762166877.806188:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f285880/2, rc 0, transno 17179869492 00000100:00100000:1.0:1762166877.806195:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765452027648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166877.806247:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452028032 00000100:00100000:3.0:1762166877.806252:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452028032 00000100:00100000:0.0:1762166877.806287:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765452028160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166877.806300:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:3.0:1762166877.806312:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765452028032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166877.806324:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1762166877.806328:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166877.806334:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765452028288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166877.806352:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452028160 00000100:00100000:2.0:1762166877.806357:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452028160 00000100:00100000:1.0:1762166877.806371:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166877.806381:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1762166877.806387:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f2d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765452028160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166877.806410:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452028288 00000100:00100000:0.0:1762166877.806417:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452028288 00000100:00100000:0.0:1762166877.806449:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:0.0:1762166877.806459:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765452028288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166877.806472:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765452028032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 163us (321us total) trans 21474836814 rc 0/0 00000100:00100000:3.0:1762166877.806480:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000004:00080000:1.0:1762166877.806507:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f2d3480/2, rc 0, transno 21474836814 00000100:00100000:1.0:1762166877.806515:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f2d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765452028032:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166877.806535:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f2d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765452028160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 146us (209us total) trans 17179869493 rc 0/0 00000100:00100000:2.0:1762166877.806543:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00002000:00010000:0.0:1762166877.806571:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x91:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:2.0:1762166877.806572:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f285500/2, rc 0, transno 17179869493 00002000:00010000:0.0:1762166877.806578:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x91:0x0] updating lvb mtime from disk: 0 -> 0 00000100:00100000:2.0:1762166877.806580:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765452028160:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762166877.806584:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166877.806588:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x91:0x0] updating lvb ctime from disk: 1762166878 -> 1762166878 00002000:00010000:0.0:1762166877.806591:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x91:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762166877.806633:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765452028288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (262us total) trans 17179869494 rc 0/0 00000100:00100000:0.0:1762166877.806641:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000004:00080000:1.0:1762166877.806655:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f284700/2, rc 0, transno 17179869494 00000100:00100000:1.0:1762166877.806663:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765452028288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166877.818534:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.818651:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444620160 00000100:00100000:0.0:1762166877.818663:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444620160 00000100:00100000:0.0:1762166877.818734:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 279 00000100:00100000:0.0:1762166877.818742:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:50098:x1847765444620160:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:0.0:1762166877.818759:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166877.818831:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f158a00/0xf915a5bdf3ca0382 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x48:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0f9215c expref: 14 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166877.818850:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48:0x0].0x0 (ffff9ee363960700) 00010000:00010000:0.0:1762166877.818854:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166877.818909:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:50098:x1847765444620160:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 165us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166877.818915:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 279 00000100:00100000:1.0:1762166877.820319:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.820405:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444620416 00000100:00100000:0.0:1762166877.820414:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444620416 00000100:00100000:0.0:1762166877.820462:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 277 00000100:00100000:0.0:1762166877.820474:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:50098:x1847765444620416:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166877.820827:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:50098:x1847765444620416:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 355us (514us total) trans 8589935260 rc 0/0 00000100:00100000:0.0:1762166877.820836:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 277 00000100:00100000:1.0:1762166877.821946:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.822023:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444620672 00000100:00100000:0.0:1762166877.822032:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444620672 00000100:00100000:0.0:1762166877.822080:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 278 00000100:00100000:0.0:1762166877.822092:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358653850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:50098:x1847765444620672:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762166877.822297:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358653850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:50098:x1847765444620672:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 207us (356us total) trans 8589935261 rc 0/0 00000100:00100000:0.0:1762166877.822305:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 278 00000100:00100000:1.0:1762166877.823105:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762166877.823154:0:31351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444620928 00000100:00100000:0.0:1762166877.823160:0:31351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444620928 00000100:00100000:0.0:1762166877.823194:0:31351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 279 00000100:00100000:0.0:1762166877.823202:0:31351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:50098:x1847765444620928:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:0.0:1762166877.823575:0:31351:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x4c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1762166877.823719:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].26, 64 off10192 00000040:00080000:0.0:1762166877.823800:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].24, 64 off9992 00000040:00080000:0.0:1762166877.823822:0:31351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].27, 64 off10256 00010000:00010000:0.0:1762166877.823900:0:31351:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3ca03b3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.823920:0:31351:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3ca03b3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.823933:0:31351:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3ca03b3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.823947:0:31351:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3ca03b3 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.823952:0:31351:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3ca03b3 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.823958:0:31351:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3ca03b3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 31351 initiator: MDT0 00010000:00010000:0.0:1762166877.823984:0:31351:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166877.824031:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166877.824038:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3ca03b3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166877.824052:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347199600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762166877.824056:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3ca03b3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166877.824063:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3ca03b3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166877.824075:0:32135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4c:0x0].0x0 (ffff9ee363960100) 00010000:00010000:1.0:1762166877.824078:0:32135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166877.824082:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3ca03b3 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166877.824086:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347199600/0xf915a5bdf3ca03b3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 31351 initiator: MDT0 00010000:00010000:1.0:1762166877.824101:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166877.824104:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166877.824106:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166877.824121:0:31351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:50098:x1847765444620928:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 918us (1017us total) trans 8589935262 rc 0/0 00000100:00100000:0.0:1762166877.824131:0:31351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 279 00000001:00080000:3.0:1762166877.877614:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836813 is committed 00000001:00080000:3.0:1762166877.877633:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836814 is committed 00000001:00080000:3.0:1762166877.877637:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836811 is committed 00000100:00100000:1.0:1762166878.308208:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166878.308289:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444621056 00000100:00100000:1.0:1762166878.308292:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762166878.308306:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444621056 00000100:00100000:0.0:1762166878.308346:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765444621184 00000100:00100000:0.0:1762166878.308351:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765444621184 00000100:00100000:3.0:1762166878.308390:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 69 00000100:00100000:3.0:1762166878.308403:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2359:x1847765444621056:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:0.0:1762166878.308418:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 211 00000100:00100000:0.0:1762166878.308431:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2359:x1847765444621184:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762166878.308490:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2359:x1847765444621056:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 90us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166878.308500:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+9:2359:x1847765444621184:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 68us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166878.308501:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 69 00000100:00100000:0.0:1762166878.308514:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 211 00000001:02000400:1.0:1762166878.584106:0:32501:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_61a: @@@@@@ FAIL: cannot migrate /mnt/lustre/d61a.sanity-flr/f61a.sanity-flr 00010000:00010000:1.0:1762166878.632009:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 60938 lines, 60938 kept, 0 dropped, 0 bad.